Skip to content

feat(cuda): add LLamaSharp.Backend.Cuda13 packages - #1441

Merged
martindevans merged 1 commit into
SciSharp:masterfrom
modelpath-dev:feat/1360-cuda13-nuget
Oct 14, 2026
Merged

martindevans merged 1 commit into
SciSharp:masterfrom
modelpath-dev:feat/1360-cuda13-nuget

Conversation

@modelpath-dev

@modelpath-dev modelpath-dev commented Sep 18, 2026 •

Copy link
Copy Markdown
Contributor

Why

Part 3 of the CUDA 13 split for #1360. Ships the Backend.Cuda13 nuspecs, Runtime.targets copy rules for cu13.0.0, and package docs. Hold this until the NuGet ownership issue Martin mentioned is resolved and cuda13 binaries exist from part 1.

Depends on #1440.

Scope

  • LLama/runtimes/build/LLamaSharp.Backend.Cuda13*.nuspec
  • LLama/LLamaSharp.Runtime.targets copy-to-output links for cu13.0.0 → cuda13
  • README.md, docs/QuickStart.md package mentions

Out of scope: compile workflow and NativeLibraryWithCuda (parts 1 and 2).

Tradeoffs

Runtime.targets sits with the NuGet packaging change, not the loader, because it is copy-to-output packaging for deps, not Prepare() probe logic.

Blast Radius

Adds new packages and optional copy rules gated on Exists(...). Existing Cuda12 packages and paths are untouched. Publishing still waits on package ownership.

Verification

  • NuGet-only files vs the loader tip: targets, three nuspecs, README, QuickStart.
  • Full tip patch-id matches the pre-split combined change that used to live on this stack.
  • No local pack run (needs binaries from Compile). Review against the Cuda12 nuspec/targets pattern.

@martindevans

Copy link
Copy Markdown
Member

Our nuget key issue has finally been sorted out, so I think I can merge this now 🥳

Could you rebase it onto master before I give it a final review please.

Ship the Cuda13 nuspecs, Runtime.targets copy rules for cu13.0.0 deps, and the README/QuickStart package mentions. Safe to land after binaries exist and the nuget ownership issue is resolved.
@modelpath-dev
modelpath-dev force-pushed the feat/1360-cuda13-nuget branch from 05a11e2 to a787a08 Compare October 14, 2026 08:31
@modelpath-dev

Copy link
Copy Markdown
Contributor Author

@martindevans rebased onto master. Since #1439 and #1440 already landed, the PR is down to the one packaging and docs commit, and I checked that every cu13.0.0 file the new nuspecs and targets reference is in the 815a2a5915f22c_withcuda13 binaries release.

@martindevans
martindevans merged commit 5f3b044 into SciSharp:master Oct 14, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants