From 3b4b1196c58dac5fa5feda7f99d907a8f37a927f Mon Sep 17 00:00:00 2001 From: Jhin Lee Date: Tue, 20 Oct 2026 18:41:37 -0400 Subject: [PATCH] Document the Windows x64 native bundle download size --- CHANGELOG.md | 4 ++++ website/docs/changelog/recent-releases.md | 4 ++++ website/docs/platforms/native-build-hooks.md | 5 +++++ 3 files changed, 13 insertions(+) diff --git a/CHANGELOG.md b/CHANGELOG.md index 1e8bfbf4b..c9306e96f 100644 --- a/CHANGELOG.md +++ b/CHANGELOG.md @@ -1,3 +1,7 @@ +## Unreleased + +- Document that Windows x64 builds download the full native bundle, about 700 MiB with CUDA, even when CUDA is not selected, and how to avoid it with `llamadart_native_path`. + ## 0.15.5 - Keep Llama 3 (JSON and builtin `<|python_tag|>`), FireFunction v2, Functionary v3.1/v3.2, FunctionGemma and Gemma tool calls out of streamed answer text, and LFM2 and Kimi K2 tool calls out of streamed answer text and reasoning. diff --git a/website/docs/changelog/recent-releases.md b/website/docs/changelog/recent-releases.md index 2fc67e571..809daa73c 100644 --- a/website/docs/changelog/recent-releases.md +++ b/website/docs/changelog/recent-releases.md @@ -7,6 +7,10 @@ For canonical full release notes, use: - [`CHANGELOG.md`](https://github.com/leehack/llamadart/blob/main/CHANGELOG.md) +## Unreleased + +- Document that Windows x64 builds download the full native bundle, about 700 MiB with CUDA, even when CUDA is not selected, and how to avoid it with `llamadart_native_path`. + ## 0.15.5 - Keep Llama 3 (JSON and builtin `<|python_tag|>`), FireFunction v2, Functionary v3.1/v3.2, FunctionGemma and Gemma tool calls out of streamed answer text, and LFM2 and Kimi K2 tool calls out of streamed answer text and reasoning. diff --git a/website/docs/platforms/native-build-hooks.md b/website/docs/platforms/native-build-hooks.md index 973baa8f4..03799edc7 100644 --- a/website/docs/platforms/native-build-hooks.md +++ b/website/docs/platforms/native-build-hooks.md @@ -244,6 +244,11 @@ Selection rules: module. - CUDA runtime DLLs (`cudart64_*`, `cublas64_*`, `cublaslt64_*`) ship only with `cuda`, and OpenBLAS libraries only with `blas`. +- Modules are selected after download. On `windows-x64` the pinned archive is + about 700 MiB, mostly CUDA DLLs, and the hook downloads it once per pinned + release even when `cuda` is not selected. It is cached under the llamadart + package's `.dart_tool/llamadart/native_bundles/`. To skip the download, set + `llamadart_native_path` to a local archive or bundle. - On `windows-x64`, the hook rejects a bundle whose `cuda` module lacks the cudart and cuBLAS DLLs, or whose `blas` module lacks OpenBLAS.