docs(fold): CUDA's flash-attention-off KV cells ran at batch 512; the f32 cast is llama.cpp's graph - #401

docs(fold): CUDA's flash-attention-off KV cells ran at batch 512; the f32 cast is llama.cpp's graph#401

glennneuber merged 1 commit into

mainMaxusAI/ollama:mainfrom

docs/kv-cuda-batch-caveatMaxusAI/ollama:docs/kv-cuda-batch-caveatCopy head branch name to clipboard