Skip to content

llama : pad KV cache size - #4280

Merged
ggerganov merged 2 commits into
masterfrom
gg/pad-kv-cache
Dec 3, 2023
Merged

llama : pad KV cache size#4280
ggerganov merged 2 commits into
masterfrom
gg/pad-kv-cache

metal : try to improve batched decoding

3cb1c34
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs