Skip to content

server: preserve reusable checkpoints for recurrent / hybrid prompts - #24035

Draft
Regrad wants to merge 3 commits into
ggml-org:masterfrom
Regrad:fix/qwen-hybrid-checkpoint-reuse
Draft

server: preserve reusable checkpoints for recurrent / hybrid prompts#24035
Regrad wants to merge 3 commits into
ggml-org:masterfrom
Regrad:fix/qwen-hybrid-checkpoint-reuse

server: make prompt cache state swaps atomic

920ea56
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

The logs for this run have expired and are no longer available.