Skip to content
Open
Overdue by 4 month(s)
•
Due by June 12, 2026
•Last updated Jun 21, 2026

Unified paged KV cache (epic): radix-tree-indexed paged attention with shared, refcounted copy-on-write blocks and a fused Metal paged-attention kernel. Server-side prefix-cache reuse and disaggregated serving (chunked-prefill handoff, per-frame token streaming), batched MTP speculative-decoding hardening, tool-calling and chat-template fidelity, and DiffusionGemma block-diffusion generation.

100% complete

Issues