cuda: retain routed experts in bounded cache - #739

Open

exochard wants to merge 3 commits into

antirez:mainfrom

exochard:perf/cuda-persistent-expert-cache

Commits on Aug 7, 2026

cuda: bound SSD weight cache and refuse host fallback
exochard
committed
283806d
cuda: overlap streamed expert uploads with compute
exochard
committed
e747490
cuda: retain routed experts in bounded cache
exochard
committed
05632d2