serve --parallel on HRX: shared KV cache, no qwen.attention (Qwen3-4B 4 slots 39 -> 153 tok/s) - #240

serve --parallel on HRX: shared KV cache, no qwen.attention (Qwen3-4B 4 slots 39 -> 153 tok/s)#240

bong-water-water-bong merged 1 commit into

main1bit-MONSTER/engine:mainfrom

hrx-parallel1bit-MONSTER/engine:hrx-parallelCopy head branch name to clipboard