Skip to content

1bit serve --prefill-device hrx: prompt prefill on HRX, decode on Vulkan, one shared KV cache (zero copy) - #30

Merged
bong-water-water-bong merged 1 commit into
mainfrom
hrx-prefill-split
Sep 24, 2026
Merged

1bit serve --prefill-device hrx: prompt prefill on HRX, decode on Vulkan, one shared KV cache (zero copy)#30
bong-water-water-bong merged 1 commit into
mainfrom
hrx-prefill-split

Commits

  1. Commits on Sep 24, 2026