Skip to content

Enhance NPU optimizations with KV cache slicing and buffer management - #314

Open
zhaixuejun1993 wants to merge 40 commits into
ravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/npu_profiling_v7
Open

Enhance NPU optimizations with KV cache slicing and buffer management#314
zhaixuejun1993 wants to merge 40 commits into
ravi9:dev_backend_openvinofrom
zhaixuejun1993:xuejun/npu_profiling_v7

openvino: add self-contained NPU model cache

c50ddca
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs