Repository navigation

Fix saveloadstate ov - #309

Draft

cavusmustafa wants to merge 16 commits into

ravi9:dev_backend_openvinofrom

cavusmustafa:fix_saveloadstate_ov

Draft

Fix saveloadstate ov#309
cavusmustafa wants to merge 16 commits into
ravi9:dev_backend_openvinofrom
cavusmustafa:fix_saveloadstate_ov

Commits on Sep 2, 2026
- exclude GPU/NPU failing POOL_2D case
  
  mostafafaheem
  authored and
  ravi9
  committed
  cc78b9b
- Fix pool case
  
  mostafafaheem
  authored and
  ravi9
  committed
  1dc77f6
- ggml-openvino: fix stateful decode for Gemma-4 per-layer-type head sizes
  
  cavusmustafa
  authored and
  ravi9
  committed
  eb10c12
- ggml-openvino: fix MSVC narrowing error in permute
  
  cavusmustafa
  authored and
  ravi9
  committed
  4ef6be1
- ggml-openvino: classify sliding-window layers structurally on interleaved-SWA models
  
  cavusmustafa
  authored and
  ravi9
  committed
  16d1c91
- ggml-openvino: add GGML_OPENVINO_REQUANT_KQUANT to select a 4-bit requant target
  
  cavusmustafa
  authored and
  ravi9
  committed
  5a1a131
- ggml-openvino: add GGML_OPENVINO_SPILL_DIR to spill weight buffers to disk
  
  cavusmustafa
  authored and
  ravi9
  committed
  3b89dc2
- Stateful Performance: Added pass::KVStateSeqAxis to change KV layout
  
  cavusmustafa
  authored and
  ravi9
  committed
  7dd49dc
- ggml-openvino: fix stateful decode past the sliding-window size
  
  cavusmustafa
  authored and
  ravi9
  committed
  b61592a
- ggml-openvino: refuse stateful decode that cannot resume from the KV state
  
  cavusmustafa
  authored and
  ravi9
  committed
  fb28a15
- ggml-openvino: use the per-layer KV head count for the stateful KV state
  
  cavusmustafa
  authored and
  ravi9
  committed
  c5f754a
- ggml-openvino: apply the KV state relayout to any KV head count
  
  cavusmustafa
  authored and
  ravi9
  committed
  fd9bc04
Commits on Sep 3, 2026

Navigation Menu

Repository navigation

Fix saveloadstate ov - #309

Fix saveloadstate ov#309
cavusmustafa wants to merge 16 commits into
ravi9:dev_backend_openvinofrom
cavusmustafa:fix_saveloadstate_ov

Commits on Sep 2, 2026

exclude GPU/NPU failing POOL_2D case

Fix pool case

ggml-openvino: fix stateful decode for Gemma-4 per-layer-type head sizes

ggml-openvino: fix MSVC narrowing error in permute

ggml-openvino: classify sliding-window layers structurally on interleaved-SWA models

ggml-openvino: add GGML_OPENVINO_REQUANT_KQUANT to select a 4-bit requant target

ggml-openvino: add GGML_OPENVINO_SPILL_DIR to spill weight buffers to disk

Stateful Performance: Added pass::KVStateSeqAxis to change KV layout

ggml-openvino: fix stateful decode past the sliding-window size

ggml-openvino: refuse stateful decode that cannot resume from the KV state

ggml-openvino: use the per-layer KV head count for the stateful KV state

ggml-openvino: apply the KV state relayout to any KV head count

Commits on Sep 3, 2026

ggml-openvino: keep the dynamic dim through SQR and untracked ops

ggml-openvino: guard the zero-length recurrent state reset

ggml-openvino: give a reshaping view its own ov::Tensor

ggml-openvino: accept the slot-strided conv-state writeback CPY