Repository navigation

Fix ZeRO-3 from_pretrained: load registered buffers in _load_state_dict_into_zero3_model - #45402

Merged

SunMarc merged 9 commits into

huggingface:mainfrom

saslifat-gif:fix/gemma4-zero3-base-model-prefix

Apr 17, 2026

Merged

Fix ZeRO-3 from_pretrained: load registered buffers in _load_state_dict_into_zero3_model#45402
SunMarc merged 9 commits into
huggingface:mainfrom
saslifat-gif:fix/gemma4-zero3-base-model-prefix

Commits on Apr 16, 2026
- Fix Gemma4 ZeRO-3 weight loading by correcting base_model_prefix in AudioModel and VisionModel
  saslifat-gif
  committed
  e515c72
- Revert VisionModel base_model_prefix change per review feedback
  saslifat-gif
  committed
  2ddf0c6
- Fix ZeRO-3 loading: handle buffers in _load_state_dict_into_zero3_model
  saslifat-gif
  committed
  28d38cb
- Fix indentation in _load_state_dict_into_zero3_model buffer handling
  saslifat-gif
  committed
  ffc0067
- Add test for ZeRO-3 registered buffer loading
  saslifat-gif
  committed
  d5f64ab
- fix: organize imports and remove unused variable in deepspeed test
  saslifat-gif
  committed
  21f9e95
- fix: apply ruff formatting to deepspeed test
  saslifat-gif
  committed
  238dd31
- fix: copy buffers on all ranks and set _is_hf_initialized in ZeRO-3 load
  saslifat-gif
  committed
  a9fcac8
- Merge branch 'main' into fix/gemma4-zero3-base-model-prefix
  saslifat-gif
  authored
  0222a26