Skip to content

fix(gemma4_moe): re-tie lm_head to active embed_tokens on MoE path - #2601

Merged
yuhezhang-ai merged 4 commits into
NVIDIA-NeMo:mainfrom
Achyuthan-S:Achyuthan-S/fix/gemma4-moe-tied-lm-head
Jun 22, 2026
Merged

fix(gemma4_moe): re-tie lm_head to active embed_tokens on MoE path#2601
yuhezhang-ai merged 4 commits into
NVIDIA-NeMo:mainfrom
Achyuthan-S:Achyuthan-S/fix/gemma4-moe-tied-lm-head

Commits

  1. Commits on Jun 16, 2026

  2. Commits on Jun 17, 2026