### 🐛 Describe the bug Most failures are related to transformers VLM changes ## unit test qwen2vl_mrope - [x] test_qwen2vl_mrope https://github.com/linkedin/Liger-Kernel/pull/728 monkey patch - [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_mllama_for_conditional_generation https://github.com/linkedin/Liger-Kernel/pull/737 - [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_gemma3 https://github.com/linkedin/Liger-Kernel/pull/735 - [ ] test_monkey_patch::test_apply_liger_kernel_to_instance_for_qwen2_vl https://github.com/linkedin/Liger-Kernel/pull/738 https://github.com/linkedin/Liger-Kernel/pull/755 - [x] test_monkey_patch::test_apply_liger_kernel_to_instance_for_qwen2_5_vl https://github.com/linkedin/Liger-Kernel/pull/738 https://github.com/linkedin/Liger-Kernel/pull/755 ## convergence test VLM changes related #723 (config, video_processor, ...) - [x] llava https://github.com/linkedin/Liger-Kernel/pull/743 - [x] qwen2_vl https://github.com/linkedin/Liger-Kernel/pull/738 - [x] qwen2_5_vl https://github.com/linkedin/Liger-Kernel/pull/738 - [x] gemma3 https://github.com/linkedin/Liger-Kernel/pull/735 _init_weights related (#739) - [x] olmo2 https://github.com/linkedin/Liger-Kernel/pull/741 - [x] glm4 https://github.com/linkedin/Liger-Kernel/pull/741 - [x] gemma1 https://github.com/linkedin/Liger-Kernel/pull/741 - [x] gemma2 https://github.com/linkedin/Liger-Kernel/pull/741 logits numerical issue (#742) - [ ] gemma3 - [ ] gemma - [ ] paligemma - [ ] paligemma2 ### Reproduce _No response_ ### Versions liger_kernel==https://github.com/linkedin/Liger-Kernel/commit/5d25e46827cd63210373d7a15641438b0bf36c66 trasnformers==4.52.3
Activity
lancerts commentedon May 27, 2025
@momochen @shimizust for visability.
shimizust commentedon May 28, 2025
@Tcc0403 Thanks for doing the initial investigation. Can I help look into some of these? Which failures are you currently looking at?
Fix gemma3 monkey patch tests (#735)
Tcc0403 commentedon May 29, 2025
@shimizust Thanks for the help. I only checked the vlm related issues, haven't checked what caused the
_init_weightserrors.fix: Fix qwen2_vl and qwen2_5_vl monkey patch
fix: Fix qwen2_vl and qwen2_5_vl monkey patch
LigerRMSNormwith partial arguments given would cause error in _init_weights() #739Fix mllama monkey patch tests (#737)
vaibhavjindal commentedon Jun 2, 2025
#741 should fix all the _init_weights related errors
Fix RMS norm patching (#741)
fix: Fix qwen2_vl and qwen2_5_vl monkey patch (#738)