Repository navigation
transfomers VLM base model change #713
Description
🚀 The feature, motivation and pitch
Upcoming refactor in transformers VLM models: huggingface/transformers#37033
XXXForConditionalGeneration no longer has language_model attribute for ForCausalLM. It will be changed to model attribute to hold the base model instead.language_model is available throught conditional class for backward compatiblity.
The patchings (monkey_patch and flce forward method) of VLMs in Liger Kernel will have to confront the changes.
Alternatives
No response
Additional context
No response
Activity
fix: Fix qwen2_vl and qwen2_5_vl monkey patch (#738)