Skip to content

[Feature] ernie4_5_vl_moe support huggingface safetensor loading - #3750

Merged
yuanlehome merged 7 commits into
PaddlePaddle:developfrom
aquagull:vl_torch
Sep 3, 2025
Merged

yuanlehome merged 7 commits into
PaddlePaddle:developfrom
aquagull:vl_torch

Conversation

@aquagull

@aquagull aquagull commented Aug 31, 2025

Copy link
Copy Markdown
Contributor

ernie4_5_vl_moe support huggingface safetensor loadding.

@paddle-bot

paddle-bot Bot commented Aug 31, 2025

Copy link
Copy Markdown

Thanks for your contribution!

Comment on lines +160 to +165
setattr(
self.gate.weight,
"model_format",
"",
)

@aquagull aquagull Sep 2, 2025

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

组网没有转置,因此这个权重也不需要转置。

Comment thread fastdeploy/model_executor/models/ernie4_5_vl/dfnrope/modeling.py Outdated
Comment thread fastdeploy/model_executor/models/ernie4_5_vl/ernie4_5_vl_moe.py
Comment thread fastdeploy/model_executor/models/ernie4_5_vl/ernie4_5_vl_moe.py Outdated
Comment thread fastdeploy/model_executor/models/ernie4_5_vl/ernie4_5_vl_moe.py
@yuanlehome
yuanlehome merged commit 31313e0 into PaddlePaddle:develop Sep 3, 2025
15 of 17 checks passed
qwes5s5 pushed a commit to qwes5s5/FastDeploy that referenced this pull request Sep 3, 2025
…addlePaddle#3750)

* update

* update

* update in tp

* add todo

* update

---------

Co-authored-by: aquagull <hongyuh@qq.com>
@aquagull
aquagull deleted the vl_torch branch October 15, 2025 03:44
xiaoguoguo626807 pushed a commit to xiaoguoguo626807/FastDeploy that referenced this pull request May 7, 2026
…addlePaddle#3750)

* update

* update

* update in tp

* add todo

* update

---------

Co-authored-by: aquagull <hongyuh@qq.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants