Skip to content

Fix LISA init OOM caused by deepspeed#728

Merged
research4pan merged 2 commits into
mainfrom
rpan-fix-lisa
Apr 1, 2024
Merged

Fix LISA init OOM caused by deepspeed#728
research4pan merged 2 commits into
mainfrom
rpan-fix-lisa

Add paged_adamw to avoid occasional OOM

d588b5a
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs