Skip to content

Multiply lr scheduler steps by num_processes.#3983

Merged
sayakpaul merged 2 commits into
huggingface:mainfrom
eliphatfs:main
Jul 13, 2023
Merged

Multiply lr scheduler steps by num_processes.#3983
sayakpaul merged 2 commits into
huggingface:mainfrom
eliphatfs:main

Stop multiplying steps by gradient accumulation.

660c551
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs