DeepSpeed Zero-3 is not compatible with `low_cpu_mem_usage=True` or with passing a `device_map`

[nicosouth]

hello!

The environment was installed as instructed without any code changes.

But an error was encountered:
DeepSpeed Zero-3 is not compatible with low_cpu_mem_usage=True or with passing a device_map

How can i solve it?

[2003pro]

Hi, we have fixed this issue in the newest version. Please git clone the repo again and have try.

[nicosouth]

Does the change remove the definition of optimizer in ds_config_zero3.json?

[2003pro]

Not only removing the definition of optimizer, but also remove device_map when loading the model. For details, please check this pr #622 .

[nicosouth]

thank you!