Describe the bug
I install the deepspeed with DS_BUILD_OPS=1 pip install deepspeed and compile the extra keenal, but I get err when I use zero optimizer, I get fused_adam_cuda = FusedAdamBuilder().load(), TypeError: 'NoneType' object is not callable
Expected behavior
A clear and concise description of what you expected to happen.
ds_report output
I run ds_report and get this error
System info (please complete the following information):
- OS: CentOS
- GPU count and types: 1machines with x8 A100s each
- Python version: 3.9.12
- Cuda:11.3
- torch:1.13
Launcher context
deepspeed --num_gpus=2 train.py
Describe the bug
I install the deepspeed with
DS_BUILD_OPS=1 pip install deepspeedand compile the extra keenal, but I get err when I use zero optimizer, I getfused_adam_cuda = FusedAdamBuilder().load(),TypeError: 'NoneType' object is not callableExpected behavior
A clear and concise description of what you expected to happen.
ds_report output
I run
ds_reportand get this errorSystem info (please complete the following information):
Launcher context
deepspeed --num_gpus=2 train.py