information about FP16

[zgchen33]

Did you use FP16 to train your model? And was the performance in the paper trained by FP32?

[NotACracker]

Did you use FP16 to train your model? And was the performance in the paper trained by FP32?

All the models were trained by FP32

[zgchen33]

Thank you for your response. By the way, I don't see any checkpoint you released. Do you plan to release the checkpoints?