[Dev] restore DSv4 tflops calc in training and fix the packed seq case - #5358

[Dev] restore DSv4 tflops calc in training and fix the packed seq case#5358

hxbai merged 3 commits into

NVIDIA:devNVIDIA/Megatron-LM:devfrom

hxbai:dsv4_tflopshxbai/Megatron-LM:dsv4_tflopsCopy head branch name to clipboard