Add the flops profiler which measures the time, number of estimated flops and parameters of each module in a model#544

cli99 wants to merge 42 commits into

deepspeedai:masterdeepspeedai/DeepSpeed:masterfrom

cli99:cheng/flops_profilercli99/DeepSpeed:cheng/flops_profilerCopy head branch name to clipboard