Closed odashi closed 3 months ago
Add a script calculate_model_stats.py that reads a Megatron-LM checkpoint and calculates some statistics of containing weights:
calculate_model_stats.py
LGTMです.綺麗なコードですね.Usage に書いてある通りに実行してみて,ちゃんと動いたら approve 出します.
Add a script
calculate_model_stats.py
that reads a Megatron-LM checkpoint and calculates some statistics of containing weights: