search

InternLM / InternEvo

InternEvo is an open-sourced lightweight training framework aims to support model pre-training without the need for extensive dependencies.
https://internevo.readthedocs.io/zh-cn/latest/?badge=latest
Apache License 2.0
310 stars 52 forks source link

[Feature] 优化ce_loss计算 #306

Closed zigzagcai closed 2 months ago

zigzagcai commented 2 months ago

Describe the feature

优化ce_loss计算，优化loss计算逻辑并且保证xentropy计算正确

Will you implement it?