jiahe7ay / MINI_LLM

This is a repository used by individuals to experiment and reproduce the pre-training process of LLM.
348 stars 53 forks source link

遇到NaN or Inf found in input tensor.错误 #8

Open andyweiqiu opened 7 months ago

andyweiqiu commented 7 months ago

请问作者在搭建这个pipeline的过程中有没有遇到过这个问题,或者有解决这个问题的经验吗?谢谢

jiahe7ay commented 7 months ago

没有呀 你能发一下报错吗

andyweiqiu commented 7 months ago

没有呀 你能发一下报错吗

image