search

alibaba / FederatedScope

An easy-to-use federated learning platform
https://www.federatedscope.io
Apache License 2.0
1.26k stars 206 forks source link

WARNING: Skip the batch due to the loss is NaN, it may be caused by exceeding the precision or invalid labels #777

Open Pengxin-Guo opened 1 month ago

Pengxin-Guo commented 1 month ago

When I run "python federatedscope/main.py --cfg federatedscope/llm/baseline/exp_yaml/dolly_lda/dolly_federate.yaml"

why there usually exists "WARNING: Skip the batch due to the loss is NaN, it may be caused by exceeding the precision or invalid labels"?