huggingface / autotrain-advanced

🤗 AutoTrain Advanced
https://huggingface.co/autotrain
Apache License 2.0
4.04k stars 494 forks source link

[BUG] Any updates to errors due to Gradient Accumulation? #795

Open jackswl opened 1 month ago

jackswl commented 1 month ago

Prerequisites

Backend

Local

Interface Used

CLI

CLI Command

-

UI Screenshots & Parameters

-

Error Logs

With the recent bug fix by Unsloth, wondering if AutoTrain will be updated for this? Thanks https://www.reddit.com/r/LocalLLaMA/comments/1g4ego7/llm_training_bug_fixes_gradient_accumulation_was/

Additional Information

No response

github-actions[bot] commented 6 days ago

This issue is stale because it has been open for 30 days with no activity.