search

mozilla / firefox-translations-training

Training pipelines for Firefox Translations neural machine translation models
https://mozilla.github.io/firefox-translations-training/
Mozilla Public License 2.0
135 stars 28 forks source link

"No space left on device" on score step #666

Closed eu9ene closed 2 weeks ago

eu9ene commented 2 weeks ago

https://firefox-ci-tc.services.mozilla.com/tasks/U18cLu6uQxKJ4oBkeiJbrQ/runs/0/logs/public/logs/live.log

[task 2024-06-09T22:04:00.269Z] etches/corpus.en.zst : 9064 MB...     
[task 2024-06-09T22:04:00.437Z] etches/corpus.en.zst : 9069 MB...     
[task 2024-06-09T22:04:00.605Z] etches/corpus.en.zst : 9075 MB...     
[task 2024-06-09T22:04:00.781Z] etches/corpus.en.zst : 9080 MB...     
[task 2024-06-09T22:04:00.957Z] etches/corpus.en.zst : 9085 MB...     
[task 2024-06-09T22:04:04.016Z] etches/corpus.en.zst : 9091 MB...     zstd: error 93 : Write error : cannot write decoded block : No space left on device 
[fetches 2024-06-09T22:04:04.017Z] removing /home/ubuntu/tasks/task_171796902426066/fetches
[fetches 2024-06-09T22:04:18.072Z] finished
[taskcluster 2024-06-09T22:04:18.082Z]    Exit Code: 93
[taskcluster 2024-06-09T22:04:18.082Z]    User Time: 4m19.662196s
[taskcluster 2024-06-09T22:04:18.082Z]  Kernel Time: 2m16.75928s
[taskcluster 2024-06-09T22:04:18.082Z]    Wall Time: 26m46.328022547s
[taskcluster 2024-06-09T22:04:18.082Z]       Result: FAILED
[taskcluster 2024-06-09T22:04:18.082Z] === Task Finished ===
[taskcluster 2024-06-09T22:04:18.082Z] Task Duration: 26m46.32963764s
eu9ene commented 2 weeks ago

Also https://firefox-ci-tc.services.mozilla.com/tasks/Ds9EpdPwRDqkW7kXC6zV8g