Useful scripts - Githubissues

huggingface / nanotron

Minimalistic large language model 3D-parallelism training

Apache License 2.0

1.14k stars 107 forks source link

Closed NouamaneTazi closed 9 months ago

NouamaneTazi commented 1 year ago

[x] add train script
[x] add generate script
[x] add test_training.py to check correctness (by finetuning a llama 7b for 100 iterations) (python tests/trest_training.py)

NouamaneTazi commented 9 months ago

yes added a todo!