search

jzhang38 / TinyLlama

The TinyLlama project is an open endeavor to pretrain a 1.1B Llama model on 3 trillion tokens.
Apache License 2.0
7.7k stars 453 forks source link

Should this line use args.seed instead of seed=42? #169

Open brynhayder opened 6 months ago

brynhayder commented 6 months ago

https://github.com/jzhang38/TinyLlama/blob/bf122247c486b6b897050e98cbb7bedae8eeba73/sft/finetune.py#L450