search

huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
https://huggingface.co/transformers
Apache License 2.0
132.47k stars 26.39k forks source link

The examples in the examples directory are mostly for fine-tuning pre-trained models？how to trian from scratch #33416

Open zc-Chao opened 1 week ago

zc-Chao commented 1 week ago

Model description

no

Open source status

Provide useful links for the implementation

No response

LysandreJik commented 1 week ago

The examples for causal LM and masked LM can also be used for training from scratch!