ltoniazzi / reduce-llms-for-testing

Reduce LLMs size for testing
0 stars 0 forks source link

Reduce LLMs size for testing

Take an LLM, reduce the hidden_size for its matrices, and then overfit it to some text. This is done to get a lightweight version of the same architecture, for testing.




HuggingFace access

Via a user write access token to be set as the environment variable HF_TOKEN.


Development