search

pytorch-labs / gpt-fast

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.
BSD 3-Clause "New" or "Revised" License
5.34k stars 484 forks source link

Add support for TinyLLAMAs #138

Closed malfet closed 3 months ago

malfet commented 3 months ago

By just defining a configs and using model weights storied in model

Should enable TinyStories LLMS posted in https://huggingface.co/karpathy/tinyllamas