search

danbraunai / simple_stories_train

Trains small LMs. Designed for training on SimpleStories
3 stars 1 forks source link

Make it easy to port model to transformerlens #5

Open danbraunai opened 2 months ago

danbraunai commented 2 months ago

It would be easy to port to transformerlens if all parameter names were the same as the default ones in huggingface.

ryanhoangt commented 1 week ago

HI @danbraunai, can you give some more details on this issue (or some example PRs to look at if having any)? Maybe I can look into and give it a try.