rai-llc / LanguageModels.jl

Load nanoGPT-style transformers in Julia. Code ported from @karpathy's llama2.c
MIT License
59 stars 2 forks source link

Repackage system prompts #4

Open jiahao opened 1 year ago

jiahao commented 1 year ago

Commit c3a68e73467eec0c8ab94b03b575a6e71dcd5fab implements the system prompts expected by llama2, but this breaks the tests on tinystories, which doesn't expect these prompts. Need to think about how to package this information.