Clean up README and exported functions - Githubissues

marcom / Llama.jl

Julia interface to llama.cpp, a C/C++ library for running language models

MIT License

23 stars 2 forks source link

Clean up README and exported functions #10

Closed svilupp closed 8 months ago

svilupp commented 8 months ago

Clean up code

Unexports the low-level API (commented out for reference)
Disable automatic REPL mode init (it doesn't work anyway)
Add a warning if someone initiates the REPL mode directly

Clean up README

Shuffle around the section
Remove broken functionality
Add more up-to-date model recommendation (I went for Dolphin; While in spirit OpenChat would have been better, its performance without their custom prompt template is bad. Doplhin seems to perform much better out of the box on a range of tasks).

Side-note: in repl.init my auto-formatter kicked in. I'll leave as is, as it will be resolved by the formatted PR anyway.

svilupp commented 8 months ago

Rebased. Should be ready for review.

Once this is merged, we should probably tag.