Clean up README and exported functions - Githubissues

marcom / Llama.jl

Julia interface to llama.cpp, a C/C++ library for running language models

MIT License

26 stars 2 forks source link

Clean up README and exported functions #10

Closed svilupp closed 10 months ago

svilupp commented 10 months ago

Clean up code

Unexports the low-level API (commented out for reference)
Disable automatic REPL mode init (it doesn't work anyway)
Add a warning if someone initiates the REPL mode directly

Clean up README

Shuffle around the section
Remove broken functionality
Add more up-to-date model recommendation (I went for Dolphin; While in spirit OpenChat would have been better, its performance without their custom prompt template is bad. Doplhin seems to perform much better out of the box on a range of tasks).

Side-note: in repl.init my auto-formatter kicked in. I'll leave as is, as it will be resolved by the formatted PR anyway.

svilupp commented 10 months ago

Rebased. Should be ready for review.

Once this is merged, we should probably tag.