Add ability to configure runtime and model hyperparameters

alexrozanski / LlamaChat

Chat with your favourite LLaMA models in a native macOS app

https://llamachat.app

MIT License

1.45k stars 56 forks source link

Closed zakkor closed 1 year ago

zakkor commented 1 year ago

Some essential ones that come to mind:

-t {n} to specify number of threads. From what I can tell, LlamaChat uses 3 threads by default, but on my machine 8 threads gets the best performance.
--temp and the rest of the useful params

alexrozanski commented 1 year ago

@zakkor Yep this is definitely coming ☺️

alexrozanski commented 1 year ago

Added in v1.2.0