carlrobertoh / llm-client

User-friendly Java HTTP client that provides access to large language model APIs and services
https://central.sonatype.com/artifact/ee.carlrobert/llm-client
MIT License
17 stars 27 forks source link

Add support for some extended parameters of llama.cpp(top_k, top_p, min_p, and repeat_penalty) #7

Closed plinkr closed 8 months ago

plinkr commented 9 months ago

In these URL there is information about those values: https://www.reddit.com/r/LocalLLaMA/comments/17vonjo/your_settings_are_probably_hurting_your_model_why/ https://github.com/huggingface/transformers/issues/27670