nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://nomic.ai/gpt4all
MIT License
70.2k stars 7.67k forks source link

Custom stop sequences in settings #3061

Open manyoso opened 2 weeks ago

manyoso commented 2 weeks ago

Related things to fix:

ThiloteE commented 2 weeks ago

refs https://github.com/huggingface/transformers/pull/28932 refs https://github.com/ggerganov/llama.cpp/issues/5040

I cannot seem to find the issue/pr that talks about multiple eos in llama.cpp.

manyoso commented 2 weeks ago

Duplicate of https://github.com/nomic-ai/gpt4all/issues/2439