search

dibrale / webui_autonomics

Dynamic parameter modulation for oobabooga's text-generation-webui that adjusts generation parameters to better mirror user affect.
GNU General Public License v3.0
34 stars 3 forks source link

Which llamas/mixtril #4

Open Delcos opened 11 months ago

Delcos commented 11 months ago

Did you use llama or llama 2, and base or chat, and are there any plans to tune a preset for any other models now available?

dibrale commented 10 months ago

The original settings were prepared with regular llama in mind, and used successfully with both the foundational model and various finetunes. I've also had good results using them with foundational llama 2.

Formally optimizing model-specific presets is a labor intensive task. I have no plans to do this unless there is considerable demand for it. However, alternative presets would be a welcome contribution to the project!