search

ItsPi3141 / alpaca-electron

The simplest way to run Alpaca (and other LLaMA-based local LLMs) on your own computer
MIT License
1.29k stars 144 forks source link

Control over result with params. [not a issue 🐕‍🦺] #35

Open DogVanDog opened 1 year ago

DogVanDog commented 1 year ago

1.Will be possible to add control over parameters like "temp" and "top_p" (with sliders) in separated menu? As example if you tweak "temp" in other text generation tools (from 0 to 1) - this will change answers that AI provide. Closer to 0 AI will try to answer as much closer to your request as possible, but when you tweak temp to 1 Ai will become more free to answer in more creative way. "top_p" is affecting answers too, but i'm not sure what this affect (some people prefer to keep top_p closer to 0.85 and control randomness of AI by temp). If you afraid of overcomplication your application - you can do small button in the corner that will change mode from simple to advanced (or open menu to tweak parameters).

  1. Sometimes pretty cool to have ability to rewrite answers of AI during generating (stop and rewriting before continue). As example - if you writing a novel you can write something like "Hero looked at sword, it was " AI imagining something about sword. Then you stop AI again and writing "But hero decided longbow because it was " and AI again trying to imagine something.

Anyway atm your application looks cool and clean as it's. Have a good day 🐕‍🦺 label:enhancement

ItsPi3141 commented 1 year ago

Yes I'll add a settings page for that soon.