A user-friendly interactive command-line interface, similar to ollama
Use cobra or charm.sh
Flags:
To start with it would only need a --prompt flag, then interactive chat style would be a further goal
After the simple --prompt flag, it would be nice to be able to extract information like token loss, perplexity, and any other information that can be extracted
--temperature
--batch-size controls size of batch size, larger would lead to quicker passes
--training-data would specify training data to open
Flags: To start with it would only need a
--promptflag, then interactive chat style would be a further goalAfter the simple
--promptflag, it would be nice to be able to extract information like token loss, perplexity, and any other information that can be extracted--temperature--batch-sizecontrols size of batch size, larger would lead to quicker passes--training-datawould specify training data to open--eval-datawould specify data to eval againstSee https://github.com/joshcarp/grpctl for reference