Create flags for model settings

neokd / NeoGPT

Chat effortlessly, execute commands, and interpret code with Llama3, Phi3, and more - your local AI assistant. Enjoy seamless interaction while ensuring ultimate privacy

https://neogpt.dev

MIT License

68 stars 60 forks source link

Create flags for model settings #155

Closed neokd closed 5 months ago

neokd commented 5 months ago

Usage: python main.py [options]

Options: --temperature
--max-tokens
--context-windows

Add descriptions for flags as needed

Example: python main.py --temperature 1.2 --max-tokens 512 --context-windows 256

Note:

The temperature influences the randomness of generated text.
Adjust max tokens to control response length.
Context windows determine the number of tokens considered for context.

yashasvini121 commented 5 months ago

Hey @neokd, Can you please assign me this under JWOC'24?

neokd commented 5 months ago

@yashasvini121 any updates? Did you add the parameters.

yashasvini121 commented 5 months ago

@neokd, I am currently working on it, will update you by tomorrow.

ayushmorbar commented 5 months ago

I have solved this issue as part of JWoC, since there was no activity.