giladgd
commented
1 month ago You can inspect the types of options for every object and function you create to control all the settings. Each option has a detailed documentation explaining what it does and how to use it. You can see those types both in TypeScript types of function usages in your project, and on the documentation website.
For example, you can see the options for these on the documentation website:
getLlama(...)(options)- Llama:
.loadModel(...)(options) - LlamaModel:
.createContext(...)(options) - LlamaChatSession: constructor (options),
.prompt()(options)
tigert2173
Feature Description
I'm finding it very difficult to figure out the settings I can and cannot modify, I know I can do temperature but I am also aware of the many others but do not know how they are called for this. If we had a list of these it would help so we don't have to test over and over to see if it's making any difference or if we even got the right name for the setting
The Solution
Documentation on the possible settings we can change with an json api request and the best ways to do so.
Considered Alternatives
Not that I know of.
Additional Context
No response
Related Features to This Feature Request
Are you willing to resolve this issue by submitting a Pull Request?
No, I don’t have the time and I’m okay to wait for the community / maintainers to resolve this issue.