ianarawjo / ChainForge

An open-source visual programming environment for battle-testing prompts to LLMs.
https://chainforge.ai/docs
MIT License
2.38k stars 181 forks source link

Request: in the settings for Ollama can be inserted num_ctx parameter? #306

Open avvocati-e-mac opened 1 week ago

avvocati-e-mac commented 1 week ago

Ollama, by default use 2048 context windows. For long prompt it will be useful change che windows (if you have the ram).

here the parameter reference (num_ctx). here an example of api call with che parameter (num_ctx).

P.S. Love your project, very useful work!