Open avvocati-e-mac opened 1 week ago
Ollama, by default use 2048 context windows. For long prompt it will be useful change che windows (if you have the ram).
here the parameter reference (num_ctx). here an example of api call with che parameter (num_ctx).
P.S. Love your project, very useful work!
Ollama, by default use 2048 context windows. For long prompt it will be useful change che windows (if you have the ram).
here the parameter reference (num_ctx). here an example of api call with che parameter (num_ctx).
P.S. Love your project, very useful work!