Open iboB opened 3 months ago
Intentionally skipped while implementing #3
This is done by setting llama_context_params::n_seq_max to a value greater than one.
llama_context_params::n_seq_max
Additionally we should devise a good way to expose this from both the module API and the SDK API.
Intentionally skipped while implementing #3
This is done by setting
llama_context_params::n_seq_maxto a value greater than one.Additionally we should devise a good way to expose this from both the module API and the SDK API.