Do not provide format as this breaks chat completions with some models.

jmont-dev / ollama-hpp

Modern, Header-only C++ bindings for the Ollama API.

MIT License

53 stars 7 forks source link

Closed jmont-dev closed 3 months ago

JG-Adams commented 3 months ago

Both llama3 and llama3.1 actually appeared to have worked after commenting out the format! I'll let you know if it stopped working.