Add optional api_url configuration for llama.cpp adapter

thmsmlr / instructor_ex

Structured outputs for LLMs in Elixir

https://hexdocs.pm/instructor

432 stars 49 forks source link

Add optional api_url configuration for llama.cpp adapter #8

Closed heimann closed 4 months ago

heimann commented 5 months ago

Adds an optional api_url configuration parameter to the llama.cpp adapter. I also added a blurb in the README about how to (optionally) configure the llama.cpp params.

thmsmlr commented 4 months ago

Perfect, totally missed that. Thanks!