Issue 67/enable completion and chat completion for other llms

cyberchitta / openai_ex

Community maintained Elixir library for OpenAI API

https://hexdocs.pm/openai_ex

Apache License 2.0

132 stars 18 forks source link

Issue 67/enable completion and chat completion for other llms #68

Closed restlessronin closed 10 months ago

restlessronin commented 10 months ago

i have parameterized the base url for the api.

without any other changes, this now works for non-streaming completions and chat completions with thellama.cpp-python in server mode.

Madd0g commented 10 months ago

has this been released? I'm getting: function OpenaiEx.with_base_url/2 is undefined or private

restlessronin commented 10 months ago

@Madd0g I was hoping to polish off an issue or two more before publishing it, but it's been a while, so I've gone ahead and published it now. It's v0.5.0.