search

cyberchitta / openai_ex

Community maintained Elixir library for OpenAI API
https://hexdocs.pm/openai_ex
Apache License 2.0
132 stars 18 forks source link

Base model completions API #102

Closed kalocide closed 1 month ago

kalocide commented 1 month ago

Describe the feature or improvement you're requesting

README.md states that:

3rd Party LLMs with an OpenAI proxy ... are considered legitimate use cases.

Yet the ability to use the /completions API was removed in 312f502, making the library unusable for base model completions. To me, this seems counterintuitive: many providers (for example, TogetherAI) require the use of /completions for base models. I don't think the library should consider the /completions API deprecated, as it is well within the scope of third-party providers.

Additional context

No response

restlessronin commented 1 month ago

@satin-spirit My apologies. I don't use it myself, and wasn't aware others were still using the API. Feel free to add it back in with a PR, and I will accept it. I can't test it out myself, so it would be great if you could check that it works on the 3rd party servers that you care about.

I think there was also a sample notebook that should be restored.

kalocide commented 1 month ago

No problem. Thank you for the quick reply ^^