search

allenai / recoma

Reasoning by Communicating with Agents
Apache License 2.0
21 stars 3 forks source link

Update litellm version to support OpenAI o1 models #1

Closed shatu closed 1 month ago

shatu commented 1 month ago

LiteLLM started supporting OpenAI o1 models from version 1.44.276 onwards: https://github.com/BerriAI/litellm/releases/tag/v1.44.27

tusharkhot commented 1 month ago

There are many new parameters needed for o1. One option would be for downstream libraries to write a new generator class (e.g. similar to https://github.com/allenai/recoma/blob/main/recoma/models/impl/openai_generators.py) and register it. Happy to also accept PRs to this library for something like an OpenAIO1Generator.

tusharkhot commented 1 month ago

For now, I have added special code in the openai_chat model to change parameters when it sees an o1 model. https://github.com/allenai/recoma/commit/51ac88ed55d846641a5c789f70e422609e661814