socketteer / loom

Multiversal tree writing interface for human-AI collaboration
1.02k stars 75 forks source link

Update openai api #24

Open matt-bernstein opened 9 months ago

matt-bernstein commented 9 months ago

Sharing some local changes I made to continue using loom with openai models now that the chat completions endpoint does not support logprobs [1]. Hardcodes using a non-chat model (davinci) if needed and updates the API syntax to the latest version of the openai client library.

Is anyone else still using openai models for loom? I notice there's a feature branch (metaprocesses) with new code using openai.

[1] https://community.openai.com/t/logprobs-are-missing-from-the-chat-endpoints/289514