socketteer / loom

Multiversal tree writing interface for human-AI collaboration
1.02k stars 75 forks source link

3.5 and gpt4 fail #22

Open catbears opened 1 year ago

catbears commented 1 year ago

Thank you for the practical UI, I wonder why there aren't many like this around already (paid and free, local and remote models). Probably we're way ahead of the crowd or something. It's a mystery for me lol

The issue: it seems that I cannot use gpt4 and gpt-3.5 (+turbo) with the standard settings. What works is text-davinci-003. The error I get if I choose gpt4 or 3.5 is the following:

WARNING:root:Failed with exception: Invalid URL (POST /v1/engines/gpt-3.5-turbo/chat/completions), Retrying in 1 seconds...
WARNING:root:Failed with exception: Invalid URL (POST /v1/engines/gpt-3.5-turbo/chat/completions), Retrying in 2 seconds...
WARNING:root:Failed with exception: Invalid URL (POST /v1/engines/gpt-3.5-turbo/chat/completions), Retrying in 4 seconds...
cannot unpack non-iterable NoneType object
ERROR cannot unpack non-iterable NoneType object. Deleting failures

I tried finding the issue in the code, but could not see it (no expert in their API). I you look here: https://platform.openai.com/docs/api-reference/chat/create then it seems that the URL is not the same anymore. They use https://api.openai.com/v1/chat/completions

Thanks for looking into this.

matt-bernstein commented 9 months ago

https://github.com/socketteer/loom/pull/24 fixes this