nextcloud / integration_openai

OpenAI integration in Nextcloud
GNU Affero General Public License v3.0
48 stars 9 forks source link

Can't get assistant to work with openai "Assistant error" #94

Open jon-bit opened 3 weeks ago

jon-bit commented 3 weeks ago

Which version of integration_openai are you using?

2.0.0

Which version of Nextcloud are you using?

28.0.4.1

Which browser are you using? In case you are using the phone App, specify the Android or iOS version and device please.

Brave

Describe the Bug

When I have the asstent to get requests from open ai I get:

"Text generation error: Failed to run or schedule a task"

on most things (but not all). When I to STT I get

"Failed to schedule transcription:

failure
500
Internal Server Error"

and if I use the quick app in next cloud instead of the builtin tools in files I get

Assistant error

Expected Behavior

it does Textgen or STT

To Reproduce

install openai integration app and set to the API to anything (blank, "https://api.openai.com", "https://api.openai.com/v1/" is what I tried) and try any AI things. It won't work(at least for me).

jon-bit commented 3 weeks ago

I got image to text working (by setting the URL to "https://api.openai.com/") but when I do STT The error log says this OCA\\Assistant\\Controller\\SpeechToTextApiController::transcribeAudio(): Argument #1 ($appId) must be of type string, null given, called in /var/www/html/lib/private/AppFramework/Http/Dispatcher.php on line 230","Code":0,"Trace":[{"file":"/var/www/html/lib/private/AppFramework/Http/Dispatcher.php in the message

manatwork81 commented 1 week ago

I have the same Problem NC29.

In Log: TypeError OCA\OpenAi\Service\OpenAiAPIService::getExtraParams(): Return value must be of type ?array, int returned LanguageModel call using provider OpenAI failed

nc29

No Idea what the second Line mean? empty i got an error.

Any Idea?

julien-nc commented 1 week ago

@manatwork81 06f695b0978418cf759d32b3f8ab3093c023f0be should fix this. It will be included in the next integration_openai release. For now you can set an empty object as extra params: {}. It will work.

@jon-bit It's not clear what happens to you. It is most likely a bug in the assistant because integration_openai is not involved when scheduling a job but when the job runs. I'll have a look.

julien-nc commented 1 week ago

@jon-bit Found and fixed the issue. Fix is included in v1.0.9 which is out now. Could you confirm submitting an audio transcription task with the picker works now?

julien-nc commented 1 week ago

@manatwork81 integration_openai v2.0.1 is out. Invalid values for extra llm params are now correctly handled.