search

LostRuins / lite.koboldai.net

A zero dependency web UI for KoboldAI Horde
GNU Affero General Public License v3.0
69 stars 34 forks source link

OpenRouter Throwing an error with Some models: #45

Closed jeffkelly2020 closed 8 months ago

jeffkelly2020 commented 9 months ago

Hello, Over the past couple days, I've been seeing an error when using Lite with Certain models on OpenRouter. In particular, this is happening with alpindale/goliath-120b and xwin-lm-70b, maybe others I haven't found so far. When I try to generate text with either of these models, I see the following: Error occurred during text generation: {"error":{"message":"{\n \"error\": {\n \"message\": \"Bad Arguments. ’logit_bias’ not yet supported.\"\n }\n}\n","code":400}}. Both of these models worked fine as of several days ago, and most other models still seem to be working as of today. Not sure if something changed in Lite or on the OpenRouter side. Does anyone have any idea what's going on?

LostRuins commented 9 months ago

Hi, can you please try again and see if this is resolved? thanks.

jeffkelly2020 commented 9 months ago

Hi,

Still not working, but now it’s a slightly different error. It seems to try for a few seconds longer, and then simply aborts:

Error while submitting prompt: AbortError: The operation was aborted.

From: LostRuins @.> Sent: Wednesday, December 13, 2023 1:31 AM To: LostRuins/lite.koboldai.net @.> Cc: jeffkelly2020 @.>; Author @.> Subject: Re: [LostRuins/lite.koboldai.net] OpenRouter Throwing an error with Some models: (Issue #45)

Hi, can you please try again and see if this is resolved? thanks.

— Reply to this email directly, view it on GitHub https://github.com/LostRuins/lite.koboldai.net/issues/45#issuecomment-1853342181 , or unsubscribe https://github.com/notifications/unsubscribe-auth/BBFC5TAWOHVXSXD7KWNQQ6DYJFDTFAVCNFSM6AAAAABARXQPU2VHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTQNJTGM2DEMJYGE . You are receiving this because you authored the thread. https://github.com/notifications/beacon/BBFC5TFKS4CGJWCIJ6Y2OMLYJFDTFA5CNFSM6AAAAABARXQPU2WGG33NNVSW45C7OR4XAZNMJFZXG5LFINXW23LFNZ2KUY3PNVWWK3TUL5UWJTTOO7A6K.gif Message ID: @. @.> >

LostRuins commented 9 months ago

Then I think it's an OpenRouter issue

jeffkelly2020 commented 9 months ago

It seems to be working now for whatever reason.

Thanks for having a look!

jeffkelly2020 commented 9 months ago

Actually, I believe now the change you made did resolve the issue. I’m still occasionally getting the generic “The operation was aborted” error, but I think that’s simply due to OpenRouter overload. I have not seen the “logit_bias’ not yet supported” error at all today.