Vali-98 / ChatterUI

Simple frontend for LLMs built in react-native.
GNU Affero General Public License v3.0
529 stars 28 forks source link

OpenRouter problems: No reply at all or after a few minutes #105

Open CyborgArmy83 opened 4 days ago

CyborgArmy83 commented 4 days ago

l0g I recently re-downloaded the app and tried it out on my Android phone. It seems like OpenRouter has some problems.

I selected my default model (hermes-405:free) and API key but it is not streaming a response. I have plenty of credits and it's working on other apps. Most often I get an empty screen as output or it will output something small after 70-90 seconds. Not sure if it related to a (broken?) model selection. Can you also add a model in the top of the list called "user default" to choose whatever you made standard in the OpenRouter settings? I'm looking forward to hear if others are facing similar issues and what can be done about it. I am using A15 and the latest app release (0.8.1)

Update 1: Okay, after more testing it seems that there are quite a few models in the list that do not work in the way I would figure, such as the 405 hermes one. If I select Sonnet 3.5 it works most of the time. Not sure if the list is hardcoded and might contain some errors either in the naming or calling the models.

Update 2: It could also be an API / server problem on their side. Not pointing fingers, just trying to figure it out!

May I also suggest a model search / type field in the openrouter API settings? This would be 1000% appreciated :)

Vali-98 commented 4 days ago

Hey there, thanks for the feedback!

Not sure if the list is hardcoded and might contain some errors either in the naming or calling the models.

Its obtained directly from OpenRouter, so it should be 100% accurate, unless OpenRouter themselves are screwing up something.

May I also suggest a model search / type field in the openrouter API settings? This would be 1000% appreciated :)

This is one of the additions planned for an upcoming API-rework.