search

lmg-anon / mikupad

LLM Frontend in a single html file
https://lmg-anon.github.io/mikupad/mikupad.html
Creative Commons Zero v1.0 Universal
175 stars 24 forks source link

Fix a couple of things that break when using Together AI #54

Closed tjohnman closed 2 months ago

tjohnman commented 2 months ago

Fixes #55. When I tried to use mikupad with Together, inference failed because the API won't accept more than 1 n_probs in the request. Moreover, fetching the model list also failed. These two commits fix these problems.

lmg-anon commented 2 months ago

Sorry, I guess I broke the previous fix for the logprobs issue when I rearranged the code. But thank you for the new fix!