search

jackschedel / KoalaClient

The best LLM API Playground Interface (for me)
https://client.koaladev.io/
Creative Commons Zero v1.0 Universal
26 stars 8 forks source link

claude + gpt4turbo #90

Closed jackschedel closed 7 months ago

ghost commented 7 months ago

Yeah, sorry for not making a PR, and about claude 2 and instant - it'll only work with a compatible reverse proxy, e.g. https://gitgud.io/khanon/oai-reverse-proxy that can translate OpenAI API calls for Claude endpoints (you still need Claude API from either Anthropic or Amazon Bedrock - the latter is much easier to get access to)

I'm not sure if SSE parsing is 100% correct but it works for reverse proxies and stuff where SSE stream has comments sent while the original didn't.

ghost commented 7 months ago

Oops @jackschedel the last commit was purely for my own use, it's something that can be used to bypass some safety OAI checks, you can revert that last commit if you want :)

jackschedel commented 7 months ago

@Yardanico for some reason the previous build checks failed, even when manually rerunning then. I'll keep the random uuids; might as well.