This is a project that unifies the management of LLM APIs. It can call multiple backend services through a unified API interface, convert them to the OpenAI format uniformly, and support load balancing. Currently supported backend services include: OpenAI, Anthropic, DeepBricks, OpenRouter, Gemini, Vertex, etc.
323
stars
40
forks
source link
feat: add TextToSpeechRequest model and implement audio speech endpoi… #14
佬友好
我自己加了tts-1等接口的支持,目前卡在从外部api返回语音数据后,这些数据在
wrapped_generator, first_response_time = await error_handling_wrapper(generator)
处理出错,应该是byte数据不能用unicode解码,这里该怎么处理我就不知道了