Open NeonDaniel opened 1 month ago
Currently, STT and TTS plugins are hosted independent of HANA. I think that either:
The latter option does raise questions about hosting multiple plugins in one backend, but does expose a unified endpoint for all hosted services. Deferring to OVOS server packages means it is less clear where different endpoints exist, but does scale more easily where hosting multiple services is desired.
In any case, the MQ integration Klat uses for translations will likely need to be updated or replaced with an HTTP query
Relevant Klat integration changes in LibreTranslate
This also includes an example for how services could be attached to MQ as well as the example inputs from Klat that need to be supported
Currently, STT and TTS plugins are hosted independent of HANA.
Also worth noting that LLMs hosted by Neon are also similar in that they use vLLM and expose their own endpoints.
Objective
Implement a
/translate
backend to replace calls currently made to a custom LibreTranslate container.Initial Implementation Requirements
/translate/simple
endpoint that acceptstext
,input_lang
, andoutput_lang
. Input lang ofNone
should use lang detection.text
may be a single string or a list of strings; return value is a list of strings/translate/detect
endpoint that acceptstext
input and returnslang
andlanguages
values with most likely language and optional a list of (lang, conf) tuples/translate/bulk
endpoint that acceptsinputs
(List[str]),input_lang
(str) andoutput_langs
(List[str]) and returns a dict oflang
to a list of translated stringsOther Considerations