[Feature Request] Add support for multilingual machine translation LLMs

oobabooga / text-generation-webui

A Gradio web UI for Large Language Models.

GNU Affero General Public License v3.0

40.8k stars 5.33k forks source link

Closed fcolecumberri closed 1 year ago

fcolecumberri commented 1 year ago

Description

Add support for multilingual machine translation LLMs (MMTLLM)

Additional Context

There are some MMTLLMs designed to translate text such as https://huggingface.co/facebook/nllb-200-3.3B and https://huggingface.co/facebook/mbart-large-50-many-to-many-mmt that could get attention from the public if there is a user friendly system to use them (like this) while also help this project to become the Swiss army knife of LLMs that is becoming.

janvarev commented 1 year ago

Hi! You can check my https://github.com/janvarev/multi_translate extension. There are multiple translation engines already. Also it support https://github.com/janvarev/OneRingTranslator - separate local translation server, where plugins with additional translators supported. There is no plugin for FB MMTLLMs, but it can be done.

Imho, it's better to make separate modules to support features, than make it all in one place, that's hard to support.

janvarev commented 1 year ago

UPD: I've added support for NLLB translation in https://github.com/janvarev/OneRingTranslator

github-actions[bot] commented 1 year ago

This issue has been closed due to inactivity for 30 days. If you believe it is still relevant, please leave a comment below.