add notice regarding AIO

[marcelklehr]

Does localAI actually have LLMs that are multilingual?

[szaimen]

Does localAI actually have LLMs that are multilingual?

I guess so see https://github.com/go-skynet/model-gallery/blob/main/index.yaml

[marcelklehr]

i heavily doubt it. To my knowledge there are no multilingual open source llms out there atm. integration_openai will simply query the llm to simulate machine translation, so this will fail with localAI, afaict

[szaimen]

I see. However the models of the translate app could potentially be used via local AI, right?

[marcelklehr]

However the models of the translate app could potentially be used via local AI, right?

I doubt it. How do you come to that conclusion?

[szaimen]

How do you come to that conclusion?

Because local AI uses debian as base. So why should it not be possible?

[marcelklehr]

Well, sure it can be implemented, but localAI only implements a subset of the models available on huggingface, AFAIK. See https://localai.io/model-compatibility/ - The Opus models by University Helsinki are using a Marian-NMT architecture which is not in that list.

[szaimen]

Well, sure it can be implemented, but localAI only implements a subset of the models available on huggingface, AFAIK. See localai.io/model-compatibility - The Opus models by University Helsinki are using a Marian-NMT architecture which is not in that list.

all right

[marcelklehr]

You could add the libretranslate container and integration to AIO, though.

[szaimen]

You could add the libretranslate container and integration to AIO, though.

ah you mean as community container? Good idea!