Support multiple languages for input messages

mattermost / mattermost-plugin-ai

Mattermost Copilot plugin supporting multiple LLMs

https://mattermost.com/copilot

Apache License 2.0

122 stars 23 forks source link

Support multiple languages for input messages #34

Open crspeller opened 1 year ago

crspeller commented 1 year ago

Not sure exactly what is required here. Do we just need to modify our prompts asking it to answer in a specific language? Or maybe we need to localize the prompts themselves?

it33 commented 11 months ago

I think it just works, I asked a question in Japanese and it came back straight forward.

it33 commented 11 months ago

Or maybe it works for the GPT-4 model we're using and we might need a label or some metadata surfaced, or an error message for what's not supported.

Or maybe models that don't support the language seem like they'll figure out how to say that in future...

muratbayan commented 11 months ago

The model we're using definitely works in French, Turkish and Greek fwiw

kaakaa commented 11 months ago

I tried to use ai-plugin with gpt-3.5-turbo, and it works fine in Japanese. Mattermost AI Pluginを試してみた - Zenn

But when generating a thread summary for a thread written in Japanese, the summary was written in English. Rewriting built-in prompts in Japanese allow me to get a summary in Japanese.

I also tried the LocalAI/GPT4ALL-J environment as well as OpenOps default, but it did not work well (left side in the bellow image). I think this is because the LocalAI/GPT4ALL-J does not handle stream response of multi-byte character correctly.

crspeller commented 11 months ago

There are defiantly some cases where it works. I think the cases where it doesn't are where we write the prompt for the user. It's going to end up in the prompt language (English) rather than the user's selected language. This might be as simple as adding a "Please respond in LANGUAGE" to the standard personality prompt.

MrCyjaneK commented 11 months ago

@crspeller it could even add the LANGUAGE depending on the actual user language that one may have set in the settings.

azigler commented 6 months ago

Hey, Mattermost AI community! :wave:

We're looking for help on this one. :eyes: In this issue, we want to support multiple languages for input messages. :globe_with_meridians: :page_with_curl:

To visualize, imagine a user from France :fr: wanting to use commands in French. The plugin should understand and respond in different languages (like French) based upon the user's settings, thus enhancing the Mattermost experience for all languages!

For those interested in tackling this, here are some starting points:

Familiarize yourself with our current implementation of language support in the AI plugin and understand its workings.
Determine the ideal user experience (UX) for which language the LLM chooses to responds with, whether that's to use the language used in the prompt or the language in their user settings.
Experiment with altering the prompt that gets sent to the LLM.

Dive in and let us know if you need any guidance along the way. :thumbsup:

Happy contributing! :sparkles: