nomic-ai / gpt4all

GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
https://nomic.ai/gpt4all
MIT License
70.42k stars 7.69k forks source link

How to start chat support other languages ? #326

Closed SergeyStratus closed 1 year ago

SergeyStratus commented 1 year ago

I managed to set up and install on my PC, but it does not support my native language, so that it would be convenient to use it. Although he answered twice in my language, and then said that he did not know my language but only English, French. so I have a question how to teach him my language?

SergeyStratus commented 1 year ago

photo1 Sometimes he even answers in Korean and in the language that I need

Niehaus commented 1 year ago

I would like to know how to do it for Brazilian Portuguese as well

SergeyStratus commented 1 year ago

I would like to know how to do it for Brazilian Portuguese as well

Let's hope someone can help us )

Artenes commented 1 year ago

According to this issue and this other one this is not something predictable or even possible to do sometimes.

"ChatGPT isn't actually aware of what language you're using. You used a set of words in language X, so it spits out words related to your input, which happens to often form an answer since it's really good at prediction. What character set you're using it doesn't even know, it's not represented in it's token system."

(From one of the issues above).

After some playing around it can sometimes provide some words in my native language (pt-BR), but in average it can only answer in english since most of the data used for its training was in english. I think the only solution for this would to completely retrain the model using other languages for more predictable results.

iOSDevSK commented 1 year ago

Any idea how to retrain the model for specific language using google collab?

SergeyStratus commented 1 year ago

Любая идея, как переобучить модель для определенного языка с помощью Google Collab?

If I knew, and the idea is good, in general, I think that you need to somehow embed the translator in the gpt chat and most likely he will understand what you are saying to him, since the translator will have to work in two directions and respond already through processing to the translators , but the question is how then gptchat works open AI and understands almost any language

riccardogobbo17 commented 1 year ago

fine tuning instead of retraining from scratch with a dataset in the desired language could be an option?

JohnClaw commented 1 year ago

Does anywhere exist a downloadable model that supports chatting in Albanian (or Hungarian, Estonian, Latvian, Lithuanian etc)?

niansa commented 1 year ago

Duplicate of #288