search

mistralai / mistral-inference

Official inference library for Mistral models
https://mistral.ai/
Apache License 2.0
9.49k stars 835 forks source link

model is giving answer in russian #66

Open Sanchit-404 opened 10 months ago

Sanchit-404 commented 10 months ago

I coded an automatic pipeline to pass questions to the model. But the model is giving answers in russian. I tried manualprompting, the answer is still in russian. Screenshot 2023-11-05 161453 Is there some paramter i need to change to get the answer in english.

xjohnxjohn commented 10 months ago

me too!

Sanchit-404 commented 10 months ago

It gives english answers on some questions but russain for others. Is it some encoding mistake?

skbaur commented 9 months ago

Not sure if this has been discussed elsewhere, but I keep getting 100% russian answers (maybe from russian wikipedia) when I prompt only with an eos token. Could this be some issue with the training data?

Example output:

'</s> В Амурской области.\n\n## География\n\nРасположен в 10 км к юго-западу от районного центра.\n\n## История\n\nОснован в 1909 году. В 1926 году в посёлке имелось 10 хозяйств и проживало 49 человек (24 мужчины и 25 женщин). В национальном составе населения того периода пре'

CrackerHax commented 7 months ago

Same