search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.97k stars 349 forks source link

[Feature Request] Japanese Support #733

Closed AsuraAce closed 6 months ago

AsuraAce commented 6 months ago

not sure whether this is Kobald or model related but i'm having trouble getting japanese characters to work. they only manage to respond in hiragana but won't use kanji.

LostRuins commented 6 months ago

What model are you using? Maybe try a different model?

AsuraAce commented 6 months ago

tried Echidna 13b. it works in chat mode but i have a hard time getting it to work in adventure mode with a companion. the only thing that works sometimes, is a Japanese response in Hiragana instead of Kanji.

LostRuins commented 6 months ago

You'd want to look for more multilingual models.

How about https://huggingface.co/Elizezen/Hameln-japanese-mistral-7B-GGUF

LostRuins commented 6 months ago

It's worth noting that models tend to follow the style and format of your own prompt. So try speaking in Japanese as well.

I just tried my normal Mistral Airoboros model, no issues.

image

AsuraAce commented 6 months ago

@LostRuins as i mentioned earlier, i'm talking about Adventure mode. i would like to have a companion while playing adventure mode, that speaks a different language and this doesn't seem to work.

chat and instruct mode work however, just not what i'm looking for.

It seems other ppl have tried as well and this is just something that doesn't work well. will close this, feel free to reopen if you think there is something that can be done about it.