su77ungr / CASALIOY

♾️ toolkit for air-gapped LLMs on consumer-grade hardware
Apache License 2.0
230 stars 31 forks source link

Define the Answer Language #96

Open neeewwww opened 1 year ago

neeewwww commented 1 year ago

Issue you'd like to raise.

I'm utilizing a Portuguese PDF file and presenting questions in Portuguese. However, there are instances when the answer is accurate but in English. Is there a means to specify the answer language when using the default models?

Suggestion:

No response

hippalectryon-0 commented 1 year ago

Have you tried modifying your question to request explicitely an answer in Portuguese ? If that doesn't work, what about modifying the default prompt, e.g. translating it in portuguese ?

GiancarloJSantos commented 1 year ago

Issue you'd like to raise.

I'm utilizing a Portuguese PDF file and presenting questions in Portuguese. However, there are instances when the answer is accurate but in English. Is there a means to specify the answer language when using the default models?

Suggestion:

No response

What model are you using, @neeewwww ?

neeewwww commented 1 year ago

The default one, also tried using: sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 and sentence-transformers/distiluse-base-multilingual-cased-v2. And using: eachadea/ggml-vicuna-7b-1.1/ggml-vic7b-q5_1.bin

The answer in english happens every now and then.

On Fri, May 19, 2023 at 11:58 AM Giancarlo Santos @.***> wrote:

Issue you'd like to raise.

I'm utilizing a Portuguese PDF file and presenting questions in Portuguese. However, there are instances when the answer is accurate but in English. Is there a means to specify the answer language when using the default models? Suggestion:

No response

What model are you using, @neeewwww https://github.com/neeewwww ?

— Reply to this email directly, view it on GitHub https://github.com/su77ungr/CASALIOY/issues/96#issuecomment-1554717636, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEZ6BAJOIN5OBH4OKWUOLJ3XG6DB5ANCNFSM6AAAAAAYGYRJQ4 . You are receiving this because you were mentioned.Message ID: @.***>

--

Thiago Hagui dos Santos Móvel/Mobile: +55-11-9-7519-7652