Response is empty

[aunwesha]

Hello,

Thanks for the wonderful initiative to bring LLMs to the Java ecosystem!

I am running on Windows 10. The maven compilation is fine. But when I run the program I am getting an empty response:

[INFO] --- exec:3.1.0:java (default-cli) @ gpt4all-java-bindings-sample ---
[com.hexadevlabs.gpt4allsample.Main.main()] INFO com.hexadevlabs.gpt4all.LLModel - Java bindings for gpt4all version: 2.4.11
gptj_model_load: loading model from 'C:\Users\dutta\Documents\GPT4AllModels\ggml-gpt4all-j-v1.3-groovy.bin' - please wait ...
gptj_model_load: n_vocab = 50400
gptj_model_load: n_ctx   = 2048
gptj_model_load: n_embd  = 4096
gptj_model_load: n_head  = 16
gptj_model_load: n_layer = 28
gptj_model_load: n_rot   = 64
gptj_model_load: f16     = 2
gptj_model_load: ggml ctx size = 5401.45 MB
gptj_model_load: kv self size  =  896.00 MB
gptj_model_load: ................................... done
gptj_model_load: model size =  3609.38 MB / num tensors = 285
You are a helpful assistant
### Instruction:
The prompt below is a question to answer, a task to complete, or a conversation to respond to; decide which and write an appropriate response.
### Prompt:
Add 2+2
### Response:
C:\Users\dutta\Downloads\GPT4ALLjava\gpt4all-java-bindings-sample-main>

[felix-zaslavskiy]

Hi thanks for your report. I happen to have an old PC and still running Windows 10 and AVX-only machine. The JVM does crash it is in the call to backend. I do recommend trying to run this on Windows 11 and it for sure works there. There was mention of a Windows issue with AVX-only version of gpt4all which I think you are probably on as well. If you patient maybe after I make new version of binding it may fix this.

[aunwesha]

Thank you for your reply.

Please let me know once you release new version of binding.

Regards,

Diptendu Dutta

On Fri, 18 Aug, 2023, 12:39 pm Felix Zaslavskiy, @.***> wrote:

Hi thanks for your report. I happen to have an old PC and still running Windows 10 and AVX-only machine. The JVM does crash it is in the call to backend. I do recommend trying to run this on Windows 11 and it for sure works there. There was mention of a Windows issue with AVX-only version of gpt4all which I think you are probably on as well. If you patient maybe after I make new version of binding it may fix this.

— Reply to this email directly, view it on GitHub https://github.com/felix-zaslavskiy/gpt4all-java-bindings-sample/issues/1#issuecomment-1683455298, or unsubscribe https://github.com/notifications/unsubscribe-auth/ASBVDOWIXD2NWL3U7UJVVFLXV4IJJANCNFSM6AAAAAA3TWD434 . You are receiving this because you authored the thread.Message ID: @.*** com>

[aunwesha]

Hello,

I have managed to run it on Windows using wsl.

Thanks for your work.

Regards,

Diptendu Dutta