Open zarmonela opened 1 year ago
zarmonela
commented
1 year ago LLM model path C:/Users/Bz/Downloads/gpt4all.unity-master (1)/gpt4all.unity-master/Assets/StreamingAssets\Assets/StreamingAssets/Gpt4All/wizardlm-13b-v1.1-superhot-8k.ggmlv3.q4_0.bin doesn't exist!
UnityEngine.Debug:LogError (object)
Gpt4All.LlmWrapper:InitFromPath (Gpt4All.LlmModelType,string) (at ./Packages/com.gpt4all.unity/Scripts/LlmWrapper.cs:166)
Gpt4All.LlmWrapper/<>c__DisplayClass28_0:
Macoron
commented
1 year ago Wizardlm isn't supported by current version of gpt4all-unity. Right now it was tested with:
Check #11 for more information
danger-electrodes
commented
1 year ago Hello, I'm getting the same error as OP as well as an error due to Whisper?
Model not loaded error :
NullReferenceException: Object reference not set to an instance of an object
Gpt4All.LlmManager.InitModel () (at Packages/com.gpt4all.unity/Scripts/LlmManager.cs:114)
UnityEngine.Debug:LogException(Exception)
Gpt4All.
Whisper Error :
Whisper model isn't loaded! Init Whisper model first!
UnityEngine.Debug:LogError (object)
Gpt4All.LlmManager/
Do I need to add your whisper package too?
Could you also provide a link to the models you mentionned too? I can't find them on gpt4all.io?
Macoron
commented
1 year ago Hello, I'm getting the same error as OP as well as an error due to Whisper? Do I need to add your whisper package too?
No, it's just a typo. You don't need whisper to run LLMs. Actual error is just saying that it failed to load model weights for some reason.
Could you also provide a link to the models you mentionned too? I can't find them on gpt4all.io?
gpt4all deprecated old models recently. I make fork of their models on HF. Check readme to get compatible models weights.
zarmonela
commented
1 year ago Wizardlm isn't supported by current version of gpt4all-unity. Right now it was tested with:
- mpt-7b-chat
- gpt4all-j-v1.3-groovy.bin
- gpt4all-l13b-snoozy
Check #11 for more information
Hey! I'm working on updating the project to incorporate the new bindings. I'd love to chat and ask you a few questions if you're available. Please let me know.
Macoron
commented
1 year ago @zarmonela sure, I created a quick Discord group, so we can discuss it there. https://discord.gg/RAjD5yY7bP
Alternatively, you can ask all questions in this issue.
Elevons
commented
1 year ago How's this going? Any way I can help?
On Sun, Aug 27, 2023, 3:30 AM zarmonela @.***> wrote:
Wizardlm isn't supported by current version of gpt4all-unity. Right now it was tested with:
- mpt-7b-chat
- gpt4all-j-v1.3-groovy.bin
- gpt4all-l13b-snoozy
Check #11 https://github.com/Macoron/gpt4all.unity/issues/11 for more information
Hey! I'm working on updating the project to incorporate the new bindings. I'd love to chat and ask you a few questions if you're available. Please let me know.
— Reply to this email directly, view it on GitHub https://github.com/Macoron/gpt4all.unity/issues/14#issuecomment-1694509378, or unsubscribe https://github.com/notifications/unsubscribe-auth/AX4DMKJBIF6YB335FXDKOVTXXJWXFANCNFSM6AAAAAA3Q5KKRE . You are receiving this because you are subscribed to this thread.Message ID: @.***>
hey getting this error please help
NullReferenceException: Object reference not set to an instance of an object Gpt4All.LlmManager.InitModel () (at ./Packages/com.gpt4all.unity/Scripts/LlmManager.cs:114) UnityEngine.Debug:LogException(Exception) Gpt4All.d37:MoveNext() (at ./Packages/com.gpt4all.unity/Scripts/LlmManager.cs:121)
System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1:SetResult(LlmWrapper)
Gpt4All.d 28:MoveNext() (at ./Packages/com.gpt4all.unity/Scripts/LlmWrapper.cs:214)
UnityEngine.UnitySynchronizationContext:ExecuteTasks()