typescript: Models keep emitting strange symbols

[jacoobes]

System Info

MSVC 143 nodejs v 18.15.0 windows 10 AMD64 ryzen 3100 AVX2 AVX gpt4all-j groovy 1.3 , also mosaic mpt 7b

Information

• [ ] The official example notebooks/scripts
• [X] My own modified scripts

Related Components

• [X] backend
• [X] bindings
• [ ] python-bindings
• [ ] chat-ui
• [ ] models
• [ ] circleci
• [ ] docker
• [ ] api

Reproduction

• clone https://github.com/nomic-ai/gpt4all/tree/jacoobes-patch-1
• make sure to recursively update submodules (llama.cpp)
• cd gpt4all/*bindings/typescript
• yarn build:backend to build the shared libraries
• yarn to build the nodejs bindings
• node spec/index.mjs

Everything loads correctly, but when it gets to prompting, i get weird symbols and Im unsure how to solve this. Behavior was working correctly previously, right before #913 was merged

Expected behavior

Prompting to infer successfully.

[jacoobes]

Culprit was partially installed models, will close now 👍