search

su77ungr / CASALIOY

♾️ toolkit for air-gapped LLMs on consumer-grade hardware
Apache License 2.0
229 stars 32 forks source link

Error in ingest #59

Closed lix2coder closed 1 year ago

lix2coder commented 1 year ago

I just test the embedding function under directory of models

Python 3.9.7 (default, Sep 16 2021, 13:09:58) [GCC 7.5.0] :: Anaconda, Inc. on linux Type "help", "copyright", "credits" or "license" for more information.

from langchain.embeddings import HuggingFaceEmbeddings, LlamaCppEmbeddings LlamaCppEmbeddings(model_path='./ggml-model-q4_0.bin', n_ctx=1024) llama.cpp: loading model from ./ggml-model-q4_0.bin 非法指令 (核心已转储)

hippalectryon-0 commented 1 year ago

非法指令 (核心已转储) = core dumped.

1) are you using the GPU version ? 2) Can you retry with python 3.10 ?

su77ungr commented 1 year ago

@lix2coder since the codebase has been restructured lately; the switch for the sentence-transformer should fix this issue. Ping me if you are still having problems.