MODEL_TYPE=LlamaCpp # GPT4All or LlamaCpp
MODEL_PATH=eachadea/ggml-vicuna-7b-1.1/ggml-vic7b-q5_1.bin
MODEL_TEMP=0.8
MODEL_STOP=[STOP]
CHAIN_TYPE=stuff
N_RETRIEVE_DOCUMENTS=100 # How many documents to retrieve from the db
N_FORWARD_DOCUMENTS=6 # How many documents to forward to the LLM, chosen among those retrieved
python ingest.py --device_type mps
Traceback (most recent call last):
File "/Users/ac/Documents/mc2/projects/casalioygpt/casapoetry/casalioygpt/casalioy/ingest.py", line 26, in
from load_env import chunk_overlap, chunk_size, documents_directory, get_embedding_model, ingest_n_threads, persist_directory
File "/Users/ac/Documents/mc2/projects/casalioygpt/casapoetry/casalioygpt/casalioy/load_env.py", line 9, in
from casalioy.utils import download_if_repo
ModuleNotFoundError: No module named 'casalioy'
(base)
.env
Generic
MODEL_N_CTX=1024 TEXT_EMBEDDINGS_MODEL=sentence-transformers/all-MiniLM-L6-v2 TEXT_EMBEDDINGS_MODEL_TYPE=HF # LlamaCpp or HF USE_MLOCK=true
Ingestion
PERSIST_DIRECTORY=db DOCUMENTS_DIRECTORY=source_documents INGEST_CHUNK_SIZE=500 INGEST_CHUNK_OVERLAP=50
Generation
MODEL_TYPE=LlamaCpp # GPT4All or LlamaCpp MODEL_PATH=eachadea/ggml-vicuna-7b-1.1/ggml-vic7b-q5_1.bin MODEL_TEMP=0.8 MODEL_STOP=[STOP] CHAIN_TYPE=stuff N_RETRIEVE_DOCUMENTS=100 # How many documents to retrieve from the db N_FORWARD_DOCUMENTS=6 # How many documents to forward to the LLM, chosen among those retrieved
Python version
3.11.5
System
14.0 (23A344
CASALIOY version
v0.1.1 ->https://github.com/su77ungr/CASALIOY/tree/gguf-fix
Information
Related Components
Reproduction
python ingest.py --device_type mps Traceback (most recent call last): File "/Users/ac/Documents/mc2/projects/casalioygpt/casapoetry/casalioygpt/casalioy/ingest.py", line 26, in
from load_env import chunk_overlap, chunk_size, documents_directory, get_embedding_model, ingest_n_threads, persist_directory
File "/Users/ac/Documents/mc2/projects/casalioygpt/casapoetry/casalioygpt/casalioy/load_env.py", line 9, in
from casalioy.utils import download_if_repo
ModuleNotFoundError: No module named 'casalioy'
(base)
Expected behavior
it should start ingesting files