failed to generate embedding

[Bobpick]

I installed it without any issues. However the embeddings took quite some time and I ended it. I tried to restart it but it threw an error. I then replaced all the files except the vault and now I have this:

Cloning into 'easy-local-rag'...
remote: Enumerating objects: 146, done.
remote: Counting objects: 100% (29/29), done.
remote: Compressing objects: 100% (28/28), done.
remote: Total 146 (delta 12), reused 3 (delta 1), pack-reused 117ReceReceiving objects:  89% (130/146)
Receiving objects: 100% (146/146), 63.38 KiB | 1.06 MiB/s, done.
Resolving deltas: 100% (72/72), done.
PS C:\Users\Bob\easy-local-rag> cd ..
PS C:\Users\Bob> git clone  https://github.com/AllAboutAI-YT/easy-local-rag.git
fatal: destination path 'easy-local-rag' already exists and is not an empty directory.
PS C:\Users\Bob> cd .\easy-local-rag\
PS C:\Users\Bob\easy-local-rag> python .\localrag_no_rewrite.py
Traceback (most recent call last):
  File "C:\Users\Bob\easy-local-rag\localrag_no_rewrite.py", line 92, in <module>
    response = ollama.embeddings(model='mxbai-embed-large', prompt=content)
               ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "C:\Python312\Lib\site-packages\ollama\_client.py", line 198, in embeddings
    return self._request(
           ^^^^^^^^^^^^^^
  File "C:\Python312\Lib\site-packages\ollama\_client.py", line 73, in _request
    raise ResponseError(e.response.text, e.response.status_code) from None
ollama._types.ResponseError: failed to generate embedding
PS C:\Users\Bob\easy-local-rag>

Any thoughts?

[AllAboutAI-YT]

did you pull the embeddings model?:)

[Bobpick]

Yes, in the initial install and when I ran it, it ran for 2 hours before I ended it. I made vault smaller and still the embedding just hangs.

[jwai99]

i also have the same issue running on linux with amd gpu using rocm in a cuda env

ah ive fixed it using this patch on this github https://github.com/AllAboutAI-YT/easy-local-rag/issues/14

[vitorcalvi]

Traceback (most recent call last): File "localrag.py", line 134, in response = ollama.embeddings(model='mxbai-embed-large', prompt=content) File "/opt/homebrew/anaconda3/envs/RAG2/lib/python3.8/site-packages/ollama/_client.py", line 198, in embeddings return self._request( File "/opt/homebrew/anaconda3/envs/RAG2/lib/python3.8/site-packages/ollama/_client.py", line 73, in _request raise ResponseError(e.response.text, e.response.status_code) from None ollama._types.ResponseError: failed to generate embedding