-
Command： python -m main interactive /mistral-7B-v0.1/
Error:
Prompt: Hello
Traceback (most recent call last):
File "/usr/local/anaconda3/envs/mistral/lib/python3.10/runpy.py", line 196, in _ru…
-
Hi,
I'm new to Langchain and LLM.
I've recently deployed an LLM model using the Hugging Face text-generation-inference library on my local machine.
I've successfully accessed the model using …
-
I have followed all the step mentioned I can able to execute the ./rag_demo --help command but when i try to run the main command to interact with model its telling the illegal instruction
![image…
-
### **Title**: Dynamic FAISS Integration for RAG in Prototyping Conversations
---
### **Description**
Implement a lightweight Retrieval-Augmented Generation (RAG) solution using FAISS for small-sc…
-
I using docker version: nvcr.io/nvidia/tritonserver 23.10-trtllm-python-py3
run follow script:
python scripts/launch_triton_server.py --world_size=1 --model_repo=/tensorrtllm_backend/triton_model_…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
This is on an M3 MacBook Pro.
1. I'm following the guide, I had Ollama set up and running already, I'm serving a llama3 variant which I tested. Listening on the 1st terminal window.
2. I configured …
-
**Describe the bug**
I tried building docker image by closing source code and also building using pip pymemgpt and additionally copying memgpt config and credentials from working ~/.memgpt folder. Bu…
-
### What happened + What you expected to happen
Our OSS library launches Ray tasks on a cluster on behalf of our users. One user (@dcavadia) reported (https://github.com/run-house/runhouse/issues/9#i…