-
Hi,
I am trying to convert and save model: "mistralai/Mistral-7B-Instruct-V0.2" in 4bit and running into an error. I am using Flex GPU.
Could you please kindly help.
The error:
I am us…
-
/opt/conda/lib/python3.10/site-packages/tree_of_thoughts/treeofthoughts.py:481
solution = self.model.generate_solution(initial_prompt, best_state)
AttributeError: 'HuggingLanguageModel' object has…
-
I try to use **trusted-bigdl-llm** to run the Fastchat.
When I build the base image,I got the patching failed error:
```
patching file /usr/local/lib/python3.9/dist-packages/bigdl/llm/utils/utils.p…
-
How many shots do you use to test advGLUE?
-
### Your current environment
```text
安装完之后,直接运行python examples/minicpmv_example.py出现的问题
INFO 06-27 10:16:32 utils.py:598] Found nccl from environment variable VLLM_NCCL_SO_PATH=/usr/local/lib/pytho…
-
**Describe the bug**
Hi, all. Working on a blog article, following a mix of local documentation + Intelligent app workshop, but instead of going Falcon, I've gone with the Mistral 7b model. and at …
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I am trying to create a RAG chatbot that only answers from the content that i provide th…
-
### What is the issue?
Since I installed ollama (v0.1.30) on Windows 11 Pro, I run into a peculiar issue. When I launch ollama from the installed shortcut, which launches "ollama app.exe", or when …
-
on Windows (WindowsServer 2019).
Model: TheBloke/Llama-2-7b-Chat-GGUF, on: **cpu**
this tip dont help me: pip install llama-cpp-python --force-reinstall --upgrade --no-cache-dir (from issues #46…
-
**Is your feature request related to a problem? Please describe.**
I think it would be super neat if you could use LLMs to predict text, they are basically auto complete on steroids and take everythi…