-
# URL
- https://arxiv.org/pdf/2310.06825
# Affiliations
- Albert Q. Jiang, N/A
- Alexandre Sablayrolles, N/A
- Arthur Mensch, N/A
- Chris Bamford, N/A
- Devendra Singh Chaplot, N/A
- Diego…
-
### Your current environment
The output of `python collect_env.py`
```text
Your output of `python collect_env.py` here
```
### Model Input Dumps
model="Qwen/Qwen2.5-72B-Instruct"
guid…
-
Here is the code it gives .... EVERY NOTEBOOK I tried.
---------------------------------------------------------------------------
NameError Traceback (most recent…
-
When I try to load an unsloth 4bit model with
`llm = LLM("unsloth/mistral-7b-instruct-v0.3-bnb-4bit", dtype="half")`,
I get the error
`Cannot find any of ['adapter_name_or_path'] in the model's q…
-
### Your current environment
```text
The output of `python collect_env.py`
Collecting environment information...
WARNING 07-15 19:13:04 _custom_ops.py:14] Failed to import from vllm._C with Mo…
-
I am using `intfloat/e5-mistral-7b-instruct` model to get last hidden state for my input and compute cosine similarity.
I am using a toy example provided at: https://huggingface.co/intfloat/e5-mist…
-
### Describe the issue
We referred to your code [https://github.com/microsoft/LLMLingua/blob/main/experiments/llmlingua2/evaluation/compress.py](url), [https://github.com/microsoft/LLMLingua/blob/mai…
-
I'm using the default LM Studio settings (In Griptape/ComfyUI and on LM Studio) BUt I'm getting the below error
And the text output from Griptape: Tool Task is: 'NoneType' object is not iterable
2…
-
### Validations
- [X] I believe this is a way to improve. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](https://gi…
-
### Feature request
Recent mistral models inlcuding mistral 7b v0.3 instruct have consolidated.safetensors which have different weights key names compared to what LoRAx expects. Also there are keys…