-
### Your current environment
vllm-tgi:
container_name: vllm-tgi
image: vllm/vllm-openai:v0.6.3.post1
restart: always
shm_size: "16gb"
command: "--model /model --served-mode…
-
Love the crate. Curious, any way to get these larger models like Mistral 7X8B into it?
Their pytoch_model.bin files are split into multiple files, and uncertain how to convert that. Have used t…
-
### What happened?
When using LiteLLM as proxy for Together.ai and Mistral-7b-Instruct-v0.2 there are two strange issues that occur during inference when using the [Chat-UI](https://github.com/hugg…
-
Please change the license @haoheliu. This will open up new possibilities for the world of open source software. This is currently the one of the _only_ diffusion-based audio generators. This has the p…
-
I've tried to merge Mistral 7B with Platypus2-7B and I receive this error "Tensor model.layers.39.mlp.down_proj.weight required but not present in model garage-bAInd/Platypus2-7B".
I also tried ot…
-
Hello,
I have been testing out both the role play and original pipelines, and I am seeing random undesired data in the outputs.
To use a recent rp pipeline run as an example, I deleted everythin…
-
**TIER**: Corporate Mogul
**CODE**: 6EM0L-M76C5-N3R5Z
**NAME**: Mistral
**BLUEPRINT**:
[Mistral.zip](https://github.com/tsunamayo/Starship-EVO-Backers-Ships/files/4567001/Mistral.zip)
![202005…
-
### Describe the issue
Issue:
I have finetuned mistral llava model with a sample dataset and the training was well
here is the commands of training
```
deepspeed llava/train/train_mem.py -…
-
**❗BEFORE YOU BEGIN❗**
Are you on discord? 🤗 We'd love to have you asking questions on discord instead: https://discord.com/invite/a3K9c8GRGt
**Describe the bug**
AttributeError: 'str' object has…
-
Can we use other APIs and LLMs?
I'm trying to not get stuck in the OpenAI world.