-
Thanks for your contributions. I would like to know whether it can be deployed on multi-GPU to allow the use of more VRAM?
drdh updated
6 months ago
-
### đź“ť Environment
Details
```shell
> fish_ai_bug_report
Environment
Running on Mac OS X 15.0
Dependencies
Python 3.12.4
fish, version 3.7.1
fisher, version 4.4.4
git version 2.39.5…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.1.2+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
Following the docs about [Using LoRA Adapters](https://docs.vllm.ai/en/latest/models/lora.html), I am finding an assert problem. My code:
```python
from huggingface_hub import snapshot_download
f…
-
Hello. I just signed up for Mistral api, it is very exciting.
And at docs.mistral.ai/
I saw the provided code for connecting with the api is not so verbose; one block of the curl.
It may be help…
-
### 🚀 The feature, motivation and pitch
Mistral 7B instruct 0.3 implements function calling, this is a powerfull tool and MistralAi is one of the first to implement it in a "small" model.
```from …
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
Duckduckgo AI chat now have two more models, Llama 3(`meta-llama/Llama-3-70b-chat-hf`) and Mixtral 8x7B(`mistralai/Mixtral-8x7B-Instruct-v0.1`). Please consider support these two in APIs.
-
- [ ] [skorokithakis/ez-openai: Ez API, ez life.](https://github.com/skorokithakis/ez-openai)
# TITLE: skorokithakis/ez-openai: Ez API, ez life
**DESCRIPTION:**
AGPL-3.0 license
Ez OpenAI
My opi…
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I have followed step by step mentioned in below
https://docs.llamaindex.ai/en/stable/ex…