-
### Your current environment
latest released docker 0.5.4 on 8*H100 80GB on single GPU
### 🐛 Describe the bug
Despite @DarkLight1337 closing this issue: https://github.com/vllm-project/vllm/issues/…
-
Thanks so much for this work!
1. What is the minimum GPU requirement to fine-tune the model? Will 2xV100 (32gb) be enough?
2. Is it possible to run inference via OpenAI API on the peft-finetuned mod…
-
# Bug Report
## Installation Method
I installed open-webui using docker compose via the `run-compose.sh` script.
## Environment
- **Open WebUI Version:** 0.3.31
- **Ollama (if applicable)…
-
Hi,
I have 3x3090 and I want to run Ollama Instance only on a dedicated GPU. The reason for this: To have 3xOllama Instances (with different ports) for using with Autogen.
I also tried the "Dock…
-
### What happened?
`validate_environment()` works fine for `gpt-3.5-turbo` and `claude-3-sonnet-20240229`:
- When the environment is set up properly, then `keys_in_environment = True` and `missing…
-
ANIMINA users add photos to their stories but we don't use those photos as input. Example: If somebody uploads a couple of photos with dogs then we can use that information to assume that this person …
-
### System Info / 系統信息
Python 3.10
transformers 最新
### Who can help? / 谁可以帮助到您？
@zRzRzRzRzRzRzR
### Information / 问题信息
- [ ] The official example scripts / 官方的示例脚本
- [X] My own modif…
-
https://huggingface.co/OpenGVLab/InternVL-Chat-V1-5
下载上述文件，按照要求，下载transformers==4.37.2的版本，运行Model Usage中的代码，输出结果乱码
请问有办法解决吗？
Download the above file, download the transformers==4.37.2 version acc…
-
### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答？ | Is there an existing ans…
-
#### Problem
The existence of both `definePrompt` and `defineDotPrompt` is causing confusion. See also: discussion https://github.com/firebase/genkit/discussions/337. I believe this at least partia…