-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### YOLOv8 Component
_No response_
…
-
I've been successfully serving mistralai/Mixtral-8x7B-Instruct-v0.1 on 2xA100 80GBs with the following command just fine:
`python3 -m vllm.entrypoints.openai.api_server --model mistralai/Mixtral-8x7B…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What would your feature do ?
I would like to be able to get a list of th…
-
### System Info
I am getting an error after loading Blip2 in 4bit, cant inference, cant train. Can anyone help?
### Who can help?
_No response_
### Information
- [ ] The official example script…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
```
deepspeed --include localhost:0,1,2,3 --master_port 29504 src/train_bash.py \
--sta…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### Reproduction
```
git clone https://github.com/hiyouga/LLaMA-Factory
cd LLaMA-Factory
docker-compose up -d
`…
-
Could you provide a notebook for Post Training Quantization and Quantization Aware Training in object detection topic?
-
### Bug description
I want to train a text to image diffusion model using lighting. There are mainly three models, a text encoder, a vae and a unet.
I setup them with
```
fabric.setup(unet, un…
caiqi updated
7 months ago
-
Hello,friends:
I am trying to convert h5 model to tflite-int8 model,the code is as follows:
~~~
model_filename = "alexnet_tflite_kws_model.h5"
tflite_filename = "alexnet_tflite_int8.tflite"
mod…
-
### Search before asking
- [X] I have searched the YOLOv8 [issues](https://github.com/ultralytics/ultralytics/issues) and found no similar bug report.
### YOLOv8 Component
Export
### Bug
Hi, guy…