-
When i ran quantize code for llama3-70b-instruct. It was successfull, but when i used vllm load quantized model. I got a warning: `awq quantization is not fully optimized yet. The speed can be slower …
-
Hello all,
I've been trying to combine dask-ml's tools in the most vanilla way that I can think of and they don't seem to fit together (no pun intended).
Specifically, I want to both train model…
-
### Motivation
Set internvl as an example, it's vision model is 6B. If the vision model can be quantilized, the inference process can be done in only one 4090.
请问目前vision model不支持量化的原因,是因为feature暂时还…
-
### 🚀 The feature, motivation and pitch
Fuyou Training Framework Integration for PyTorch
Description:
Integrate the Fuyou training framework into PyTorch to enable efficient fine-tuning of larg…
-
### Idea Contribution
- [X] I have read all the feature request issues.
- [X] I'm interested in working on this issue
- [X] I'm part of GSSOC organization
### Explain feature request
Deep Learning …
-
I would like to ask the YOLOv8 team, YOLO has already reached the tenth generation, and I am wondering if your team has any plans to release the 11th generation. I hope the next generation can increas…
-
### 🐛 Describe the bug
I made very simple python script which loads torchvision ResNet50 model and tries to export to onnx file in two ways (torch.onnx.export and torch.onnx.dynamo_export)
```
…
-
Hi! I have a quick question regarding the future prospects for the package.
A common use case for optimization is to have a dataset that fully contains your set of choices, as opposed to an analyt…
-
Tracker issue for adding [LayerSkip](https://arxiv.org/abs/2404.16710) to AO.
This is a training and inference optimization that is similar to layer-wise pruning. It's particularly interesting for…
jcaip updated
2 weeks ago
-
Recolección de datos desde sensores, database y dispositivos públicos real time para elaborar un programa y una propuesta integral de ciudad inteligente que servirá a la ciudad para atraer turismo de …