-
**Describe the bug**
It seems as if Relu nodes that immediately follow Conv nodes are getting dropped during quantization (if included in ops_to_quantize). If I understand things correctly, then this…
-
After working whole day I finally coded it and published it.
Also I found a better prompt that captions better.
**You can download auto installer at here : https://www.patreon.com/posts/90744385…
-
Hello,
I'm running base mistral and using bnb to quantize as below:
```python
from optimum_benchmark.backends.pytorch.config import PyTorchConfig
from optimum_benchmark.benchmarks.inference.co…
-
Hi,
I do not understand images\: quantization dataset images . What is it and how I can get it ???
Thanks
-
### 🚀 The feature, motivation and pitch
I'm trying to test Lora with quantization using BnB and I'm using Docker to run vLLM. However, I can't find a docker image, on docker hub, with a tag that matc…
-
```
torch.optim
Quantization
Distributed RPC Framework
torch.random
```
why this order? not even alphabetical. I'd suggest that big special topics such as Quantization are presented on top in a …
-
### 1. System information
Colab , as of 2023-10-23
### 2. Code
Please see the attached colab notebook here
https://colab.research.google.com/drive/1yUD0nDu8oeeDtQBa7xCbQWx_w8PxS4UC?usp=sharin…
-
So, I need to implement stepped portamento as another glide mode. The simplest implementation is simply quantizing the pitch always to the nearest note and pitch changes, but I want to do a kind of "v…
-
In Glow, the quantization is done in two passes:
- profile generation
- quantization profile loading, and quantized model inference
Our understanding is that this mechanism works with the assumpt…
-
### Describe the issue
Observing that repository checkout can consume a lot of time.
Due to model files examples stored in the repository.
Those files can be outdated to the project branch, but d…
mc-nv updated
4 months ago