-
### The Feature
Feature request originally submitted to aider, but he said that it belonged here.
https://github.com/paul-gauthier/aider/issues/1380#issuecomment-2339128896
### Issue
When us…
-
Hi!
I heard about a very promising model some while ago that you might be interested in. It's called fish.audio.
Here's a youtube demo : https://www.youtube.com/watch?v=Ghc8cJdQyKQ
Here's the…
-
Hello, I created a test script which I was testing on Aarch64 platform, for distilbert inference and using wanda sparsifier:
```
import torch
from transformers import BertForSequenceClassificatio…
-
Hi there,
I am trying to run the Resnet-50 adestrated on imagenet that you give as an [example](https://github.com/Xilinx/Vitis-AI/tree/3.0/examples/vai_runtime/resnet50), I am using vitis3.0.
T…
-
```python
print('--> Building model')
ret = self.model.build(do_quantization=False)
if ret != 0:
print('Build model failed!')
exit(ret)
print('don…
-
## 🐛 Bug
I get an error
- loop in forward and loop count num from input x
- call torch.quantization.quantize_fx.prepare_fx
## To Reproduce
Steps to reproduce the behavior:
1. code e…
MHGL updated
11 months ago
-
### Feature request
Pass in `torch_dtype` in model_kwargs, as supported by sentence_transformers when specifying dtype in the infinity_emb v2 cli when InferenceEngine type is torch.
This would all…
-
Hi. I'm saving my model to GGUF after training. These are the utilization metrics:
> 155.3186 seconds used for training.
> 2.59 minutes used for training.
> Peak reserved memory = 7.939 GB.
> Pe…
-
### Your current environment
The output of `python collect_env.py`
```text
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A…
-
### Discussed in https://github.com/openvinotoolkit/nncf/discussions/2547
Originally posted by **MinGiSa** March 5, 2024
I've been working on converting Torch models into OpenVINO models rece…