-
### System Info
- `transformers` version: 4.44.0
- Platform: Linux-4.18.0-553.16.1.el8_10.x86_64-x86_64-with-glibc2.28
- Python version: 3.9.4
- Huggingface_hub version: 0.23.2
- Safetensors vers…
-
(As usual, I'll give the point of view of small projects like WooCommerce ...)
The current way of using HF models is quite technical: build scripts to download models, convert to ONNX, deploy
(htt…
-
### Describe the bug
https://github.com/openvinotoolkit/anomalib/blob/3fe55842cf7bf1024ed43022d5859600052a4ed0/src/anomalib/models/components/base/export_mixin.py#L251
**as the [nncf api documen…
-
```
INFO:mteb.cli:Running with parameters: Namespace(model='royokong/e5-v', task_types=None, categories=None, tasks=['BLINKIT2IRetrieval'], languages=None, device=None, output_folder='/data/niklas/mi…
-
Hi, onnxruntime provides a very useful optimization on transformers models. I can using them convert a 1.2Gb model into a 400M in int8 quantized model.
Is there any plan to support further tensorr…
-
### 🐛 Describe the bug
I'm experiencing an issue exporting the `Mixtral-8x7B` model.
I originally discussed the problem in #130274, but this is more about `torch.export`. My ultimate goal is to g…
-
Notice: In order to resolve issues more efficiently, please raise issue following the template.
（注意：为了更加高效率解决您遇到的问题，请按照模板提问，补充细节）
## ❓ Questions and Help
### Before asking:
1. search the iss…
-
The error occurs when I move the slide to close my lips, before I didn't get that error, but now I do.
Python 3.10.6 (tags/v3.10.6:9c7b4bd, Aug 1 2022, 21:53:49) [MSC v.1932 64 bit (AMD64)]
Versi…
-
### Question
A previous issue #265 and my personal experience with the models in the  shows that the models' …
-
### Problem Description
I get these errors often from [various applications](https://github.com/pytorch/pytorch/issues/134208), this one if from ComfyUI.
Is scaled_dot_product_attention part of fl…