-
I'd be very interested in how we could take llm.c models and export them into universal formats, e.g. for very fast inference in llama.cpp, vllm, or etc. Or how they could be made HuggingFace compat…
-
Does torch.export preserve the quantize_per_tensor/dequantize_per_tensor ops? I was testing with
```python
import torch
from torchao.quantization.quant_api import (
quantize_,
int8_dyna…
-
### System Info
py3.10
infinity-emb 0.0.55
Running with optimum engine fails:
```
INFO 2024-09-13 15:17:02,874 datasets INFO: PyTorch version 2.4.0 available. …
rawsh updated
2 weeks ago
-
### 问题描述
固定 seed 测了下,为了确认 seed 是固定的,先重复运行了多卡脚本,确保每次图像不变。
在这个条件下,不同卡数生成的图像:
| | image |
|--------------------------------|-------|
| flux_result_dp1_cfg1_ulysses1_…
-
### Feature request
PyTorch 2.5 introduces the `torch.onnx.export(..., dynamo=True)` option and an improved export logic for converting models to ONNX. We recommend optimum to leverage this feature…
-
Thank you for your work, the performance of this model is quite good. I would like to deploy and use it. Is there a way to export it to ONNX?
-
When I convert my best.pt model (trained on a custom dataset) to ONNX I lose a class. The best.pt model has 19 classes and the best.onnx model has 18 classes. I can't work out why. Am I missing someth…
-
There are 3 options in GA4 to export data to Bigquery -> Daily, Fresh Daily and Streaming.
Enabling Daily creates sharded tables called events_*
Enabling Fresh Daily creates sharded tables called…
-
Is it possible to extend the feature of recursive folder detection, that it also consider existing barrel files in the recursive folders?
This would simplify the barrel files, especially in higher hi…
-
Hi, I'm having trouble with the export_int8_model.py code results and would like to ask a question.
The model in the huggingface was fine, but I'm wondering what is causing the size issue when app…