-
### Description
When running t2t-decoder script ( En-De transformer-big) on a model which was trained on 8 GPUs using DistributedMirrorStrategy.
I get the following error
ValueError: Tensor("bod…
assij updated
3 years ago
-
Has anyone exported the soundstream model to ONNX? I tried:
`torch.onnx.export(soundstream, audio, "soundstream.onnx")`
but it fails with
```
/home/divya/.local/lib/python3.8/site-packages/…
-
**Describe the bug**
When turning the flag with_mixed_precision = False the code crashes when computing the attentions [here](https://github.com/clessig/atmorep/blob/main/atmorep/transformer/transf…
-
I need to optimize every tool that uses a huggingface model. Such as NMT. Maybe kernl to replace graphs with torch jit or flash attention. Inference speed is key for these.
Investigate faster tran…
-
Dear Qualcomm,
It fails to generate genie-compatible QNN binaries, according to the guide (https://github.com/quic/ai-hub-models/tree/main/qai_hub_models/models/llama_v2_7b_chat_quantized/gen_ond…
-
## ❓ Questions and Help
@nikithamalgifb, as per our offline discussion, I am reporting the issue with tracing of HuggingFace (HF) Models here. I am facing this issue with using Trace API from Torc…
-
Allow to update the query (in place in the graph title bar) for already monitored functions. This can be done without backend modification with a demonitor/monitor combo.
Some restrictions may apply …
-
### 🐛 Describe the bug
We have Dynamo backend defined similar to IPEX which traces and freezes the model:
```python
import importlib
import logging
import torch
from torch._dynamo import reg…
-
**Proposal for usability / UI improvement**
In the result histogram graph, you can drag your mouse over a given timeframe (which produces an overlay on the graph for the selected area).
When the mou…
-
### Description (简介)
**Hi, everyone👋**
Recently, the community has welcomed many new guys. In order to let everyone get familiar with the project and participate in the community faster, we crea…