-
### System Info
Hello TensorRT-LLM team! 👋 I'm facing an issue where the inference output does not contain the expected "Singapore" text. Below are the details of my setup and steps to reproduce the …
-
## Problem Statement
I am trying to dequantize the quantized tensor (packed into `int32`) and perform multiplication to another tensor in `fp16`. However, I observed a weird error: `LLVM ERROR: mma16…
-
### Summary
Last year, we released [pytorch-labs/torchao](https://github.com/pytorch-labs/ao) to provide acceleration of Generative AI models using native PyTorch techniques. Torchao added support …
-
## 🐛 Bug
LSTM network can not be evaluated after preparing for quantisation aware training. The same warning does not appear if evaluated before preparing.
## To Reproduce
Steps to reproduce…
-
Hello,
Did anyone try pathway analysis with GAGE and Pathview using Sleuth results (`results_table.csv` where column names are: target_id, test_stat, pval, qval, rss, sigma_sq, tech_var, mean_obs, …
-
**Is the bug primarily related to salmon (bulk mode) or alevin (single-cell mode)?**
This is relevant to salmon.
**Describe the bug**
I have been trying to run the salmon quant commando and have ke…
-
hello~I will be appreciate if you can give any advice!
my accelerate,peft,deepspeed,transformer are all the latest version. "device_map" is set to auto
CUDA_VISIBLE_DEVICES="0,5" torchrun --nnod…
-
## ❓ Questions and Help
#### I'm trying to fine-tune BART model for classification task on another language by following the steps in the [example](https://github.com/pytorch/fairseq/blob/master/…
-
### Is there an existing issue for this problem?
- [X] I have searched the existing issues
### Operating system
Linux
### GPU vendor
AMD (ROCm)
### GPU model
AMD Radeon RX 7800 XT…
-
Dear Greg - thanks for your continued work on this and for this follow up paper with updated pipeline. I'm the lead author of [Hermida et al. Nat Commun 2022](https://www.nature.com/articles/s41467-02…