-
`transformer_engine.pytorch.module.layernorm.LayerNorm` calls `inputmat = inp.view((-1, in_features))` which throws the error below. Using `reshape` fixes this error.
![image](https://github.com/NVID…
-
torch-npu 2.2 版本。模型llama 7b
[ma-user LLaMA-Factory]$npu-smi info
+------------------------------------------------------------------------------------------------+
| npu-smi 23.0.rc2 …
-
当我参考readme.md文件中的指示使用命令python demo/image_demo.py .//images//xixi_33.tif configs/rsprompter/samseg-maskrcnn-whu.py --weights ./checkpoint\sam-vit-base/pytorch_model.bin --out-dir ./output
控制台报错…
-
Very minor issue here. For some reason, I ran into troubles when using PyTorch 1.2.0. Specifically when using BatchSemiHardTripletLoss, I got an error similar to https://github.com/huggingface/transfo…
-
## Where are we?
Exporting pytorch model for ExecuTorch runtime goes through multiple AoT (Ahead of Time) stages.
At high level there are 3 stages.
1. `exir.capture`: This captures model’s graph …
-
@NielsRogge i am facing this issue....
```
from transformers import TrainingArguments, Trainer
training_args = TrainingArguments(output_dir="test",
max_steps=…
tzktz updated
9 months ago
-
Hi. Something (possibly not unsloth) changed between July and now.
I am getting an unexpected OOM error trying to do a LORA finetune. This worked before, but is now barfing.
Looked at #338, but not…
-
### System Info
Platform: Linux-5.15.0-52-generic-x86_64-with-glibc2.35
Python version: 3.10.12
PyTorch version (GPU?): 2.4.0+cu121 (True)
[TensorRT-LLM] TensorRT-LLM version: 0.12.0
Driver Version: …
-
When I run the inference logic using the following script, I get `RuntimeError: No available kernel. Aborting execution.` error:
```
A100 GPU detected, using flash attention if input tensor is on…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…