-
torch-npu 2.2 版本。模型llama 7b
[ma-user LLaMA-Factory]$npu-smi info
+------------------------------------------------------------------------------------------------+
| npu-smi 23.0.rc2 …
-
当我参考readme.md文件中的指示使用命令python demo/image_demo.py .//images//xixi_33.tif configs/rsprompter/samseg-maskrcnn-whu.py --weights ./checkpoint\sam-vit-base/pytorch_model.bin --out-dir ./output
控制台报错…
-
## Description
Currently the mxnet temporal fusion transformer only allows for quantile loss. It would be helpful to be able to specify other distributions (i.e. negative binomial for count data).
…
-
It seems that we can not get pytorch or transformer on macos.
https://github.com/hasktorch/hasktorch-datasets/pull/1
-
Is there any BGE model that can be used for multi-label text classification (predefined labels) by adding some dense layers for classification (similar to BERT base uncased) instead of Sentence BERT?
-
Currently NestedTensors give errors (examples - https://pytorch.org/tutorials/prototype/nestedtensor.html and https://pytorch.org/docs/stable/nested.html)
```
File :23, in forward(__beartype_objec…
-
When I run the inference logic using the following script, I get `RuntimeError: No available kernel. Aborting execution.` error:
```
A100 GPU detected, using flash attention if input tensor is on…
-
Hi. Something (possibly not unsloth) changed between July and now.
I am getting an unexpected OOM error trying to do a LORA finetune. This worked before, but is now barfing.
Looked at #338, but not…
-
### System Info
Platform: Linux-5.15.0-52-generic-x86_64-with-glibc2.35
Python version: 3.10.12
PyTorch version (GPU?): 2.4.0+cu121 (True)
[TensorRT-LLM] TensorRT-LLM version: 0.12.0
Driver Version: …
-
### Bug description
Got
**RuntimeError: Expected all tensors to be on the same device, but found at least two devices, cuda:1 and cuda:0! (when checking argument for argument index in method wrapp…