-
await self.inference_engine.infer_tensor(request_id, shard, tensor, inference_state=inference_state)
ValueError: Shapes (1,8,4,60,119) and (60,60) cannot be broadcast
-
The title bar steals the mouse cursor before you can ever select the tensor and/or the view itself.
https://github.com/rerun-io/rerun/assets/2910679/f726b503-def0-4fd9-9cdd-6e39c1092e28
-
### Describe the bug
example (provided by @YuLiu98): [abfs-pca-zero-size-tensor.tar.gz](https://github.com/user-attachments/files/16969863/abfs-pca-zero-size-tensor.tar.gz)
The LibRI data contai…
-
After installation, when I run bash finetune_lora.sh,the error:
File "/home/jinchuan/anaconda3/envs/llama3v/lib/python3.10/site-packages/transformers/models/mllama/modeling_mllama.py", line 650, in…
-
hello, I trianed it on DOTA datasets,but get error.
RuntimeError: The size of tensor a (80) must match the size of tensor b (1280) at non-singleton dimension 1
-
### Bug description
For some reason, the tensor parallel implementation generates non-sensical outputs
```
⚡ python-api-tensor-parallel ~/litgpt litgpt generate_tp checkpoints/microsoft/phi-2
…
rasbt updated
2 months ago
-
When using MarlinInt4WeightQBitsTensor and its associated optimized gemm kernel, there are issues with the weight/scales/zero-point readback as soon as parallelization increases.
The consequence i…
-
Following the notebook file, I tried to construct a DMPNN model for tox21.
Training for some reason takes way longer than the pytorch implementation onn chemprop.
So I tried to parallelize it in mul…
-
### Description
Using `Tensor.ReverseDimension(slice, dimension)` on a `TensorSpan` created via `TensorSpan.Slice` creates a tensor with partially invalid values - in this case, the source tensor has…
-
There seem to be inconsistencies in TTNN IR op layout inputs and outputs. Currently all op inputs are set to TILE layout, while all outputs are ROW_MAJOR. Example:
```mlir
#device = #tt.device, l1Ma…