-
## ❓ Questions and Help
Recently, I speed up [GLM-10B](https://huggingface.co/THUDM/glm-10b-chinese/blob/main/modeling_glm.py) model inference with `torch/xla`.
The XLA got **3.5x** faster than PT2.…
-
BMM proteus f7 board ECU, firmware 20240330
While Idling, changing the Idle Max add and remove percentage in Closed Loop Fueling does not seem to adjust the correct region. However, when Adjusting …
rk-iv updated
2 months ago
-
大佬大佬,请问要怎么样解决?
使用TPH训练,使用检测命令加载该训练权重时 python detect.py --weights runs_swin/exp/weights/best.pt 出现报错
Fusing layers...
Traceback (most recent call last):
File "detect.py", line 350, in
dete…
-
One part of my model performs the matrix multiplication, i.e torch.bmm() / torch.matmul(), but results show the GMac of this part is 0.0, i want to know if this is because the GMac is too small or it…
-
devices=-1, in train.py with a machine with 2 more more GPU's causes these errors:
RuntimeError: It looks like your LightningModule has parameters that were not used in producing the loss returned by…
-
Branch: `asarje/alex/metal/bmm_large_block_untilize_out`
Test: `TT_METAL_WATCHER=20 pytest tests/ttnn/integration_tests/resnet/test_ttnn_functional_resnet.py::test_resnet_50`
Looks like the preced…
-
Hi,
**Background:**
I am writing the methods section for the sound correspondences paper. I evaluated the simple "cognate detection" method we used against the expert annotations in Lexicore datas…
-
## ✨ 任务背景
现有的深度学习框架主要是基于对实数函数的优化设计的,在主流的深度学习应用场景中,网络的输入变量,中间变量,输出变量都是实数,与此相关的基础设施,比如数组,优化器等组件也都是适用于实数类型。
但随着深度学习应用的扩展,也出现对复数支持的需求,比如图像,语音等领域的傅里叶变换,量子物理领域,其理论体系都是基于复数建立的。虽然并非不能用实数表示复数运算,但稍显繁琐,深度学习框架有…
zbt78 updated
2 weeks ago
-
In our paper we only showed results on causal language models, which use causally masked (decoder) self-attention.
If you'd like to use ALiBi for seq2seq tasks such as translation, speech or T5, o…
-
### 🐛 Describe the bug
Functions [`torch.nn.functional.relu`](https://github.com/pytorch/pytorch/blob/main/torch/nn/functional.py#L1693) and [`torch.nn.functional.multi_head_attention_forward`](https…