-
In each iteration, the state of the `self.q_deivce` will be changed. Why is the changed `self.q_device` in the previous iteration used in the next iteration here?
```
class QuanvolutionFilter(tq.Qua…
-
Please refer [this tutorial](https://github.com/pytorch/tutorials/blob/master/beginner_source/transformer_tutorial.py).
I'm not sure that the function `batchify` is correct.
```python3
impo…
-
Nice work! In the paper I saw this batched result:
But examples like https://github.com/Infini-AI-Lab/TriForce/blob/main/test/on_chip.py only use batch size=1. Does the code supports batched sp…
-
The default setting is to use the bidirectional data, attn_type='bi', but bsz=1.
But in this function,
https://github.com/graykode/xlnet-Pytorch/blob/cb793a1c75bdc59e3360f04ec641af726719811f/xlnet.p…
-
### 🐛 Describe the bug
![Screenshot 2023-04-20 at 16-17-53 onnx](https://user-images.githubusercontent.com/32585434/233304748-e8b05678-c59c-4406-9f18-32047aa4321b.png)
### 🐛 Describe the bug
wh…
-
Seems VLIDA_BSZ should be replaced with VALID_BSZ in a couple places. For example:
https://github.com/kimiyoung/transformer-xl/blob/e619492d7168d55ed14e443af5e56b9599ee469d/tf/scripts/wt103_large_t…
-
Hi,
Thanks for your good work!
Can you clarify what is learning rate,bsz and epochs for baseline LoRA experiments among different datasets
Kind regards,
Jason
-
Hello, thank you for a great project!
I am getting this error when using ALiBi or RoPe positional encoding in a tranformer NMT model from OpenNMT-py:
KeyError: 'encoder.embeddings.make_embedding…
-
Currently base RNN class/functions are hard to extend. If someone would like to extend LSTM with new features to pytorch they would have to modify:
AutogradRNN ([nn/_functions/rnn.py](https://github.…
-
### 🐛 Describe the bug
I am having serious doubt on the 1.13 Adam(fused=true) implementation.
First it should be faster than fused=False, in our case it is not, but also the numerical seems off.
…