Feature request for `nn_transformer_encoder`, `nn_transformer_encoder_layer`, `nn_transformer_decoder`, and `nn_transformer_decoder_layer`

mlverse / torch

R Interface to Torch

https://torch.mlverse.org

Other

498 stars 68 forks source link

Open MaximilianPi opened 2 weeks ago

MaximilianPi commented 2 weeks ago

It would be nice to have the transformer objects in Torch.

Actually, I have already implemented most of them (by translating the pytorch code https://github.com/pytorch/pytorch/blob/main/torch/nn/modules/transformer.py ), so I could do a PR if you want.

cregouby commented 1 week ago

Hello @MaximilianPi Please do !