Make fast-transformers JIT Compilable

idiap / fast-transformers

Pytorch library for fast transformer implementations

1.65k stars 179 forks source link

Make fast-transformers JIT Compilable #88

Open AndriyMulyar opened 3 years ago

AndriyMulyar commented 3 years ago

Are their any plans to make fast-transformers modules JIT compilable (for use in torchscript/onnx compilation) Would you be open to reviewing PRs that do this?

angeloskath commented 3 years ago

Hi Andriy,

Sorry for the very late reply.

I would of course be open to reviewing PRs. I do not know what that would entail though and if a lot of architectural changes are needed then it is probably not something to be merged in master right away.

Best, Angelos