Add depthwise convolution and allow to use it in CausalAttention. - Githubissues

google / trax

Trax — Deep Learning with Clear Code and Speed

Apache License 2.0

8.07k stars 813 forks source link

Add depthwise convolution and allow to use it in CausalAttention. #1700

Closed lukaszkaiser closed 2 years ago

lukaszkaiser commented 3 years ago

Inspired by a recent paper from Google :).