FX based conv2d/bn fuser

pytorch / nestedtensor

[Prototype] Tools for the concurrent manipulation of variably sized Tensors.

BSD 3-Clause "New" or "Revised" License

252 stars 28 forks source link

Closed cpuhrsch closed 3 years ago

cpuhrsch commented 3 years ago

Preliminary brittle prototype. Based on https://github.com/pytorch/pytorch/pull/47657 . Only shows gains on fp16 if using at least cudnn 8.2.