Can NNfusion fuse cudnn's kernel?

microsoft / nnfusion

A flexible and efficient deep neural network (DNN) compiler that generates high-performance executable from a DNN model description.

MIT License

937 stars 157 forks source link

Can NNfusion fuse cudnn's kernel? #505

Open five12 opened 1 year ago

five12 commented 1 year ago

I briefly ran the example provided by NNfusion (many thanks to NNfusion for the detailed tutorial)

I noticed that the generated cuda file calls the kernel of cudnn. i have a question, is it possible to control the grid size and block size of the kernel in cudnn ? could NNfusion fuse the kernel of cudnn?

I would appreciate your reply!