search

hidet-org / hidet

An open-source efficient deep learning framework/compiler, written in python.
https://hidet.org
Apache License 2.0
634 stars 50 forks source link

[cuDNN] Add cudnn conv2d #435

Closed yudi0201 closed 2 weeks ago

vadiklyutiy commented 4 months ago

@yaoyaoding A little bit different but connected question. Are we planing to include conv2d_cudnn to search space? I mean we can search via our current space + cudnn implementation. Is it doable at all (wo huge redesign)?

yaoyaoding commented 4 months ago

It's doable, similar to cublas gemm: https://github.com/hidet-org/hidet/commit/072a606111435b2fb46678577f291f4a4ac91d5c

vadiklyutiy commented 4 months ago

What about adding cudnn, cublas etc to search space?

yaoyaoding commented 4 months ago

What about adding cudnn, cublas etc to search space?

That's exactly what the commint I mentioned before does.

destefy commented 1 month ago

If cuDNN needs to be installed, could it be added to the README? It doesn't seem to be included in CUDA Toolkit: link

yaoyaoding commented 1 month ago

If cuDNN needs to be installed, could it be added to the README? It doesn't seem to be included in CUDA Toolkit: link

We can add the nvidia-cudnn-cu12 to our dependency in setup.py like what pytorch does (#1 #2) and the pypi package.

yaoyaoding commented 1 month ago

Similar like other package like cublas.

yaoyaoding commented 3 weeks ago

Hi @c-fteixeira, the ci seems can not initialize the vm for test, could you help us to take a look? thank you!