Hipify operators with cuda implementation && no other dependencies and validate.

[petrex]

Total number of operators - 210

CUDA operators - 77 (some of underlying dependency on CUB/Thrust) cuDNN operators - 11

Tasks includes but not limited to :

• [ ] hipify ops with cuda implementation (77 total)

• [ ] write python tests to validate the hip ops

[petrex]

hipify script-- caffe2 flavor https://github.com/petrex/HIP/blob/master/bin/hipify-perl

[petrex]

We will do cross-validation. ( eg. AF hipify some ops; PY write the tests and vice versa)

[dagamayank]

CPU operators are working on AMD.

CUDA operators -

• We know the process .. now matter of implementation and testing.
• Not all the operators have tests; need to implement our own.

[petrex]

refer to #22 Note this is a WIP.

[petrex]

Landing Zone:

• [ ] Must Have: Validate Ops (passing on AMD platform )with test bundle from upstream.

• [ ] Nice to Have: New tests for hipified ops.

[petrex]

status: https://docs.google.com/spreadsheets/d/1qJlCWfnIrEyCUQy7XsxsD0bMiCh_CKpPdA8tYUOxLsk/edit#gid=0