[REVIEW] End to End triton example

rapidsai / rapids-examples

33 stars 24 forks source link

Closed VibhuJawa closed 3 years ago

VibhuJawa commented 3 years ago

This PR adds an end to end example of using Triton with rapids and pytorch for BERT inference.

Todo:

[x] Upload model wights to a public bucket (Waiting on https://github.com/rapidsai/ops/issues/1772)
[x] Load model wights into the model

CC: @vinaybagade

review-notebook-app[bot] commented 3 years ago

Check out this pull request on

See visual diffs & provide feedback on Jupyter Notebooks.

Powered by ReviewNB

vinaybagade commented 3 years ago

Looks good to me. Tried it on my end with NVAIE containers.