allegroai / clearml-serving

ClearML - Model-Serving Orchestration and Repository Solution
https://clear.ml
Apache License 2.0
138 stars 40 forks source link

Await async Triton process #55

Closed amirhmk closed 1 year ago

amirhmk commented 1 year ago

While experimenting with overriding the process() function for a Triton engine, noticed that the results are not getting resolved correctly, and getting the following warning:

RuntimeWarning: coroutine 'Preprocess.process' was never awaited

After which we noticed that there is a await missing...