search

alibaba / BladeDISC

BladeDISC is an end-to-end DynamIc Shape Compiler project for machine learning workloads.
Apache License 2.0
803 stars 160 forks source link

cuda graph and multi-stream support #1271

Closed zhyncs closed 8 months ago

zhyncs commented 9 months ago

Hi BladeDISC genius. To clarify, I would like to inquire about your plans to incorporate support for cuda graph and multi-stream options in the technology roadmap of tf -> onnx -> trt. Thanks.

zhyncs commented 8 months ago

Due to no response for too long, this issue has been closed. I heard that your team is focusing on developing BladeLLM, and there will be an open source plan soon. May you tell me when it is expected to be open source? Cheers.

qiuxiafei commented 8 months ago

Sorry, there's no exact play about that, at this moment.