Open ndeep27 opened 6 months ago
@singhniraj08 Can you please help with above query? I want to see if there is a way to convert a TF graph to CUDA graph for serving optimization
@ndeep27, I don't think Tensorflow serving supports CUDA graphs. We will keep this as a feature request and and I will pass this feature to owners internally for implementation. Thank you!
Does TF Serving support CUDA graphs?