search

mlcommons / inference_results_v2.0

This repository contains the results and code for the MLPerf™ Inference v2.0 benchmark.
https://mlcommons.org/en/inference-datacenter-20/
Apache License 2.0
9 stars 12 forks source link

Graph visualizer in RNNT #15

Closed mahmoodn closed 1 year ago

mahmoodn commented 1 year ago

Hi Is it possible to disable the graph visualizer in RNNT in Nvidia implementation?

nv-ananjappa commented 1 year ago

@nvzhihanj Is this possible?

nvzhihanj commented 1 year ago

@mahmoodn I am not sure if I understand your request. Which graph visualizer are you talking about?

mahmoodn commented 1 year ago

Let me state the problem in this way. I want to use NVBit for RNNT but as described here, it faces an error which is due to the cudaStreamBeginCapture() used in the RNNT code in makeDecoderGraph().

I don't know about the internals of that function, but I guess that is related to creating a graph. So, I want to know if there is a way to bypass that by disabling graph related things.

nvzhihanj commented 1 year ago

You can turn off the graph by specifying "--use_graph=False" in the config or command line.