search

microsoft / onnxscript

ONNX Script enables developers to naturally author ONNX functions and models using a subset of Python.
https://onnxscript.ai/
MIT License
285 stars 54 forks source link

[torchlib] Some ReduceMax axis is null #1848

Closed justinchuby closed 2 months ago

justinchuby commented 2 months ago

/opt/conda/envs/ptca/bin/python -m bash_bench.bash_bench_huggingface --repeat 30 --warmup 10 --model MT5ForConditionalGeneration --exporter onnx_dynamo --device cuda --dynamic 0 --target_opset 18 --verbose 1 --opt_patterns "" --dump_folder /opt/onnx_benchmark/.onnx_models --quiet 1 --start 0 --dtype float16 --output_data "" --memory_peak 1 --nvtx 0 --dump_ort 0 --split_process 0 --part "" --tag "" --timeout 900

image

https://artprodcus3.artifacts.visualstudio.com/Abc038106-a83b-4dab-9dd3-5a41bc58f34c/04e34684-2e55-4d0f-858e-70a8fbfd3eca/_apis/artifact/cGlwZWxpbmVhcnRpZmFjdDovL2FpaW5mcmEvcHJvamVjdElkLzA0ZTM0Njg0LTJlNTUtNGQwZi04NThlLTcwYThmYmZkM2VjYS9idWlsZElkLzU0NjY3My9hcnRpZmFjdE5hbWUvb25ueF9tb2RlbHNfb25ueF9keW5hbW9faHVnZ2luZ2ZhY2U1/content?format=file&subPath=%2FMT5ForConditionalGeneration-onnx_dynamo-cuda-torch.float16%2Fmodel.onnx

justinchuby commented 2 months ago

Check the node metadata to locate the op.