microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator
https://onnxruntime.ai
MIT License
14.65k stars 2.93k forks source link

failing to find trt_timing_cache_path #21484

Open darthmalak1986 opened 3 months ago

darthmalak1986 commented 3 months ago

hello im trying to use tensorrt and when looking for the trt path cache, while processing.

is giving me this error

Error D:\a_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:709 onnxruntime::python::CreateExecutionProviderInstance Invalid TensorRT EP option: trt_timing_cache_path when using [('TensorrtExecutionProvider', {'trt_engine_cache_enable': True, 'trt_engine_cache_path': 'tensorrt-engines', 'trt_timing_cache_enable': True, 'trt_timing_cache_path': 'tensorrt-engines', 'trt_dump_ep_context_model': True, 'trt_ep_context_file_path': 'tensorrt-engines', 'trt_layer_norm_fp32_fallback': True, 'trt_builder_optimization_level': 5}), 'CUDAExecutionProvider', 'CPUExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying.

it seems to be or that i put the wrong path or maybe i just miss typed something

can someone help me a bit please'??

chilo-ms commented 3 months ago

Which ORT version you were using? Simply from what you pasted above seems okay, but it's better if you provide the python code to help us repro the issue.

darthmalak1986 commented 3 months ago

Which ORT version you were using? Simply from what you pasted above seems okay, but it's better if you provide the python code to help us repro the issue.

idk how to check that, i only followed a guide.

if you can guide me trough it, for sure i will provide the information your requesting, for my understaing regarding the issue the "trt_cache_path" is or not specified or wrong typed.

And thats part of the configuration of onnxruntime, is what copilot said xD

but i dont know how to fix that i have been looking for a configuration file but i cant find any. So bcoz the path is not specified (probably) bcoz i only copy and paste files tensorrt is failing so is using cude - cpu

for sure the path is wrong if i could know what file is maybe i could fix it or just replace it, probably if i do will screw something else. So i rather leave it the way it is and just edit or fix what is requesting.

darthmalak1986 commented 3 months ago

Captura de pantalla (458) Captura de pantalla (459) Captura de pantalla (460)

github-actions[bot] commented 2 months ago

This issue has been automatically marked as stale due to inactivity and will be closed in 30 days if no further activity occurs. If further support is needed, please provide an update and/or more details.