yuvraj108c / ComfyUI-Dwpose-Tensorrt

Ultra fast dwpose estimation inside comfyui using tensorrt
Other
20 stars 1 forks source link

IRuntime::deserializeCudaEngine: Version tag does not match. #5

Closed jelling closed 2 months ago

jelling commented 3 months ago

I followed the instructions and built the models on my GPU machine but get the following error when I try to use the node:

Loading TensorRT engine: /workspace/ComfyUI/models/tensorrt/dwpose/yolox_l.engine
[W] 'colored' module is not installed, will not use colors when logging. To enable colors, please install the 'colored' module: python3 -m pip install colored
[E] IRuntime::deserializeCudaEngine: Error Code 1: Serialization (Serialization assertion stdVersionRead == kSERIALIZATION_VERSION failed.Version tag does not match. Note: Current Version: 237, Serialized Engine Version: 239)
[!] Could not deserialize engine. See log for details.
!!! Exception during processing !!! Could not deserialize engine. See log for details.
Traceback (most recent call last):
  File "/workspace/ComfyUI/execution.py", line 330, in execute
    output_data, output_ui, has_subgraph = get_output_data(obj, input_data_all, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                                           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/execution.py", line 205, in get_output_data
    return_values = _map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True, execution_block_cb=execution_block_cb, pre_execute_cb=pre_execute_cb)
                    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/execution.py", line 182, in _map_node_over_list
    process_inputs(input_dict, i)
  File "/workspace/ComfyUI/execution.py", line 171, in process_inputs
    results.append(getattr(obj, func)(**inputs))
                   ^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/custom_nodes/ComfyUI-Dwpose-Tensorrt/__init__.py", line 28, in main
    dwpose = DWposeDetector()
             ^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/custom_nodes/ComfyUI-Dwpose-Tensorrt/dwpose/__init__.py", line 33, in __init__
    self.pose_estimation = Wholebody()
                           ^^^^^^^^^^^
  File "/workspace/ComfyUI/custom_nodes/ComfyUI-Dwpose-Tensorrt/dwpose/wholebody.py", line 16, in __init__
    self.engine.load()
  File "/workspace/ComfyUI/custom_nodes/ComfyUI-Dwpose-Tensorrt/trt_utilities.py", line 227, in load
    self.engine = engine_from_bytes(bytes_from_path(self.engine_path))
                  ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<string>", line 3, in engine_from_bytes
  File "/workspace/ComfyUI/venv/lib/python3.11/site-packages/polygraphy/backend/base/loader.py", line 40, in __call__
    return self.call_impl(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/venv/lib/python3.11/site-packages/polygraphy/util/util.py", line 710, in wrapped
    return func(*args, **kwargs)
           ^^^^^^^^^^^^^^^^^^^^^
  File "/workspace/ComfyUI/venv/lib/python3.11/site-packages/polygraphy/backend/trt/loader.py", line 665, in call_impl
    G_LOGGER.critical("Could not deserialize engine. See log for details.")
  File "/workspace/ComfyUI/venv/lib/python3.11/site-packages/polygraphy/logger/logger.py", line 605, in critical
    raise ExceptionType(message) from None
polygraphy.exception.exception.PolygraphyException: Could not deserialize engine. See log for details.

Prompt executed in 0.73 seconds
yuvraj108c commented 3 months ago

hi, this error is likely due to different tensorrt versions being used to build the engine and for inferencing. please ensure that you've only 1 version of tensorrt installed in your environment