Build failure with 0.12pre: cannot find libnvinfer_builder_resource_win.so.10.2.0

replicate / cog-triton

A cog implementation of Nvidia's Triton server

Apache License 2.0

11 stars 0 forks source link

Build failure with 0.12pre: cannot find libnvinfer_builder_resource_win.so.10.2.0 #51

Closed joehoover closed 3 months ago

joehoover commented 3 months ago

Builds (e.g. here) are failing on yorickvp/trtllm-0.12pre with:

[07/25/2024-13:52:57] [TRT] [E] IBuilder::buildSerializedNetwork: Error Code 6: API Usage Error (Unable to load library: libnvinfer_builder_resource_win.so.10.2.0: libnvinfer_builder_resource_win.so.10.2.0: cannot open shared object file: No such file or directory)

Slack thread for context.

yorickvP commented 3 months ago

The upstream TRT package didn't have that file. Fixed by upgrading to 10.2.0.post1