search

tensorflow / tensorrt

TensorFlow/TensorRT integration
Apache License 2.0
736 stars 226 forks source link

Error in TensorRT conversion of e5-large model #339

Open ndeep27 opened 4 months ago

ndeep27 commented 4 months ago

I am trying to convert the open source e5-large TF model to TensorRT. This is the model - https://huggingface.co/intfloat/multilingual-e5-large. I am getting below error

[libprotobuf FATAL external/com_google_protobuf/src/google/protobuf/stubs/stringpiece.cc:50] size too big: 18446744071659921560 details: string length exceeds max size

I also tried disabling the graph freezing by setting env var - TF_TRT_EXPERIMENTAL_FEATURES=disable_graph_freezing but I get below error for that

RuntimeError: Not found in the function captures: unknown_390:0

Any pointers on how can I resolve above?

ndeep27 commented 4 months ago

@DEKHTIARJonathan Can you please help with above?