comfyanonymous / ComfyUI_TensorRT

MIT License
507 stars 34 forks source link

Feature request: P100/p4 support #36

Open dirkson opened 5 months ago

dirkson commented 5 months ago

Tensorrt 10 dropped support for Cuda 6/6.1, and thus for the P100 and p4. Pip has tensorrt-8.6.1.post1 available, which still has support for these older cards. However, upon installing that version and trying to run ComfyUI_TensorRT, I get the error "AttributeError: module 'tensorrt' has no attribute 'IProgressMonitor'"

My knowledge of python is pretty minimal, but I did try removing the two sections of the codebase that referenced Tensorrt 10's progress monitor features, and that did result in a module that loaded, ran, and reported successfully creating engines. However, trying to run these engines either results in black outputs or static outputs.

I tried all the workarounds specified in https://github.com/comfyanonymous/ComfyUI_TensorRT/issues/7 , but nothing affected the behavior at all. Not sure if this is a P100 problem or a more general problem with the stack.

Any chance we could add support for TensorRT 8.6.1 , and thus for the P100's/P4's?

Cheers!