search

olegchomp / TouchDiffusion

TouchDesigner implementation for real-time Stable Diffusion interactive generation with StreamDiffusion.
85 stars 2 forks source link

Stuck installing TensorRT #4

Closed elekktronaut closed 1 day ago

elekktronaut commented 2 weeks ago

Installing worked well until here:

Installing TensorRT requirements... <module 'tensorrt' from 'D:\TOUCHDESIGNER\External\olegchomp\TouchDiffusion-main\.venv\Lib\site-packages\tensorrt\init.py'>

Nothing seems to happen. I've tried restarting but that doesn't help :/

virusvjvisuals commented 2 weeks ago

same for me, :<module 'tensorrt' from 'D:\TOUCHDESIGNER\External\olegchomp\TouchDiffusion-main.venv\Lib\site-packages\tensorrt\init.py'> , but having a look to the webui, it says that it s all done and that you need to restart webui.bat to apply changes... I tried 3 times relaunching having the same result, even now doing a complete reinstall from scratch.. Is there a way to check about the completion of the process ? (just a detail : I did a model conversion and got a "TensorRT acceleration enabled" in the end of the model conversion, so hope this works !! ^^)

elekktronaut commented 2 weeks ago

It actually still works :) Running with 17 FPS on my 2070 laptop!! Edit: Okay more like 7 FPS

olegchomp commented 2 weeks ago

It actually still works :) Running with 17 FPS on my 2070 laptop!!

Edit: Okay more like 7 FPS

In webui it show pure speed without preprocessing images. It should be slower, for few FPS, but not 10 I think. Might be throttling?

olegchomp commented 2 weeks ago

same for me,

:<module 'tensorrt' from 'D:\TOUCHDESIGNER\External\olegchomp\TouchDiffusion-main.venv\Lib\site-packages\tensorrt\init.py'> , but having a look to the webui, it says that it s all done and that you need to restart webui.bat to apply changes...

I tried 3 times relaunching having the same result, even now doing a complete reinstall from scratch..

Is there a way to check about the completion of the process ?

(just a detail : I did a model conversion and got a "TensorRT acceleration enabled" in the end of the model conversion, so hope this works !! ^^)

Yes, if engine created, mostly means that everything should work in TD

olegchomp commented 2 weeks ago

It actually still works :) Running with 17 FPS on my 2070 laptop!!

Edit: Okay more like 7 FPS

Updated benchmarks with 3060 12G and 16 FPS. I think 2070 should be close this values also, so might be something with hardware or throttling.

superlotek commented 1 week ago

I keep getting stuck on installing TensorRT as well. Getting this error when I try to Update Dependencies: Error installing packages: torch==2.1.0, onnx==1.15.0, onnxruntime==1.16.3, Failed to install TensorRT

Issue Solved! I was running Python 3.12 thinking it would work. Apparently not. So installing 3.11 fixed the issue!