Slower execution when compared with Pytorch 2.1.2 + CU 11.8 + xformers 0.0.23.post1

kijai / ComfyUI-Florence2

Inference Microsoft Florence2 VLM

MIT License

768 stars 51 forks source link

Slower execution when compared with Pytorch 2.1.2 + CU 11.8 + xformers 0.0.23.post1 #92

Closed Orenji-Tangerine closed 1 week ago

Orenji-Tangerine commented 3 weeks ago

I just updated my environment to 2.5.0 + CU 12.4 + xformers 0.0.28.post2, and it seems that it is slower and if I have a few images to loads, it will stop for a while before processing next image (at Florence2Run node). In the past, processing 10 images took about 40 secs now it needs 100 secs. Are there anything I can do to speed up?

Orenji-Tangerine commented 1 week ago

Issue gone after updating to Pytorch 2.5.1 + CU 12.4 (xformers 0.0.28.post3)