Adding Triton to Forge with CUDA 12.4 + Pytorch 2.4?

lllyasviel / stable-diffusion-webui-forge

GNU Affero General Public License v3.0

8.61k stars 850 forks source link

Open Telllinex opened 1 month ago

Telllinex commented 1 month ago

https://github.com/woct0rdho/triton-windows https://www.reddit.com/r/StableDiffusion/comments/1g45n6n/comment/ls2vt3p/ Increases speed in ComfyUI already and in Forge(custom installed) But using CUDA 12.4 + Pytorch 2.4 package doesn't even shows that triton is missing

jswag245 commented 1 month ago

Would love to see this integration, looks like there is a discussion on it already as well. #2077