search

triton-lang / triton

Development repository for the Triton language and compiler
https://triton-lang.org/
MIT License
13.3k stars 1.63k forks source link

With billion dollars you still don't support Windows and thus we can't use CogVLM V2 on Windows! #4395

Open FurkanGozukara opened 3 months ago

FurkanGozukara commented 3 months ago

There was a guy publishing pre-compiled wheels on Windows solo but he left

Meanwhile a single person can do it you are not able to!

https://github.com/triton-lang/triton/pull/2738

https://github.com/THUDM/CogVLM2/issues/169

tarunabhdutta commented 3 months ago

Running Cogvlm 2 on windows is long overdue. This compatibility is needed asap. I request the developers to kindly look into it

Rio77Shiina commented 3 months ago

I'm also on the lookout for pre-compiled wheels for Windows and found this great resource by madbuda for Triton: https://huggingface.co/madbuda/triton-windows-builds

It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

FurkanGozukara commented 3 months ago

I'm also on the lookout for pre-compiled wheels for Windows and found this great resource by madbuda for Triton: https://huggingface.co/madbuda/triton-windows-builds

It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

Thanks I also have Triton 2.1 pre-compiled wheel but need triton 3 :(

thojmr commented 3 months ago

It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

Thanks for this. I'm generating almost exactly 25% faster tokens/second now with CogVLM.

Puiching-Memory commented 2 weeks ago

I'm also on the lookout for pre-compiled wheels for Windows and found this great resource by madbuda for Triton: https://huggingface.co/madbuda/triton-windows-builds It works perfectly with my torch-2.4.0-cu121-cp311 on Windows. Thanks to him for the awesome work.

Thanks I also have Triton 2.1 pre-compiled wheel but need triton 3 :(

Hey! two days ago, I found out that the authors of the repository added version 3.0 of triton, which supports python310-312