Does matmulfreellm support Windows 10?

[fangkuoyu]

I have installed matmulfreellm with Triton for Windows via triton-2.0.0-cp310-cp310-win_amd64.whl which makes matmulfreellm work on the 'configuration' file but fail on the 'generate' file. The 'generate' file with 'ridger/MMfreeLM-370M' gets some problems at model.generate. A brief of error messages are

File "C:\Users\hp\Anaconda3\envs\mat_env\lib\subprocess.py", line 1457, in _execute_child
hp, ht, pid, tid = _winapi.CreateProcess(executable, args,
FileNotFoundError:

printout executable and args are

None whereis libcuda.so

Does matmulfreellm supports Windows 10?

Some libraries are listed as follows.

torch              2.3.1+cu118
torchaudio         2.3.1+cu118
torchvision        0.18.1+cu118
transformers       4.41.2
triton             2.0.0 

[ridgerchu]

Hi, we have not tested Windows 10 yet since the server we used are all Linux... You can try to upgrade triton to 2.2.0 and cuda to 12.2 or above

[fangkuoyu]

@ridgerchu Thanks for your comments. I have upgraded to Triton 2.1.0 for Windows (triton-2.1.0-cp310-cp310-win_amd64.whl). However, the system still doesn't work. I haven't found Trion 2.2.0 for Windows yet. I will suspend my test for now. Do you have any plans to support Windows officially?

[ridgerchu]

It depends when the triton 2.2.0 for windows release I think, without 2.2.0 this repo cannot work well

[fangkuoyu]

@ridgerchu Got it. Thanks!