aredden / torch-cublas-hgemm

PyTorch half precision gemm lib w/ fused optional bias + optional relu/gelu
25 stars 1 forks source link

Error installing #2

Closed ashakoen closed 4 weeks ago

ashakoen commented 1 month ago

Prior to seeing your note in the README on https://github.com/aredden/flux-fp8-api, I went ahead and tried to install this because it was in the requirements.txt for flux-fp8-api, but got an error on Ubuntu 22.04. I ended up having to change line 31 in cublas_ops/init.py as follows:

def get(cls, __name: str, device: torch.device) -> torch.Any:

to this:

def get(cls, __name: str, device: torch.device) -> Any:

and I had to include:

from typing import Any

I'm way out of my league here, but wanted to report it all the same. Thanks!

aredden commented 4 weeks ago

Ah thanks! I'll change this.