search

NetEase-FuXi / EETQ

Easy and Efficient Quantization for Transformers
Apache License 2.0
174 stars 14 forks source link

Supports H100 #12

Closed mwbyeon closed 2 months ago

mwbyeon commented 6 months ago

Do you have plans to support the H100(sm90)?

https://github.com/NetEase-FuXi/EETQ/blob/1657b1504faa359e2ce0ac02999439d7ac8c74c0/csrc/cutlass_kernels/cutlass_preprocessors.cc#L113-L128

SidaZh commented 6 months ago

@mwbyeon Thank you for your concern. We have no plans yet, but contributions to the community are very welcome.