search

bytedance / flux

A fast communication-overlapping library for tensor parallelism on GPUs.
Apache License 2.0
223 stars 17 forks source link

[ENHANCEMENT] 你好，fp8有计划支持吗 #48

Open zkyue opened 4 days ago

wenlei-bao commented 3 days ago

@zkyue Yes, fp8 support is on the way. And we will release it in future.

zkyue commented 3 days ago

@zkyue Yes, fp8 support is on the way. And we will release it in future.

Thank you for your reply. I am now looking to apply Flux in my project to perform FP8 GEMM on the H100. What work still needs to be done with Flux at the moment? Is it just a matter of adding a data type like supporting FP16, or are there some underlying tasks that need to be addressed? How is the progress of your project, and when can we expect the next version to be released?