search

chrisgoringe / cg-image-picker

198 stars 13 forks source link

FP8 Support Error #73

Closed Daryl-Horton closed 6 months ago

Daryl-Horton commented 6 months ago

Any support for FP8 being planned? I get an error when attempting to use FP8:

"log_cuda" not implemented for 'Float8_e4m3fn' [FABRIC] Encountered an exception. If this is not a memory issue, please report this issue. [FABRIC] 0: weights b: 2, weights nk: 27648, nq: 77, nk: 77, h: 8, bs: 1 ERROR:root:!!! Exception during processing !!!

Thanks.

Daryl-Horton commented 6 months ago

placed in the wrong repo.