Open Dewei-Wang-sh opened 2 months ago
when we enable flash attention, hard to debug if the result can not match. so we'd like to add print for easy debug process.
Closing as per @etiotto's feedback.
@vlad-penkin @etiotto any reason to close this? advanced path need this to help debug result data mismatch?
when we enable flash attention, hard to debug if the result can not match. so we'd like to add print for easy debug process.