mindspore-lab / mindone

one for all, Optimal generator with No Exception
Apache License 2.0
329 stars 63 forks source link

add memory_efficient_attention #463

Closed CaitinZhao closed 1 month ago

CaitinZhao commented 2 months ago

What does this PR do?

benchmarking xformer memory_efficient_attention implementation

Fixes # (issue)

Adds # (feature)

Before submitting

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.

@xxx

geniuspatrick commented 1 month ago

xformers-like memory efficient attention is supported in #491, closing the pr.