Songyuanwei commented 5 months ago

What does this PR do?

Update the benchmark for sd inference.

Use inference/sd_infer.py to test performance.

Before submitting

[x] This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
[ ] Did you read the contributor guideline?
[ ] Did you make sure to update the documentation with your changes? E.g. record bug fixes or new features in What's New. Here are the documentation guidelines
[ ] Did you build and run the code without any errors?
[ ] Did you report the running environment (NPU type/MS version) and performance in the doc? (better record it for data loading, model inference, or training tasks)
[ ] Did you write any new necessary tests?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag members/contributors who may be interested in your PR.

@xxx

zhtmike commented 5 months ago

And also can try MS_PYNATIVE_GE on MS910* currently, there is a visible speed improvement

Songyuanwei commented 5 months ago

And also can try MS_PYNATIVE_GE on MS910* currently, there is a visible speed improvement

No improvement for sdv2