Lightning-AI / lightning-Habana

Lightning support for Intel Habana accelerators.
Apache License 2.0
25 stars 8 forks source link

Change dist init order #239

Closed ankitgola005 closed 1 month ago

ankitgola005 commented 2 months ago
Before submitting - [ ] Was this discussed/agreed via a Github issue? (no need for typos and docs improvements) - [ ] Did you read the [contributor guideline](https://github.com/Lightning-AI/pytorch-lightning/blob/main/.github/CONTRIBUTING.md), Pull Request section? - [ ] Did you make sure to update the docs? - [ ] Did you write any new necessary tests?

What does this PR do?

Fixes # (issue).

PR review

Anyone in the community is free to review the PR once the tests have passed. If we didn't discuss your PR in GitHub issues there's a high chance it will not be merged.

Did you have fun?

Make sure you had fun coding 🙃

ankitgola005 commented 1 month ago

Manual validation results.

Category pytorch-lightning \ pypi   pytorch-lightning \ source   lightning \ pypi   lightning \ source  
  G1 G2 G1 G2 G1 G2 G1 G2
HPU General tests Pass Pass Pass Pass Pass Pass Pass Pass
HPU torch compile tests Pass Pass Pass Pass Pass Pass Pass Pass
HPU FSDP tests Pass Pass Pass Pass Pass Pass Pass Pass
HPU Deepspeed tests Pass Pass Pass Pass Pass Pass Pass Pass
HPU precision test Pass Pass Pass Pass Pass Pass Pass Pass
Standalone-only single card tests Pass Pass Pass Pass Pass Pass Pass Pass
Multi card(2) HPU test Pass Pass Pass Pass Pass Pass Pass Pass
FSDP PT Multi card(2) HPU test Pass Pass Pass Pass Pass Pass Pass Pass
FSDP Fabric Multi card(2) HPU test Pass Pass Pass Pass Pass Pass Pass Pass
Testing HPU examples Pass Pass Pass Pass Pass Pass Pass Pass