search

pytorch / torchx

TorchX is a universal job launcher for PyTorch applications. TorchX is designed to have fast iteration time for training/research and support for E2E production ML pipelines when you're ready.
https://pytorch.org/torchx
Other
306 stars 99 forks source link

Migrate components-integration-tests to Terraform #892

Closed yikaiMeta closed 1 month ago

yikaiMeta commented 1 month ago

In this PR, all the AWS resources that components-integration-tests are using will be from Terraform. The IAM role is migrated to TF version. The ECR is migrated to the container registry in US-west-1, in which all resources are from Terraform. The kubernetes scheduler in this test is using a minicube, which doesn't require AWS EKS. So I deleted the EKS setup.

Test plan: Components Integration Tests can pass.

facebook-github-bot commented 1 month ago

@yikaiMeta has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

manav-a commented 1 month ago

Just for my understanding just changing the terraform here runs the CI with the change?

yikaiMeta commented 1 month ago

Just for my understanding just changing the terraform here runs the CI with the change?

yes that's correct.