pytorch / test-infra

This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic to track disabled tests and slow tests, as well as our continuation integration jobs HUD/dashboard.
https://hud.pytorch.org/
Other
83 stars 83 forks source link

Upload benchmark results in v3 schema to ossci-benchmarks S3 bucket #5845

Closed huydhn closed 1 month ago

huydhn commented 1 month ago

After https://github.com/pytorch/test-infra/pull/5839, it's time to upload the GHA to upload to S3. I'll update the S3 lambda replicator in a separate PR.

Testing

We use only S3 for v3 schema

$python upload_benchmark_results.py --benchmark-results-dir benchmark-results-dir-for-testing/v3 --schema-version v3 INFO:root:Upload benchmark-results-dir-for-testing/v3/mock.json to s3://ossci-benchmarks/v3/pytorch/pytorch/1/1/mock.json



* CI
    * v2 https://github.com/pytorch/test-infra/actions/runs/11606273442/job/32318017857?pr=5845#step:4:55
    * v3 https://github.com/pytorch/test-infra/actions/runs/11606273442/job/32318017857?pr=5845#step:5:43 

* Test PR on ExecuTorch to use the new version https://github.com/pytorch/executorch/actions/runs/11606339159 to see that the files are uploaded to S3 https://github.com/pytorch/executorch/actions/runs/11606339159/job/32318826449#step:8:87 
vercel[bot] commented 1 month ago

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Skipped Deployment | Name | Status | Preview | Comments | Updated (UTC) | | :--- | :----- | :------ | :------- | :------ | | **torchci** | ⬜️ Ignored ([Inspect](https://vercel.com/fbopensource/torchci/2RTLstL9CjtXadSbS2fTbiCNrvtA)) | [Visit Preview](https://torchci-git-upload-benchmark-results-s3-fbopensource.vercel.app) | | Oct 31, 2024 4:47am |