Arm backend: Provide more debug info for numerical diff issues

freddan80 commented 1 month ago

Save torch reference output
Print useful debug info
Print path to debug artifacts

pytorch-bot[bot] commented 1 month ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/3596

:page_facing_up: Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

:x: 1 New Failure

As of commit f059e477db0e8601d6484b95cf54ef4c015c8eb4 with merge base 400860066c9806af0361fdd634a7cd5bffb6cda0 ():

NEW FAILURE - The following job has failed:

* [trunk / test-coreml-delegate / macos-job](https://hud.pytorch.org/pr/pytorch/executorch/3596#25106770982) ([gh](https://github.com/pytorch/executorch/actions/runs/9130260560/job/25106770982)) `RuntimeError: Command bash /Users/runner/work/_temp/exec_script failed with exit code 1`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

freddan80 commented 4 weeks ago

Failing tests not related to this PR. Ready to merge.

facebook-github-bot commented 3 weeks ago

@digantdesai has imported this pull request. If you are a Meta employee, you can view this diff on Phabricator.

mergennachin commented 3 weeks ago

@freddan80 have you seen this?

https://pytorch.org/executorch/main/sdk-bundled-io.html

Instead of saving the reference output as a ad-hoc file, we provide utility function to make the testing easier.

facebook-github-bot commented 3 weeks ago

@digantdesai merged this pull request in pytorch/executorch@bc5ba991b2356e3f2983b1d2b29a2a3b90b54f89.

pytorch / executorch