Method 1:circleci local execute --job orb-tools/review
Why this wont work:
The review job utilizes the save_test_results step which isnt supported locally and will cause the job to fail
Step failed
====>> Uploading test results
Archiving the following test results
* /tmp/orb_dev_kit/review/review.xml
Error: Failed uploading test results
Error not supported
Method 2:bats ./src/scripts/review.bats
Why this wont work:
The review.bats script is local to the orb-tools orb and will not be present in the local files of another orb without cloning it down first.
Expected behavior:
Ideally, it would be possible to run the circleci local execute job locally, though we would need a way to retrieve and then ideally view the JUNIT output.
Better output can be achieved locally by not exporting to JUNIT, but we would need the user to have bats installed and the review script locally.
Orb version:
11+
What happened:
Method 1:
circleci local execute --job orb-tools/reviewWhy this wont work: The review job utilizes the
save_test_resultsstep which isnt supported locally and will cause the job to failMethod 2:
bats ./src/scripts/review.batsWhy this wont work: The
review.batsscript is local to the orb-tools orb and will not be present in the local files of another orb without cloning it down first.Expected behavior:
Ideally, it would be possible to run the
circleci local executejob locally, though we would need a way to retrieve and then ideally view the JUNIT output.Better output can be achieved locally by not exporting to JUNIT, but we would need the user to have
batsinstalled and thereviewscript locally.Other:
https://github.com/CircleCI-Public/circleci-cli/issues/684