aws / aws-toolkit-vscode

Amazon Q, CodeCatalyst, Local Lambda debug, SAM/CFN syntax, ECS Terminal, AWS resources
https://marketplace.visualstudio.com/items?itemName=AmazonWebServices.amazon-q-vscode
Apache License 2.0
1.51k stars 436 forks source link

ci(core): Seperate setup, execution, and verification of performance tests #5540

Closed jpinkney-aws closed 1 month ago

jpinkney-aws commented 2 months ago

Problem

We are currently running performance tests without waiting for the cpu to recover. This could be part of the reason why our tests could be flaky.

These were suggestions made by George on Friday

Solution

Wait until the the cpu usage is at a reasonable (determined using previous test runs) starting cpu usage before continuing on with the tests


License: I confirm that my contribution is made under the terms of the Apache 2.0 license.

github-actions[bot] commented 2 months ago

This pull request modifies files in src/ but no tests were added/updated. Confirm whether tests should be added or ensure the PR description explains why tests are not required.

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests

jpinkney-aws commented 2 months ago

/runIntegrationTests