fetchai / agents-aea

A framework for autonomous economic agent (AEA) development
https://docs.fetch.ai/aea/
Apache License 2.0
203 stars 62 forks source link

refactor: rearrange tests #2810

Closed solarw closed 1 year ago

solarw commented 1 year ago

Proposed changes

Rearrange tests into two categories, those run in every PR and those run on release PRs to speedup CI.

Fixes

If it fixes a bug or resolves a feature request, be sure to link to that issue.

Types of changes

What types of changes does your code introduce to agents-aea? Put an x in the boxes that apply

Checklist

Put an x in the boxes that apply.

codecov-commenter commented 1 year ago

Codecov Report

Merging #2810 (b54b81c) into develop (ef04074) will increase coverage by 0.78%. The diff coverage is 100.00%.

:exclamation: Current head b54b81c differs from pull request most recent head f716092. Consider uploading reports for the commit f716092 to get more accurate results

@@             Coverage Diff             @@
##           develop    #2810      +/-   ##
===========================================
+ Coverage    97.88%   98.67%   +0.78%     
===========================================
  Files          506      212     -294     
  Lines        36146    18598   -17548     
===========================================
- Hits         35382    18351   -17031     
+ Misses         764      247     -517     
Flag Coverage Δ
unittests 98.67% <100.00%> (+0.78%) :arrow_up:

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
aea/agent.py 100.00% <ø> (ø)
aea/crypto/registries/base.py 100.00% <ø> (ø)
aea/helpers/async_utils.py 100.00% <ø> (ø)
aea/helpers/install_dependency.py 100.00% <ø> (ø)
aea/helpers/transaction/base.py 100.00% <ø> (ø)
aea/launcher.py 100.00% <ø> (ø)
aea/runtime.py 98.20% <ø> (ø)
aea/__version__.py 100.00% <100.00%> (ø)
aea/abstract_agent.py 100.00% <100.00%> (ø)
aea/aea_builder.py 100.00% <100.00%> (ø)
... and 375 more

Help us with your feedback. Take ten seconds to tell us how you rate us. Have a feature suggestion? Share it here.

5A11 commented 1 year ago

The current breakdown of the tests seems to be the following:

Integ/uni Job name Release only? Folders Markers Requirements
Unit+Integ Core Integration Checks no tests/test_aea_core_packages/ Ubuntu, py3.8
Unit aea-core-tests no ./tests/test_docs ./tests/test_aea not integration, not unstable, not ledger Matrix
Unit aea-extras-tests no ./tests/test_aea_extra Matrix
Integ Integration Checks yes ./tests integration, not unstable, not ledger Ubuntu, py3.8
Integ integration_checks_ledger yes ./tests integration, not unstable, ledger Ubuntu, py3.8
Unit packages-tests yes ./tests/test_packages_for_aea_tests ./tests/test_packages not integration and not unstable Matrix
5A11 commented 1 year ago

Also please change the trigger from on push to develop and main and pull request to just on pull request