search

hashgraph / hedera-services

Crypto, token, consensus, file, and smart contract services for the Hedera public ledger
Apache License 2.0
281 stars 124 forks source link

Execute E2E tests on every deploy #3816

Open steven-sheehy opened 2 years ago

steven-sheehy commented 2 years ago

Problem

There are an exhaustive set of end to end test suites that run in CI, but these tests are not used to verify actual deployments.

Solution

Run the full E2E/EET test suites on every deploy to non-mainnet environments. Some tests change system properties that might cause things to break, so they might have to be omitted until they can be adjusted to behave more like standard transactions. A smaller subset of tests could be used to validate mainnet.

Alternatives

No response

nathanklick commented 2 years ago

@steven-sheehy To clarify, are you referring to the E2E/EET tests we run as part of the nightly JRS CI panel or the set of tests we run as part of EET/Integration test suites in each and every PR?

steven-sheehy commented 2 years ago

The latter. Since they target a HAPI server by IP they can be reused as acceptance tests.