cosmos / interchain-security

Interchain Security is an open sourced IBC application which allows cosmos blockchains to lease their proof-of-stake security to one another.
https://cosmos.github.io/interchain-security/
Other
154 stars 124 forks source link

EPIC: Refactor existing e2e testing framework #877

Open MSalopek opened 1 year ago

MSalopek commented 1 year ago

Problem

ICS e2e testing uses a long bash script to initialize the testing environment.

Although there is nothing wrong with using bash scripts they quickly become poorly maintained due to their imperative and verbose nature.

Besides that, in the current setup it is difficult to achieve the following:

  1. using arbitrary provider and consumer chains
  2. configuring multi-consumer setups
  3. getting comprehensive and understandable test output
  4. import the e2e testing framework into both provider and consumer chain repositories
  5. run in the CI

Closing criteria

At minimum the new test initialization should become declarative and allow easier running in the CI and allow arbitrary chain binaries to be used.

Related:

mpoke commented 4 months ago

@MSalopek Is this EPIC still needed?