Ecosystem XCM regression tests

paritytech / polkadot-sdk

The Parity Polkadot Blockchain SDK

https://polkadot.com/

1.93k stars 709 forks source link

Open xlc opened 10 months ago

xlc commented 10 months ago

We had too many breaking XCM changes / bugs. To ensure good compatibility with existing XCM usages, we should have a regression tests suite.

Steps:

Create a script to collect top 20 unique XCM from live onchain data
For each usage, write a test for it, could be using xcm-simulator or emulator or chopsticks
Include the tests in CI
Rerun the script every 3 months to identify if we have new type of XCM usage and write test for it

bkchr commented 8 months ago

Polkadot-Forum commented 4 months ago

This issue has been mentioned on Polkadot Forum. There might be relevant details there:

rockbmb commented 2 months ago

Hello all,

What's the status on this issue? Does it still make sense to pick this up?

I do not mean to be impudent; with AcalaNetwork/e2e-tests and open-web3-stack/polkadot-ecosystem-tests having good coverage, I was considering where this issue fit.

acatangiu commented 2 months ago

Yes, this is still actual. https://github.com/open-web3-stack/polkadot-ecosystem-tests gives us the framework but is currently missing the actual tests. Would be great if you could start adding tests there.