Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Ecosystem XCM regression tests #3097

Open
xlc opened this issue Jan 29, 2024 · 4 comments
Open

Ecosystem XCM regression tests #3097

xlc opened this issue Jan 29, 2024 · 4 comments
Assignees
@x3c41a
Labels
C1-mentor A task where a mentor is available. Please indicate in the issue who the mentor could be. C2-good-first-issue A task for a first time contributor to become familiar with the Polkadot-SDK. I5-enhancement An additional feature request. T6-XCM This PR/Issue is related to XCM. T10-tests This PR/Issue is related to tests.

Comments

@xlc
Copy link
Contributor

xlc commented Jan 29, 2024

We had too many breaking XCM changes / bugs.
To ensure good compatibility with existing XCM usages, we should have a regression tests suite.

Steps:

  • Create a script to collect top 20 unique XCM from live onchain data
  • For each usage, write a test for it, could be using xcm-simulator or emulator or chopsticks
  • Include the tests in CI
  • Rerun the script every 3 months to identify if we have new type of XCM usage and write test for it
@acatangiu acatangiu added T6-XCM This PR/Issue is related to XCM. I5-enhancement An additional feature request. T10-tests This PR/Issue is related to tests. labels Mar 1, 2024
@ggwpez ggwpez added C1-mentor A task where a mentor is available. Please indicate in the issue who the mentor could be. C2-good-first-issue A task for a first time contributor to become familiar with the Polkadot-SDK. labels Mar 13, 2024
@bkchr
Copy link
Member

bkchr commented Mar 19, 2024

polkadot-fellows/runtimes#171 is probably the successor of this issue.

@acatangiu acatangiu moved this from Draft to Next to pick up in Parity Roadmap Mar 28, 2024
@Polkadot-Forum
Copy link

This issue has been mentioned on Polkadot Forum. There might be relevant details there:

https://forum.polkadot.network/t/polkadot-ecosystem-tests/9067/1

@rockbmb
Copy link
Contributor

rockbmb commented Sep 27, 2024

Hello all,

What's the status on this issue? Does it still make sense to pick this up?

I do not mean to be impudent; with AcalaNetwork/e2e-tests and open-web3-stack/polkadot-ecosystem-tests having good coverage, I was considering where this issue fit.

@acatangiu
Copy link
Contributor

Yes, this is still actual. https://github.com/open-web3-stack/polkadot-ecosystem-tests gives us the framework but is currently missing the actual tests. Would be great if you could start adding tests there.

@acatangiu acatangiu changed the title XCM regression tests Ecosystem XCM regression tests Oct 14, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@x3c41a x3c41a

Labels
C1-mentor A task where a mentor is available. Please indicate in the issue who the mentor could be. C2-good-first-issue A task for a first time contributor to become familiar with the Polkadot-SDK. I5-enhancement An additional feature request. T6-XCM This PR/Issue is related to XCM. T10-tests This PR/Issue is related to tests.
Projects
Bridges + XCM
Status: No status
Parity Roadmap
Status: Next to pick up
Milestone
No milestone
Development

No branches or pull requests
7 participants
@xlc @bkchr @ggwpez @rockbmb @acatangiu @Polkadot-Forum @x3c41a