Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Source MySQL: stress test 1000 tables / columns per sync #7489

Closed
2 tasks
Tracked by #7035
alexandr-shegeda opened this issue Oct 29, 2021 · 0 comments · Fixed by #7820
Closed
2 tasks
Tracked by #7035

Source MySQL: stress test 1000 tables / columns per sync #7489

alexandr-shegeda opened this issue Oct 29, 2021 · 0 comments · Fixed by #7820

Comments

@alexandr-shegeda
Copy link
Contributor

alexandr-shegeda commented Oct 29, 2021

Tell us about the problem you're trying to solve

As part of making our databases more reliable, we should start working on a test suite containing benchmarks for validating that our DB connectors are able to serve certain workloads/scales.

The idea is that today, we see a lot of issues around DB replication that we cannot reproduce (doc containing example of problems) so we want to create a test harness specifically for reproducing this style of test.

Describe the solution you’d like

  • Create Gradle sub-project to run stress test independently
  • Create stress test including 1000 streams & 1000 columns

Note: test infrastructure should not depend on MySQL connector

Describe the alternative you’ve considered or used

A clear and concise description of any alternative solutions or features you've considered or are using today.

Additional context

The solution should be based on the described issue

Are you willing to submit a PR?

Yes

@sherifnada sherifnada changed the title Source MySQL: increase DB connector reliability Source MySQL: stress test 1000 tables / columns per sync Nov 1, 2021
@tuliren tuliren added this to the Database 2021-11-15 milestone Nov 9, 2021
@etsybaev etsybaev linked a pull request Nov 10, 2021 that will close this issue
40 tasks
@sherifnada sherifnada added the area/connectors Connector related issues label Nov 15, 2021
@sherifnada sherifnada moved this to Done in GL Roadmap Jan 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
No open projects
Archived in project
Development

Successfully merging a pull request may close this issue.

6 participants