-
Notifications
You must be signed in to change notification settings - Fork 466
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
storage/mysql: Replace enable_mysql_source with max_mysql_connections var #27847
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
I triggered nightly just in case this has some weird side effects with upgrades: https://buildkite.com/materialize/nightly/builds/8207
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
There is a bunch of failures in nightly, but they should all be fixable by bumping the limit. Ping me if you want me to fix those errors as part of this PR.
@@ -432,6 +432,13 @@ pub static MAX_POSTGRES_CONNECTIONS: VarDefinition = VarDefinition::new( | |||
false, | |||
); | |||
|
|||
pub static MAX_MYSQL_CONNECTIONS: VarDefinition = VarDefinition::new( | |||
"max_mysql_connections", | |||
value!(u32; 0), |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Your life will probably be much easier if you default this to 1000, and then use LD in production to set it back to 0 by default for production environments.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
ah great idea - will do
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
sounds good, set up the LD flag in prod to do so https://app.launchdarkly.com/projects/default/flags/max_mysql_connections/targeting?env=production&env=staging&env=development&env=loadtest&env=ci-cd&selected-env=production
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Awesome, thank you, Roshan!
cff8c90
to
93ec7b8
Compare
93ec7b8
to
01339f5
Compare
Motivation
Parity with other source types, and the ability to query this variable from the Console (via SQL). See https://materializeinc.slack.com/archives/C01CFKM1QRF/p1715228421858309?thread_ts=1715209780.830859&cid=C01CFKM1QRF for more context
Tips for reviewer
Checklist
$T ⇔ Proto$T
mapping (possibly in a backwards-incompatible way), then it is tagged with aT-proto
label.