Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

jobsprofiler: store DistSQL diagram of jobs in job info #99522

Merged
merged 1 commit into from
Mar 28, 2023

Conversation

adityamaru
Copy link
Contributor

@adityamaru adityamaru commented Mar 24, 2023

This change teaches import, cdc, backup and restore
to store their DistSQL plans in the job_info table
under a timestamped info key. The generation and writing
of the plan diagram is done asynchronously so as to not
slow down the execution of the job. A new plan will be
stored everytime the job sets up its DistSQL flow.

Release note: None
Epic: CRDB-8964
Informs: #99729

@blathers-crl
Copy link

blathers-crl bot commented Mar 24, 2023

It looks like your PR touches production code but doesn't add or edit any test code. Did you consider adding tests to your PR?

🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

@cockroach-teamcity
Copy link
Member

This change is Reviewable

@adityamaru adityamaru force-pushed the dsp-diagram branch 3 times, most recently from 1fa7638 to 07af69f Compare March 27, 2023 20:56
@adityamaru adityamaru changed the title jobs: persist the DistSQL diagram for backup in job info jobsprofiler: store DistSQL diagram of jobs in job info Mar 27, 2023
@adityamaru adityamaru requested a review from dt March 27, 2023 20:57
@adityamaru adityamaru marked this pull request as ready for review March 27, 2023 20:57
@adityamaru adityamaru requested review from a team as code owners March 27, 2023 20:57
@adityamaru adityamaru requested review from a team and HonoreDB and removed request for a team March 27, 2023 20:57
pkg/jobs/jobsprofiler/profiler.go Outdated Show resolved Hide resolved
pkg/jobs/jobsprofiler/profiler.go Outdated Show resolved Hide resolved
This change teaches import, cdc, backup and restore
to store their DistSQL plans in the job_info table
under a timestamped info key. The generation and writing
of the plan diagram is done asynchronously so as to not
slow down the execution of the job. A new plan will be
stored everytime the job sets up its DistSQL flow.

Release note: None
Epic: CRDB-8964
@adityamaru adityamaru added the backport-23.1.x Flags PRs that need to be backported to 23.1 label Mar 27, 2023
@adityamaru
Copy link
Contributor Author

TFTR!

bors r=dt

@craig
Copy link
Contributor

craig bot commented Mar 28, 2023

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Mar 28, 2023

Build failed (retrying...):

@craig
Copy link
Contributor

craig bot commented Mar 28, 2023

Build failed (retrying...):

@craig craig bot merged commit 0745cd4 into cockroachdb:master Mar 28, 2023
@craig
Copy link
Contributor

craig bot commented Mar 28, 2023

Build succeeded:

@blathers-crl
Copy link

blathers-crl bot commented Mar 28, 2023

Encountered an error creating backports. Some common things that can go wrong:

  1. The backport branch might have already existed.
  2. There was a merge conflict.
  3. The backport branch contained merge commits.

You might need to create your backport manually using the backport tool.


Backport to branch 23.1.x failed. See errors above.


🦉 Hoot! I am a Blathers, a bot for CockroachDB. My owner is dev-inf.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
backport-23.1.x Flags PRs that need to be backported to 23.1
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants