Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: Introduce data metrics for table #8363

Merged
merged 13 commits into from
Oct 20, 2022

Conversation

Xuanwo
Copy link
Member

@Xuanwo Xuanwo commented Oct 20, 2022

I hereby agree to the terms of the CLA available at: https://databend.rs/dev/policies/cla/

Summary

This PR introduces a new idea called StorageMetrics. The same as our operator, we could have:

  • data metrics: Read/Write metrics for data
  • cache metrics: Read/Write metrics for cache

As in this PR, only data metrics is added.

Also, this PR decouples metrics from our query context. Since this PR, Table trait will provide a new API called get_data_metrics. By accessing this API, users can read the data metrics about this table.

And in show processlist, we will fetch all attached table in this query, fetch their metrics and calculate to get the overall metrics.

Xuanwo added 11 commits October 20, 2022 15:47
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
Signed-off-by: Xuanwo <github@xuanwo.io>
@vercel
Copy link

vercel bot commented Oct 20, 2022

The latest updates on your projects. Learn more about Vercel for Git ↗︎

1 Ignored Deployment
Name Status Preview Updated
databend ⬜️ Ignored (Inspect) Oct 20, 2022 at 0:43AM (UTC)

@mergify mergify bot added the pr-feature this PR introduces a new feature to the codebase label Oct 20, 2022
Signed-off-by: Xuanwo <github@xuanwo.io>
Copy link
Member

@BohuTANG BohuTANG left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great to me 🚀

@BohuTANG BohuTANG merged commit a4fe9b5 into databendlabs:main Oct 20, 2022
@Xuanwo Xuanwo deleted the storage-metrics branch October 20, 2022 14:39
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
pr-feature this PR introduces a new feature to the codebase
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Feature: Support multiple table progress bug: fuse table lost DalContext layer bind
2 participants