Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[aggregator] Sample timers completely #3184

Merged
merged 1 commit into from
Feb 7, 2021
Merged

[aggregator] Sample timers completely #3184

merged 1 commit into from
Feb 7, 2021

Conversation

vdarulis
Copy link
Collaborator

@vdarulis vdarulis commented Feb 7, 2021

What this PR does / why we need it:

Timers in AddUntimed/etc. methods are usually heavily sampled, however the way it was recorded always recorded current time, which adds up to non-trivial overhead (1% of the profile or so).
This moves the timing logic to the (sampled) stopwatch.

Special notes for your reviewer:

Does this PR introduce a user-facing and/or backwards incompatible change?:


Does this PR require updating code package or user-facing documentation?:


Copy link
Contributor

@andrewmains12 andrewmains12 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Stopwatch itself is sampled right? Seems good to me.

@codecov
Copy link

codecov bot commented Feb 7, 2021

Codecov Report

Merging #3184 (5282289) into master (f6450c1) will increase coverage by 0.0%.
The diff coverage is 83.3%.

Impacted file tree graph

@@            Coverage Diff            @@
##           master    #3184     +/-   ##
=========================================
  Coverage    72.2%    72.3%             
=========================================
  Files        1087     1086      -1     
  Lines      101840   100443   -1397     
=========================================
- Hits        73592    72634    -958     
+ Misses      23161    22764    -397     
+ Partials     5087     5045     -42     
Flag Coverage Δ
aggregator 75.8% <83.3%> (+<0.1%) ⬆️
cluster 85.0% <ø> (-0.1%) ⬇️
collector 84.3% <ø> (ø)
dbnode 78.7% <ø> (+0.3%) ⬆️
m3em 74.4% <ø> (ø)
m3ninx 73.1% <ø> (-0.2%) ⬇️
metrics 20.0% <ø> (ø)
msg 74.1% <ø> (-0.2%) ⬇️
query 67.3% <ø> (ø)
x 80.2% <ø> (-0.5%) ⬇️

Flags with carried forward coverage won't be shown. Click here to find out more.


Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update f6450c1...5282289. Read the comment docs.

@vdarulis
Copy link
Collaborator Author

vdarulis commented Feb 7, 2021

Stopwatch itself is sampled right? Seems good to me.

yep it is.

@vdarulis vdarulis merged commit 2d9019d into master Feb 7, 2021
@vdarulis vdarulis deleted the v/time branch February 7, 2021 06:24
soundvibe added a commit that referenced this pull request Feb 10, 2021
* master: (30 commits)
  [dbnode] Use go context to cancel index query workers after timeout (#3194)
  [aggregator] Fix change ActivePlacement semantics on close (#3201)
  [aggregator] Simplify (Active)StagedPlacement API (#3199)
  [aggregator] Checking if metadata is set to default should not cause copying (#3198)
  [dbnode] Remove readers and writer from aggregator API (#3122)
  [aggregator] Avoid large copies in entry rollup comparisons by making them more inline-friendly (#3195)
  [dbnode] Re-add aggregator doc limit update (#3137)
  [m3db] Do not close reader in filterFieldsIterator.Close() (#3196)
  Revert "Remove disk series read limit (#3174)" (#3193)
  [instrument] Improve sampled timer and stopwatch performance (#3191)
  Omit unset fields in metadata json (#3189)
  [dbnode] Remove left-over code in storage/bootstrap/bootstrapper (#3190)
  [dbnode][coordinator] Support match[] in label endpoints (#3180)
  Instrument the worker pool with the wait time (#3188)
  Instrument query path (#3182)
  [aggregator] Remove indirection, large copy from unaggregated protobuf decoder (#3186)
  [aggregator] Sample timers completely (#3184)
  [aggregator] Reduce error handling overhead in rawtcp server (#3183)
  [aggregator] Move shardID calculation out of critical section (#3179)
  Move instrumentation cleanup to FetchTaggedResultIterator Close() (#3173)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants