Skip to content
This repository has been archived by the owner on Aug 23, 2023. It is now read-only.

Rewrite enricher to use map lookup #1523

Merged
merged 15 commits into from
Nov 15, 2019
Merged

Rewrite enricher to use map lookup #1523

merged 15 commits into from
Nov 15, 2019

Commits on Nov 7, 2019

  1. Configuration menu
    Copy the full SHA
    ccc2e47 View commit details
    Browse the repository at this point in the history
  2. rewrite enricher to use lookup map for enrichment

    this replaces the enricher implementation to improve its enrichment
    performance. it drops the enrichment cache and it also doesn't filter
    metrics based on the meta records at the enrichment stage anymore.
    instead it is now building a map from which it can lookup the metric
    keys and resolve them into meta records, from which it then gets the
    meta tags.
    especially in scenarios where there is a large number of meta records in
    the index this performs much better than the old implementation.
    replay committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    57dc74d View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    bb33c93 View commit details
    Browse the repository at this point in the history
  4. add tests for enricher

    replay committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    6715d97 View commit details
    Browse the repository at this point in the history
  5. add enricher benchmark

    replay committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    5d57d52 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    ec4b0b7 View commit details
    Browse the repository at this point in the history
  7. add enricher metrics and logs

    replay committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    e03446c View commit details
    Browse the repository at this point in the history
  8. make enricher process addMetric through buffer

    this has the purpose of improving the addMetric performance when a large
    number of metrics gets added to the index concurrently. previously each
    of them would have been checked against the filter requirements of each
    existing meta record, due to how we now process them in batches this
    process is more efficient. instead of checking each new metric one by
    one against each meta record criteria, we're now building a small
    temporary index out of all the added metrics in the buffer, then we run
    each meta record as a query on that small index. this change improves
    the addMetric event processing performance by a huge factor in
    situations where a lot of metrics get added at once.
    replay committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    89622c8 View commit details
    Browse the repository at this point in the history
  9. Configuration menu
    Copy the full SHA
    ebf2972 View commit details
    Browse the repository at this point in the history
  10. make benchmark report allocs

    replay committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    45181c8 View commit details
    Browse the repository at this point in the history
  11. Configuration menu
    Copy the full SHA
    b46956b View commit details
    Browse the repository at this point in the history
  12. Configuration menu
    Copy the full SHA
    00d2ccc View commit details
    Browse the repository at this point in the history
  13. update changelog

    replay committed Nov 7, 2019
    Configuration menu
    Copy the full SHA
    2fef238 View commit details
    Browse the repository at this point in the history

Commits on Nov 14, 2019

  1. fix typo

    replay committed Nov 14, 2019
    Configuration menu
    Copy the full SHA
    e249e9c View commit details
    Browse the repository at this point in the history

Commits on Nov 15, 2019

  1. Configuration menu
    Copy the full SHA
    acd89e0 View commit details
    Browse the repository at this point in the history