Skip to content
This repository has been archived by the owner on Aug 23, 2023. It is now read-only.

mt-parrot: continuous validation by sending dummy stats and querying them back #1680

Merged
merged 60 commits into from
Apr 6, 2020
Merged

mt-parrot: continuous validation by sending dummy stats and querying them back #1680

merged 60 commits into from
Apr 6, 2020

Commits on Mar 17, 2020

  1. Add mt-parrot command to generate deterministic artificial metrics fo… 

    …r each metrictank partition.
    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    68a9aac View commit details
    Browse the repository at this point in the history

  2. only use base url for gatewayAddress so that we can query it

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    6468658 View commit details
    Browse the repository at this point in the history

  3. query with explicit time ranges

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    993dcc7 View commit details
    Browse the repository at this point in the history

  4. publish stats instead of printing them

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    1ba76d3 View commit details
    Browse the repository at this point in the history

  5. extract partition via regex

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    e36561f View commit details
    Browse the repository at this point in the history

  6. more logging

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    8c917ce View commit details
    Browse the repository at this point in the history

  7. stats for other failure modes

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    9fccc21 View commit details
    Browse the repository at this point in the history

  8. go fmt

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    f387547 View commit details
    Browse the repository at this point in the history

  9. update docs

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    74116e5 View commit details
    Browse the repository at this point in the history

  10. FormatInt -> Itoa

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    e5f70fb View commit details
    Browse the repository at this point in the history

  11. update flags to clarify that parrot doesn't control the number of par… 

    …titions
    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    ec7ebf6 View commit details
    Browse the repository at this point in the history

  12. update command name

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    d18681f View commit details
    Browse the repository at this point in the history

  13. declare counters once

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    62a9a73 View commit details
    Browse the repository at this point in the history

  14. simplify partition parsing logic

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    4b4fb0f View commit details
    Browse the repository at this point in the history

  15. tweak parition suffix generation function

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    1080059 View commit details
    Browse the repository at this point in the history

  16. artificial -> test

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    1a498fc View commit details
    Browse the repository at this point in the history

  17. bump default test interval 5s -> 10s + update docs

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    af6b666 View commit details
    Browse the repository at this point in the history

  18. gateway -> publisher

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    f330794 View commit details
    Browse the repository at this point in the history

  19. fix lastSeen tracking

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    69e110b View commit details
    Browse the repository at this point in the history

  20. limit number of error types tracked

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    755f474 View commit details
    Browse the repository at this point in the history

  21. initialize metrics up front

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    d967261 View commit details
    Browse the repository at this point in the history

  22. use aligned lossless tick

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    14187eb View commit details
    Browse the repository at this point in the history

  23. bring decode error back

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    c19b304 View commit details
    Browse the repository at this point in the history

  24. refactor, pull series metrics gathering into a function

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    86c7cff View commit details
    Browse the repository at this point in the history

  25. add and validate parameter to control how far back we query

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    6ccddd9 View commit details
    Browse the repository at this point in the history

  26. break out if we encounter an error

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    0b0c9ce View commit details
    Browse the repository at this point in the history

  27. Add additional validation for correct number of points that are corre… 

    …ctly spaced etc
    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    713927e View commit details
    Browse the repository at this point in the history

  28. set lag based on last publish time

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    362f914 View commit details
    Browse the repository at this point in the history

  29. fix validation of lookback parameter

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    ab338f2 View commit details
    Browse the repository at this point in the history

  30. actually export metrics for new stats

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    d06aa84 View commit details
    Browse the repository at this point in the history

  31. update docs

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    c57c5af View commit details
    Browse the repository at this point in the history

  32. clearer desc

    @Dieterbe @fitzoh
    Dieterbe authored and fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    0a7553e View commit details
    Browse the repository at this point in the history

  33. initialize stats and manually set reporting timestamps

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    679eabc View commit details
    Browse the repository at this point in the history

  34. load atomically

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    26e2b19 View commit details
    Browse the repository at this point in the history

  35. update metric name

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    f9d103b View commit details
    Browse the repository at this point in the history

  36. update log

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    6ce3660 View commit details
    Browse the repository at this point in the history

  37. use tag constructor for tag based metrics

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    496a4cb View commit details
    Browse the repository at this point in the history

  38. rename variables schema -> metric

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    b5771cb View commit details
    Browse the repository at this point in the history

  39. ensure that durations are multiples of 1s

    @fitzoh
    fitzoh committed Mar 17, 2020
    Configuration menu
    Copy the full SHA
    23a250b View commit details
    Browse the repository at this point in the history

Commits on Mar 27, 2020

  1. disable metrics2d0cs for parrot

    @fitzoh
    fitzoh committed Mar 27, 2020
    Configuration menu
    Copy the full SHA
    b2612af View commit details
    Browse the repository at this point in the history

Commits on Mar 30, 2020

  1. make checkSpacing simpler

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    df72b2a View commit details
    Browse the repository at this point in the history

  2. clearer description

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    3cb22c5 View commit details
    Browse the repository at this point in the history

  3. remove needless clause

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    d8c46dd View commit details
    Browse the repository at this point in the history

  4. functions that can force quit the program should be called must*

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    a03fda3 View commit details
    Browse the repository at this point in the history

  5. gofmt import paths

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    08e2d4b View commit details
    Browse the repository at this point in the history

  6. consistency between series and partition stats

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    07a9d1a View commit details
    Browse the repository at this point in the history

  7. need a lossy ticker for the checker routine 

    we wouldn't want to process old ticks with a lag as that would produce
incorrect outcomes
    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    9ab9906 View commit details
    Browse the repository at this point in the history

  8. query response is a response

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    2095f9f View commit details
    Browse the repository at this point in the history

  9. fix off-by-one's

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    9281a5a View commit details
    Browse the repository at this point in the history

  10. make alignForward/alignBackward functions reusable

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    2cb97a6 View commit details
    Browse the repository at this point in the history

  11. fix check of last timestamp. needs to be aligned

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    4f3518f View commit details
    Browse the repository at this point in the history

  12. clean up code by using constructor

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    bb73e5e View commit details
    Browse the repository at this point in the history

  13. remove bogus clause

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    f88aad6 View commit details
    Browse the repository at this point in the history

  14. consistent parrot.monitoring.error metrics: once per response

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    4a53d22 View commit details
    Browse the repository at this point in the history

  15. don't round deltaSum down. we need to know every difference

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    10a2304 View commit details
    Browse the repository at this point in the history

  16. simplify stats setting

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    1045f17 View commit details
    Browse the repository at this point in the history

  17. fix invalid check. 

    see #1680 (comment)
    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    7a1671e View commit details
    Browse the repository at this point in the history

  18. make it easy to monitor for correctness 

    introduce "post nan points" concept
    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    200b0c0 View commit details
    Browse the repository at this point in the history

  19. fix lastPoint and num points check

    @Dieterbe
    Dieterbe committed Mar 30, 2020
    Configuration menu
    Copy the full SHA
    e8b845c View commit details
    Browse the repository at this point in the history

Commits on Apr 6, 2020

  1. scripts/dev/tools-to-doc.sh > docs/tools.md

    @Dieterbe
    Dieterbe committed Apr 6, 2020
    Configuration menu
    Copy the full SHA
    5c3aace View commit details
    Browse the repository at this point in the history