Skip to content
This repository has been archived by the owner on Aug 23, 2023. It is now read-only.

use node priority for routing requests #541

Merged
merged 5 commits into from
Feb 23, 2017
Merged

use node priority for routing requests #541

merged 5 commits into from
Feb 23, 2017

Commits on Feb 22, 2017

  1. use node priority for routing requests

    - add a priority attribute to the cluster nodes
    - when getting peers needed to handle a query, use the nodes
      with the lowest priority.
    - update kafkamdm to track kafka lag, and use this lag as the
      node priority.  So if a node has a large lag (either due to
      proecessing the backlog at startup, or because of a fault) it
      will stop recieving queries.  But if all nodes in the cluster
      have high lag, then queries will still be processed and the user
      will get all of the data available.
    - closes #519
    woodsaj committed Feb 22, 2017
    Configuration menu
    Copy the full SHA
    b3e2256 View commit details
    Browse the repository at this point in the history
  2. update kafkamdm to set priority based on number of seconds lag.

    - instead of just using the number of messages the node is lagging
    by, divide the number of messages by the ingest rate to get the
    number of seconds of lag.  ie, if a node is ingesting at 10k/s
    and the lag is 1k, then the priority is set to 0, as the outstanding
    metrics will be processed within 1second.  But if the ingest rate
    is 10k, and the lag is 40k then the prio gets set to 4 as it will take
    4seconds to process the outstanding metrics at the current rate.
    woodsaj committed Feb 22, 2017
    Configuration menu
    Copy the full SHA
    f79594b View commit details
    Browse the repository at this point in the history
  3. allow setting a node to not-ready if its priority value gets too high…

    … (lower priority)
    
    For kafkamdm specifically this allows us to remove a node from service if it is lagging
    by too much (measured in seconds of lag)
    woodsaj committed Feb 22, 2017
    Configuration menu
    Copy the full SHA
    4cf4aad View commit details
    Browse the repository at this point in the history
  4. update configs and docs

    woodsaj committed Feb 22, 2017
    Configuration menu
    Copy the full SHA
    898b4aa View commit details
    Browse the repository at this point in the history

Commits on Feb 23, 2017

  1. minor code adjustments

    woodsaj committed Feb 23, 2017
    Configuration menu
    Copy the full SHA
    18cae9f View commit details
    Browse the repository at this point in the history