Skip to content

Simple Go agent to ingest streaming data from Turbine via SSE and push it into StatsD as a gauge or to InfluxDB.

License

Notifications You must be signed in to change notification settings

fullcontact/crankshaftd

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

36 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

crankshaftd

Simple Go agent to ingest streaming data from Turbine via SSE and push it into StatsD as a gauge or to InfluxDB as a series.

Property Munging

All keys related to properties (such as max threadpool size, queue lengths, etc.) are stripped by default.

Properties of the following patterns are kept:

  • current*
  • rollingCount*
  • latencyTotal_*
  • isCircuitBreakerOpen

Normal keys are pushed under my-prefix.my-cluster.MyCommandImpl.rollingCountSuccess

Latency histograms are pushed under my-prefix.my-cluster.MyCommandImpl.latencyTotal.xx_pct

isCircuitBreakerOpen will be either 0 or 1.

Additionally, all numeric metrics are divided by the number of reporting hosts. This is because Turbine simply sums all metrics, including percentiles.

StatsD caveat

All metric values are cast from float64 -> int64.

Running

Create a config.toml with your config

# Turbine connection information
host = "turbine.yourcompany.com"
port = 80
tls_enabled = false
clusters = ["cluster1", "cluster2"]

# Backend to stream updates to, 'influxdb' or 'statsd'
backendtype = "influxdb"

[statsd]
host = "127.0.0.1"
port = 8125
prefix = "hystrix"

Build the project

go build

And deploy the resulting binary & config

./crankshaftd

Or run with a different config

./crankshaftd dev.toml

License

Copyright 2017 FullContact Inc. & Michael Rose

Licensed under the Apache License, Version 2.0 (the "License"); you may not use this work except in compliance with the License. You may obtain a copy of the License in the LICENSE file, or at:

http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.

About

Simple Go agent to ingest streaming data from Turbine via SSE and push it into StatsD as a gauge or to InfluxDB.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages