Simple Go agent to ingest streaming data from Turbine via SSE and push it into StatsD as a gauge or to InfluxDB as a series.
All keys related to properties (such as max threadpool size, queue lengths, etc.) are stripped by default.
Properties of the following patterns are kept:
- current*
- rollingCount*
- latencyTotal_*
- isCircuitBreakerOpen
Normal keys are pushed under my-prefix.my-cluster.MyCommandImpl.rollingCountSuccess
Latency histograms are pushed under my-prefix.my-cluster.MyCommandImpl.latencyTotal.xx_pct
isCircuitBreakerOpen will be either 0 or 1.
Additionally, all numeric metrics are divided by the number of reporting hosts. This is because Turbine simply sums all metrics, including percentiles.
All metric values are cast from float64 -> int64.
Create a config.toml with your config
# Turbine connection information
host = "turbine.yourcompany.com"
port = 80
tls_enabled = false
clusters = ["cluster1", "cluster2"]
# Backend to stream updates to, 'influxdb' or 'statsd'
backendtype = "influxdb"
[statsd]
host = "127.0.0.1"
port = 8125
prefix = "hystrix"
Build the project
go build
And deploy the resulting binary & config
./crankshaftd
Or run with a different config
./crankshaftd dev.toml
Copyright 2017 FullContact Inc. & Michael Rose
Licensed under the Apache License, Version 2.0 (the "License"); you may not use this work except in compliance with the License. You may obtain a copy of the License in the LICENSE file, or at:
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software distributed under the License is distributed on an "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied. See the License for the specific language governing permissions and limitations under the License.