Datadog Agent proxy service for client-side metrics collection.
- State: Early production
- Production: http://volley.artsy.net | k8s
- Staging: http://volley-staging.artsy.net | k8s
- CI/Deploys: CircleCi; merged PRs to
artsy/volley#mainare automatically deployed to staging; PRs fromstagingtoreleaseare automatically deployed to production. Start a deploy... - Point People: @artsy/velocity-engineers
Volley is a thin HTTP wrapper for node-dogstatsd. It receives metric data from browser applications and forwards it to a Datadog Agent, which in turn handles collection of metrics from multiple sources into Datadog.
- Install the Datadog Agent locally.
- Enter the management interface.
- Set up the API key.
- To avoid publishing your computer's system metrics, disable all the local checks.
Development is done via Hokusai (follow the setup instructions in that readme). Then you may run the following command:
hokusai dev startThat will build a Docker container with the app's dependencies. You can also run development outside Docker, via yarn install and yarn start (run npm install -g yarn, if you don't already have Yarn).
To run the tests run the following command:
yarn test
# or
hokusai testBecause Datadog plans have an allotment of custom metrics and tags, Metric offers the ability to restrict possible values for metric names and tags that are allowed. The allowlists are managed by environment variables.
- Get the current METRIC_NAME_ALLOWLIST with
hokusai staging env get METRIC_NAME_ALLOWLIST - Set its new value with
hokusai staging env set METRIC_NAME_LIST=preexisting-tag:value,new-tag:new-value - Refresh the environment with
hokusai staging deployment refresh - Do the same thing in
productionwhen you're satisfied.
The Datadog Agent is already configured to send an env tag with all metrics it publishes. If you want to add additional global tags, set the GLOBAL_TAGS environment variable to a comma-separated list of tags with the process mentioned in the previous section.
From a client application, make a POST request to the /report endpoint. Example:
// TODOYou may push multiple metrics in one payload. In all situations, Metric will respond with status code 202 and the text "OK", so watch Datadog for metrics appearing and Metric's logs for errors.
The following payload demonstrates the format of all possible metric types:
{
"serviceName": "client-service",
"metrics": [
{
"type": "timer",
"name": "elapsed-time",
"value": 12345,
"tags": ["tag-name:tag-arg"]
},
{
"type": "increment",
"name": "count",
"sampleRate": 1, // optional; defaults to 1
"tags": ["tag-name:tag-arg"]
},
{
"type": "incrementBy",
"name": "count",
"value": 5,
"tags": ["tag-name:tag-arg"]
},
{
"type": "decrement",
"name": "count",
"sampleRate": 3, // optional; defaults to 1
"tags": ["tag-name:tag-arg"]
},
{
"type": "decrementBy",
"name": "count",
"value": 3,
"tags": ["tag-name:tag-arg"]
},
{
"type": "gauge",
"name": "stat",
"sampleRate": 2, // optional; defaults to 1
"value": 12345,
"tags": ["tag-name:tag-arg"]
},
{
"type": "histogram",
"name": "stat",
"value": 4567,
"sampleRate": 6,
"tags": ["tag-name:tag-arg"]
},
{
"type": "set",
"name": "tracked-items",
"value": "item",
"tags": ["tag-name:tag-arg"]
}
]
}A volley in sports is to knock an airborne ball onward without letting it touch the ground. Or it's a large number of projectiles airborn at once. Either way, it's a vaguely physics-oriented term, because of...motion...and stuff.
Enjoy https://www.youtube.com/watch?v=1C9STKF0Lv4, for an example.
This project is the work of engineers at Artsy, the world's leading and largest online art marketplace and platform for discovering art. One of our core Engineering Principles is being Open Source by Default which means we strive to share as many details of our work as possible.
You can learn more about this work from our blog and by following @ArtsyOpenSource or explore our public data by checking out our API. If you're interested in a career at Artsy, read through our job postings!