monitoring

This repository exists to contain instructions + code necessary to setup a server with kibana, primarily for logging. At some point this could be expanded to time series as well.

Steps

Prerequisites

This README assumes you are running commands on an Ubuntu system with docker installed.

System Configuration

System Specifications

The VPS will need at least 4GB of RAM.

sysctl

Add this to the /etc/sysctl.conf file and reboot: vm.max_map_count=262144 Without this elasticsearch won't start. Updating the file makes sure it persists across reboots. See: https://stackoverflow.com/a/51448773/1663648

Firewall

This doc assumes ME is using digitalocean. Set up a firewall in digitalocean to allow port 80, 5601 + 9200 from allowed IP addresses (including ME IP address).

Install

Copy the following files into the same directory on the VPS:

• kibana.yml
• docker-compose.yml

Run docker-compose up -d in that directory.

Logs

Add the index pattern in Stack Management -> Index Patterns. The index is tix-factory. The logs just come directly out of elasticsearch given an index, so for logging imagine this. PUT http://localhost:9200/tix-factory/logs/1

{
    "message": "hello, world!",
    "labels": {},
    "host": {
        "name": "host name heree"
    },
    "log": {
        "name": "TFAAS1.TixFactory.ApplicationAuthorization.Service",
        "level": "Warning"
    },
    "@timestamp": "2020-10-04T13:55:15.887Z"
}

Without the labels field it doesn't seem to work? idk