server config

Server Configuration

Sample config

ingress:
  grpc01:
    type: grpc
    config:
      addr: ":8085"

ingestion:
  elasticsearch01:
    type: "elasticsearch"
    config:
      urls:
        - http://localhost:9200
      index: tcpdog

geo:
  type: "maxmind"
  config:
    path-city: "/var/maxmind/GeoLite2-City.mmdb"
    path-asn: "/var/maxmind/GeoLite2-ASN.mmdb"
    level: city-loc-asn

flow:
  - ingress: grpc01
    ingestion: elasticsearch01
    serialization: spb

Define an ingress

ingress:
  INGRESS_PROFILE_NAME:
    type: VALID_INGRESS_TYPE
    config:
      VALID_CONFIG_KEY: VALID_CONFIG_VALUE

Valid ingress type:

• grpc
• kafka

Define an ingestion

ingestion:
  INGESTION_PROFILE_NAME:
    type: VALID_INGESTION_TYPE
    config:
      VALID_CONFIG_KEY: VALID_CONFIG_VALUE

Valid ingestion type

• influxdb
• elasticsearch

Define a flow

flow:
  - ingress: INGRESS_PROFILE_NAME
    ingestion: INGESTION_PROFILE_NAME
    serialization: SERIALIZATION_TYPE

Valid serialization:

• json
• pb (protobuf)
• spb (struct protobuf)

Define Geo / Maxmind

geo:
  type: "maxmind"
  config:
    path-city: PATH_TO_CITY.mmdb # in case the level is city, city-asn, city-loc or city-loc-asn 
    path-asn: PATH_TO_ASN.mmdb # in case the level is asn, city-asn or city-loc-asn
    level: INFO_LEVEL

Valid info levels:

• asn
• city
• city-asn
• city-loc
• city-loc-asn

Download Maxmind https://dev.maxmind.com/geoip/geoip2/geolite2/

Kafka config (consumer)

config:
  brokers:
    - ADDRESS_PORT
  version: KAFKA_VERSION # default 0.10.2.1 
  topic: TOPIC_NAME
  retryBackoff: BACKOFF_SEC # default 2 seconds
  workers: WORKER_NUMBER # default 2 in case of pb or spb serializations.
  tlsConfig: TLS_CONFIGURATION # check TLS Config page.

TLS config

Valid versions: 0.8.2.0, 0.8.2.1, 0.8.2.2, 0.9.0.0, 0.9.0.1, 0.10.0.0, 0.10.0.1, 0.10.1.0, 0.10.1.1, 0.10.2.0, 0.10.2.1, 0.11.0.0, 0.11.0.1, 0.11.0.2, 1.0.0.0, 1.1.0.0, 1.1.1.0, 2.0.0.0, 2.0.1.0, 2.1.0.0, 2.2.0.0, 2.3.0.0, 2.4.0.0, 2.5.0.0