Commits on Dec 10, 2020

1. Add initial support for indexing to data streams (elastic#4409) …

   * idxmgmt: add support for data streams
   
   Introduce `apm-server.data_streams.enabled` config,
   which will be used by idxmgmt to route events to
   data streams based on data_stream.* fields that are
   expected to be in each published event.
   
   * _meta/fields.common.yml: add data_stream.* fields
   
   * model: add data_stream.{type,dataset} fields
   
   When transforming model objects into beat.Events,
   set the data_stream.{type,dataset} fields. We add
   data_stream.namespace elsewhere, using an event
   processor.
   
   * beater: handle apm-server.data_streams.enabled
   
   Handle the new apm-server.data_streams.enabled
   config:
    - when enabled, we add data_stream.namespace to
      all published events
    - when disabled, we remove data_stream.* fields
      from all published events
   
   For now we just set data_stream.namespace to "default".
   Later this will be based on the config received from Fleet.
   
   * processor/stream/package_tests: update tests
   
   There is a hack in here to inject data_stream.namespace
   in all published events, since the tests do not use the
   standard libbeat pipeline code.
   
   * Update approvals
   
   * Add changelog entry
   
   * datastreams: address review comments
   
   * changelogs: clarify feature is experimental
   
   * _meta: specify allowed values for data_stream.type
   
   * model: update datasets
   
   Use a common "apm." prefix, and place the service name last.

   

   axw committed Dec 10, 2020
   Configuration menu

   • View commit details
   • Copy full SHA for 5b48118
   • Browse repository at this point

   Copy the full SHA

   5b48118 View commit details

   Browse the repository at this point in the history