Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add initial support for indexing to data streams #4409

Merged
merged 15 commits into from
Nov 19, 2020

Commits on Nov 11, 2020

  1. idxmgmt: add support for data streams

    Introduce `apm-server.data_streams.enabled` config,
    which will be used by idxmgmt to route events to
    data streams based on data_stream.* fields that are
    expected to be in each published event.
    axw committed Nov 11, 2020
    Configuration menu
    Copy the full SHA
    1688df1 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    3b5b40a View commit details
    Browse the repository at this point in the history
  3. model: add data_stream.{type,dataset} fields

    When transforming model objects into beat.Events,
    set the data_stream.{type,dataset} fields. We add
    data_stream.namespace elsewhere, using an event
    processor.
    axw committed Nov 11, 2020
    Configuration menu
    Copy the full SHA
    b728661 View commit details
    Browse the repository at this point in the history
  4. beater: handle apm-server.data_streams.enabled

    Handle the new apm-server.data_streams.enabled
    config:
     - when enabled, we add data_stream.namespace to
       all published events
     - when disabled, we remove data_stream.* fields
       from all published events
    
    For now we just set data_stream.namespace to "default".
    Later this will be based on the config received from Fleet.
    axw committed Nov 11, 2020
    Configuration menu
    Copy the full SHA
    33200d9 View commit details
    Browse the repository at this point in the history
  5. processor/stream/package_tests: update tests

    There is a hack in here to inject data_stream.namespace
    in all published events, since the tests do not use the
    standard libbeat pipeline code.
    axw committed Nov 11, 2020
    Configuration menu
    Copy the full SHA
    64c6bf9 View commit details
    Browse the repository at this point in the history
  6. Update approvals

    axw committed Nov 11, 2020
    Configuration menu
    Copy the full SHA
    dd506f8 View commit details
    Browse the repository at this point in the history
  7. Add changelog entry

    axw committed Nov 11, 2020
    Configuration menu
    Copy the full SHA
    6b5c23f View commit details
    Browse the repository at this point in the history

Commits on Nov 16, 2020

  1. Configuration menu
    Copy the full SHA
    c41c11b View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    080ba4e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    658e639 View commit details
    Browse the repository at this point in the history

Commits on Nov 17, 2020

  1. Configuration menu
    Copy the full SHA
    017289e View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    11406d1 View commit details
    Browse the repository at this point in the history
  3. model: update datasets

    Use a common "apm." prefix, and place the service name last.
    axw committed Nov 17, 2020
    Configuration menu
    Copy the full SHA
    798cd59 View commit details
    Browse the repository at this point in the history

Commits on Nov 18, 2020

  1. Configuration menu
    Copy the full SHA
    e500a2b View commit details
    Browse the repository at this point in the history

Commits on Nov 19, 2020

  1. Configuration menu
    Copy the full SHA
    1e7379e View commit details
    Browse the repository at this point in the history