Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Beats to ECS 1.8.0 #23465

Merged
merged 43 commits into from
Feb 16, 2021
Merged

Update Beats to ECS 1.8.0 #23465

merged 43 commits into from
Feb 16, 2021

Commits on Feb 1, 2021

  1. Configuration menu
    Copy the full SHA
    c9d51a4 View commit details
    Browse the repository at this point in the history
  2. make update

    adriansr committed Feb 1, 2021
    Configuration menu
    Copy the full SHA
    1d6b885 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    fc89c23 View commit details
    Browse the repository at this point in the history
  4. Fix packetbeat's test after ECS update

    Upgrading ECS Go definitions to 1.8 caused Packetbeat's HTTP event_test
    to fail due to a couple of new ECS fields introduced in v1.7 not being
    expected. Those are:
    
    - request.mime_type
    - response.mime_type
    
    Packetbeat doesn't actually fill those fields. That task is acomplished
    by the detect_mime_type processor.
    adriansr committed Feb 1, 2021
    Configuration menu
    Copy the full SHA
    58c1b12 View commit details
    Browse the repository at this point in the history
  5. fix linting of go.sum

    adriansr committed Feb 1, 2021
    Configuration menu
    Copy the full SHA
    e1670c8 View commit details
    Browse the repository at this point in the history
  6. Update NOTICE

    adriansr committed Feb 1, 2021
    Configuration menu
    Copy the full SHA
    394d596 View commit details
    Browse the repository at this point in the history
  7. Configuration menu
    Copy the full SHA
    795e788 View commit details
    Browse the repository at this point in the history
  8. Configuration menu
    Copy the full SHA
    376b26f View commit details
    Browse the repository at this point in the history

Commits on Feb 2, 2021

  1. Add os.type field from ECS 1.8 (#23513)

    Adds the host.os.type field introduced by ECS 1.8.0.
    
    Possible values for this field are:
    - linux
    - macos
    - unix
    - windows
    
    The field will be missing for OSes not in the list.
    
    Related #23118
    adriansr authored Feb 2, 2021
    Configuration menu
    Copy the full SHA
    d8cfad6 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    0522fec View commit details
    Browse the repository at this point in the history

Commits on Feb 3, 2021

  1. [ECS] Winlogbeat ecs 1.8 changes (#23563)

    * User enhancements for powershell module
    
    * User enhancements for security and sysmon module
    
    * Add registry category to events
    
    * Add session category to events
    
    * Set target group when possible
    marc-gr authored Feb 3, 2021
    Configuration menu
    Copy the full SHA
    cd4bcb2 View commit details
    Browse the repository at this point in the history
  2. [Journalbeat][ecs] Journalbeat ecs 1.8 (#23737)

    * Improve ECS mappings and upgrade to ecs 1.8
    
    * Run mage update
    marc-gr authored Feb 3, 2021
    Configuration menu
    Copy the full SHA
    ee8edd0 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    1685e84 View commit details
    Browse the repository at this point in the history

Commits on Feb 4, 2021

  1. [ECS][Filebeat] Gsuite/Google Workspace ECS 1.8 (#23709)

    * Add new ECS user and categories features to google_workspace/gsuite
    
    * Update CHANGELOG.next.asciidoc
    
    Co-authored-by: Adrian Serrano <adrisr83@gmail.com>
    
    Co-authored-by: Adrian Serrano <adrisr83@gmail.com>
    marc-gr and adriansr authored Feb 4, 2021
    Configuration menu
    Copy the full SHA
    0d45c3f View commit details
    Browse the repository at this point in the history
  2. [ECS] Packetbeat ecs 1.8 (#23783)

    * Packetbeat changes for ECS 1.8
    
    * Remove unused parameter
    marc-gr authored Feb 4, 2021
    Configuration menu
    Copy the full SHA
    d837c3e View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    60ac401 View commit details
    Browse the repository at this point in the history

Commits on Feb 8, 2021

  1. Update Auditbeat auditd module to ECS 1.8 (#23594)

    Updates Auditbeat to new ECS 1.8.
    - Support new user/group fields provided by go-libaudit.
    - Support AUDIT_LOGIN.
    - Adds golden file tests to auditd.
    - Updates elastic/go-libaudit dependency to v2.2.0.
    adriansr authored Feb 8, 2021
    Configuration menu
    Copy the full SHA
    c51272d View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    005266e View commit details
    Browse the repository at this point in the history
  3. Update filebeat auditd module to ECS 1.8 (#23723)

    Update the auditd module in Filebeat to apply the same ECS enrichments as Auditbeat / go-libaudit.
    This is achieved by an autogenerated processor that performs the enrichments defined in go-libaudit's
    normalizations.yaml.
    adriansr authored Feb 8, 2021
    Configuration menu
    Copy the full SHA
    5e868f8 View commit details
    Browse the repository at this point in the history
  4. Update Microsoft module to ECS 1.8 (#23897)

    - Update microsoft/defender_atp to ECS 1.8
    
    This copies host.user.* fields into user.* as host.user is deprecated
    starting ECS 1.8.
    
    - Update microsoft/m365_defender to ECS 1.8
    
    Deprecate host.user fields.
    adriansr authored Feb 8, 2021
    Configuration menu
    Copy the full SHA
    40c47b9 View commit details
    Browse the repository at this point in the history
  5. Update o365 module to ECS 1.8 (#23896)

    - Updates the o365 pipeline to populate user and group added messages.
    - file input: Properly report JSON decoding errors
    adriansr authored Feb 8, 2021
    Configuration menu
    Copy the full SHA
    ac2de72 View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    3d31953 View commit details
    Browse the repository at this point in the history

Commits on Feb 9, 2021

  1. Upgrade cef to ecs 1.8.0. (#23832)

    Co-authored-by: Adrian Serrano <adrisr83@gmail.com>
    marc-gr and adriansr authored Feb 9, 2021
    Configuration menu
    Copy the full SHA
    0f50842 View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    fa2980d View commit details
    Browse the repository at this point in the history
  3. [ECS] Zeek upgrade to ecs 1.8.0 (#23847)

    * Change ecs version to 1.8.0
    
    * Add ecs mappings to http and mysql filesets
    marc-gr authored Feb 9, 2021
    Configuration menu
    Copy the full SHA
    8cb2be2 View commit details
    Browse the repository at this point in the history
  4. Update Filebeat azure module to ECS 1.8 (#23927)

    Updates azure module to add some extra ECS fields:
    - event.original
    - user.email
    - related.ip
    - related.user
    adriansr authored Feb 9, 2021
    Configuration menu
    Copy the full SHA
    696c30c View commit details
    Browse the repository at this point in the history
  5. Update Filebeat aws/s3access dataset to ECS 1.8 (#23920)

    Update the s3access dataset. There's nothing ECS 1.8 in particular.
    
    This adds:
    
    - event.category: "web"
    - event.type: "access"
    - event.original
    - http.request.method
    - http.response.body.bytes
    - http.version
    - url.original (http request URI)
    
    Fixes:
    
    - event.duration needed to be converted to nanoseconds (was milliseconds)
    adriansr authored Feb 9, 2021
    Configuration menu
    Copy the full SHA
    c957e58 View commit details
    Browse the repository at this point in the history

Commits on Feb 10, 2021

  1. Configuration menu
    Copy the full SHA
    80123fb View commit details
    Browse the repository at this point in the history
  2. Filebeat: Update aws/cloudtrail dataset to ECS 1.8 (#23911)

    Updates aws/cloudtrail to map multiuser events to ECS 1.8.
    adriansr authored Feb 10, 2021
    Configuration menu
    Copy the full SHA
    0b27310 View commit details
    Browse the repository at this point in the history

Commits on Feb 11, 2021

  1. Configuration menu
    Copy the full SHA
    a68ad55 View commit details
    Browse the repository at this point in the history
  2. Update mysqlenterprise module to ECS 1.8 (#23978)

    Updates mysqlenterprise:
    
    - Improve related.* field mapping.
    - Populate event.original.
    - Generate iam user creation and deletion from CREATE USER and DROP USER.
    adriansr authored Feb 11, 2021
    Configuration menu
    Copy the full SHA
    52b7fd0 View commit details
    Browse the repository at this point in the history
  3. Update sophos/xg to ECS 1.8 (#23967)

    Updates sophos/xg ECS mappings:
    
    - populate related.hosts.
    - avoid duplicates in related fields.
    - set user.name for authentications.
    adriansr authored Feb 11, 2021
    Configuration menu
    Copy the full SHA
    35b196b View commit details
    Browse the repository at this point in the history
  4. Upgrade to ecs 1.8 (#23961)

    marc-gr authored Feb 11, 2021
    Configuration menu
    Copy the full SHA
    b050cd0 View commit details
    Browse the repository at this point in the history
  5. Update all Beats to report ECS version 1.8.0 (#23992)

    * Set ecs.version to 1.8.0 on all x-pack/filebeat modules
    
    * set ecs.version to 1.8.0 on all filebeat modules
    
    * Set ECS version to 1.8.0 in Winlogbeat
    
    * Set ECS version to 1.8.0 in heartbeat
    
    * Set ECS version 1.8.0 in metricbeat
    adriansr authored Feb 11, 2021
    Configuration menu
    Copy the full SHA
    632408c View commit details
    Browse the repository at this point in the history
  6. Configuration menu
    Copy the full SHA
    e8f8c87 View commit details
    Browse the repository at this point in the history

Commits on Feb 12, 2021

  1. [ecs] Upgrade okta to ecs 1.8.0 and move js processor to ingest pipel…

    …ine (#23929)
    
    * Upgrade okta to ecs 1.8.0 and move js processor to ingest pipeline
    
    * Add description field and set _id properly
    marc-gr authored Feb 12, 2021
    Configuration menu
    Copy the full SHA
    ee269f0 View commit details
    Browse the repository at this point in the history
  2. Update zoom module to ECS 1.8 (#23904)

    Updates zoom pipeline with new ECS 1.8 mappings (multiuser).
    Fixes a couple of issues with the existing module:
    - user events: missing mapping for event.category (wrongly mapped to event.type).
    - chat_channel events: fixed an error in the pipeline that caused some events to be dropped on ingestion.
    adriansr authored Feb 12, 2021
    Configuration menu
    Copy the full SHA
    c4b6fd2 View commit details
    Browse the repository at this point in the history
  3. Configuration menu
    Copy the full SHA
    4c884ad View commit details
    Browse the repository at this point in the history
  4. Missing changelog entry

    adriansr committed Feb 12, 2021
    Configuration menu
    Copy the full SHA
    9b415d6 View commit details
    Browse the repository at this point in the history
  5. Configuration menu
    Copy the full SHA
    65aa885 View commit details
    Browse the repository at this point in the history

Commits on Feb 15, 2021

  1. Configuration menu
    Copy the full SHA
    d67a7dd View commit details
    Browse the repository at this point in the history

Commits on Feb 16, 2021

  1. Configuration menu
    Copy the full SHA
    7eb07ca View commit details
    Browse the repository at this point in the history
  2. Configuration menu
    Copy the full SHA
    b94a9ad View commit details
    Browse the repository at this point in the history