Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add allowlist filter for Exception list data #112668

Merged
merged 5 commits into from
Sep 21, 2021

Conversation

pjhampton
Copy link
Contributor

Summary

Filters out non-required information for downstream analysis.

Checklist

Delete any items that are not applicable to this PR.

For maintainers

@pjhampton pjhampton added v8.0.0 release_note:skip Skip the PR/issue when compiling release notes Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. auto-backport Deprecated - use backport:version if exact versions are needed v7.16.0 v7.15.1 labels Sep 21, 2021
@pjhampton pjhampton self-assigned this Sep 21, 2021
@pjhampton pjhampton requested a review from a team as a code owner September 21, 2021 14:02
@elasticmachine
Copy link
Contributor

Pinging @elastic/security-solution (Team: SecuritySolution)

@pjhampton
Copy link
Contributor Author

@elasticmachine merge upstream

@elastic elastic deleted a comment from kibanamachine Sep 21, 2021
Copy link
Contributor

@donaherc donaherc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a simple question about the types for the list telemetry.

trusted_application: TrustedApp[];
endpoint_exception: EndpointExceptionListItem[];
endpoint_event_filter: EndpointExceptionListItem[];
trusted_application: TelemetryEvent[];
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Interesting, why are these types changed to be less concrete?

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ref this commit: be4c21f
The reasoning around this was 2 fold:

  • TrustedApp and EndpointExceptionListItem (renamed ExceptionListItem) were consolidated, so these would have been 3 ExceptionListItem. Using a type we don't own has caused the issue we discussed in the backref issue.
  • The reason for the cast to TelemetryEvent is to allow for the allow list filtering without overcomplicating the logic or introducing generics (which wouldn't be easy to do / test)

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Ah ok, that makes sense.

@pjhampton
Copy link
Contributor Author

Thanks @donaherc. Good q!

@pjhampton
Copy link
Contributor Author

@elasticmachine merge upstream

@kibanamachine
Copy link
Contributor

💚 Build Succeeded

Metrics [docs]

✅ unchanged

History

To update your PR or re-run it, just comment with:
@elasticmachine merge upstream

cc @pjhampton

@pjhampton pjhampton enabled auto-merge (squash) September 21, 2021 20:25
Copy link
Contributor

@donaherc donaherc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM thx for answering the Qs

@pjhampton pjhampton merged commit feae8e7 into master Sep 21, 2021
kibanamachine added a commit to kibanamachine/kibana that referenced this pull request Sep 21, 2021
* Add allowlist filter to exception list telemetry.

* Refactor away union type.

* Bump interval back to 24h.

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
@kibanamachine
Copy link
Contributor

💔 Backport failed

Status Branch Result
7.x
7.15 Commit could not be cherrypicked due to conflicts

Successful backport PRs will be merged automatically after passing CI.

To backport manually run:
node scripts/backport --pr 112668

kibanamachine added a commit that referenced this pull request Sep 21, 2021
* Add allowlist filter to exception list telemetry.

* Refactor away union type.

* Bump interval back to 24h.

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

Co-authored-by: Pete Hampton <pjhampton@users.noreply.github.com>
pjhampton added a commit that referenced this pull request Sep 22, 2021
* Add allowlist filter for Exception list data (#112668)

* Add allowlist filter to exception list telemetry.

* Refactor away union type.

* Bump interval back to 24h.

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>

* Fix linting issue

Co-authored-by: Kibana Machine <42973632+kibanamachine@users.noreply.github.com>
@spalger spalger deleted the pjhampton/exception-list-telemetry-filter-fields branch May 8, 2022 22:04
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
auto-backport Deprecated - use backport:version if exact versions are needed release_note:skip Skip the PR/issue when compiling release notes Team: SecuritySolution Security Solutions Team working on SIEM, Endpoint, Timeline, Resolver, etc. v7.15.1 v7.16.0 v8.0.0
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants