Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add pipeline tests to Cisco ASA #414

Merged
merged 18 commits into from
Dec 14, 2020

Conversation

andrewkroh
Copy link
Member

What does this PR do?

Add missing field definitions.

Correct JSON data types for fields.

  • event.code
  • network.iana_number

TODO

  • Fix error.message in generated pipeline.
  • Fix warnings:
[0] parsing field value failed: field "destination.port"''s Go type, string, does not match the expected field type: long
[1] parsing field value failed: field "source.port"''s Go type, string, does not match the expected field type: long
cisco/asa test-not-ip.log:
[0] parsing field value failed: field "destination.nat.port"''s Go type, string, does not match the expected field type: long
[1] parsing field value failed: field "source.nat.port"''s Go type, string, does not match the expected field type: long
[2] parsing field value failed: field "syslog.facility"''s Go type, float64, does not match the expected field type: keyword
cisco/asa test-sample.log:
[0] parsing field value failed: field "source.nat.port"''s Go type, string, does not match the expected field type: long

Checklist

  • I have reviewed tips for building integrations and this pull request is aligned with them.
  • I have verified that all datasets collect metrics or logs.

How to test this PR locally

elastic-package stack up -d -s=elasticsearch
$(elastic-package stack shellinit)
cd packages/cisco/data_stream/asa
elastic-package test pipeline -g

Related issues

Add missing field definitions.

Correct JSON data types for fields.
- event.code
- network.iana_number

TODO:
Fix warnings:
[0] parsing field value failed: field "destination.port"''s Go type, string, does not match the expected field type: long
[1] parsing field value failed: field "source.port"''s Go type, string, does not match the expected field type: long
cisco/asa test-not-ip.log:
[0] parsing field value failed: field "destination.nat.port"''s Go type, string, does not match the expected field type: long
[1] parsing field value failed: field "source.nat.port"''s Go type, string, does not match the expected field type: long
[2] parsing field value failed: field "syslog.facility"''s Go type, float64, does not match the expected field type: keyword
cisco/asa test-sample.log:
[0] parsing field value failed: field "source.nat.port"''s Go type, string, does not match the expected field type: long

Fix error.message in generated pipeline.
@elasticmachine
Copy link

elasticmachine commented Nov 24, 2020

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS
Pipeline View Test View Changes Artifacts preview

Expand to view the summary

Build stats

  • Build Cause: Pull request #414 updated

  • Start Time: 2020-12-14T14:46:04.516+0000

  • Duration: 26 min 3 sec

Test stats 🧪

Test Results
Failed 0
Passed 132
Skipped 0
Total 132

@adriansr adriansr self-assigned this Nov 30, 2020
@adriansr
Copy link
Contributor

This requires elastic/elastic-package#193

@adriansr adriansr marked this pull request as ready for review December 11, 2020 10:12
@elasticmachine
Copy link

Pinging @elastic/security-external-integrations (Team:Security-External Integrations)

@andrewkroh andrewkroh merged commit 17d899b into elastic:master Dec 14, 2020
andrewkroh added a commit to andrewkroh/beats that referenced this pull request Jan 11, 2021
andrewkroh added a commit to elastic/beats that referenced this pull request Jan 25, 2021
* Sync changes to AWS CloudTrail

elastic/integrations#408

* Sync changes to CheckPoint Firewall

Change type of event.severity.

elastic/integrations#409

* Sync changes from Cisco ASA / FTD

elastic/integrations#414

* Sync changes from Cisco IOS

Make icmp and igmp fields strings because they are keywords.

elastic/integrations#416

* Sync changes to CrowdStrike Falcon

Fix some field types.

elastic/integrations#377

* Sync changes to Fortinet Firewall

Drop assignip if the value is "N/A".

elastic/integrations#437

* Sync changes to Juniper SRX

Convert event.risk values to float
Protect against missing event.timezone
Convert event.severity to long.

elastic/integrations#443

* Sync changes to Suricata EVE

Convert suricata.eve.flow_id to string because the field is a keyword in the mapping.

elastic/integrations#457

* Sync changes to Zeek DNS

Fix usages of ignore_failure with convert processor.
Make DNS transaction ID a string.

elastic/integrations#448

* Add changelog
andrewkroh added a commit to andrewkroh/beats that referenced this pull request Feb 16, 2021
* Sync changes to AWS CloudTrail

elastic/integrations#408

* Sync changes to CheckPoint Firewall

Change type of event.severity.

elastic/integrations#409

* Sync changes from Cisco ASA / FTD

elastic/integrations#414

* Sync changes from Cisco IOS

Make icmp and igmp fields strings because they are keywords.

elastic/integrations#416

* Sync changes to CrowdStrike Falcon

Fix some field types.

elastic/integrations#377

* Sync changes to Fortinet Firewall

Drop assignip if the value is "N/A".

elastic/integrations#437

* Sync changes to Juniper SRX

Convert event.risk values to float
Protect against missing event.timezone
Convert event.severity to long.

elastic/integrations#443

* Sync changes to Suricata EVE

Convert suricata.eve.flow_id to string because the field is a keyword in the mapping.

elastic/integrations#457

* Sync changes to Zeek DNS

Fix usages of ignore_failure with convert processor.
Make DNS transaction ID a string.

elastic/integrations#448

* Add changelog

(cherry picked from commit bf46572)
adriansr pushed a commit to elastic/beats that referenced this pull request Feb 17, 2021
#24077)

* Sync fixes from Integration Package Testing (#23424)

* Sync changes to AWS CloudTrail

elastic/integrations#408

* Sync changes to CheckPoint Firewall

Change type of event.severity.

elastic/integrations#409

* Sync changes from Cisco ASA / FTD

elastic/integrations#414

* Sync changes from Cisco IOS

Make icmp and igmp fields strings because they are keywords.

elastic/integrations#416

* Sync changes to CrowdStrike Falcon

Fix some field types.

elastic/integrations#377

* Sync changes to Fortinet Firewall

Drop assignip if the value is "N/A".

elastic/integrations#437

* Sync changes to Juniper SRX

Convert event.risk values to float
Protect against missing event.timezone
Convert event.severity to long.

elastic/integrations#443

* Sync changes to Suricata EVE

Convert suricata.eve.flow_id to string because the field is a keyword in the mapping.

elastic/integrations#457

* Sync changes to Zeek DNS

Fix usages of ignore_failure with convert processor.
Make DNS transaction ID a string.

elastic/integrations#448

* Add changelog

(cherry picked from commit bf46572)
eyalkraft pushed a commit to build-security/integrations that referenced this pull request Mar 30, 2022
* Add pipeline test to Cisco ASA

Add missing field definitions.

Correct JSON data types for fields.
- event.code
- network.iana_number

TODO:
Fix warnings:
[0] parsing field value failed: field "destination.port"''s Go type, string, does not match the expected field type: long
[1] parsing field value failed: field "source.port"''s Go type, string, does not match the expected field type: long
cisco/asa test-not-ip.log:
[0] parsing field value failed: field "destination.nat.port"''s Go type, string, does not match the expected field type: long
[1] parsing field value failed: field "source.nat.port"''s Go type, string, does not match the expected field type: long
[2] parsing field value failed: field "syslog.facility"''s Go type, float64, does not match the expected field type: keyword
cisco/asa test-sample.log:
[0] parsing field value failed: field "source.nat.port"''s Go type, string, does not match the expected field type: long

Fix error.message in generated pipeline.

* Check for unset raw_date temp field.

* Convert NAT ports to integer

* Upgrade ASA pipeline from Beats

* Fix internal prefix

* Fixes to the pipeline and remove bad test lines

* Missing fields

* Regenerate golden files

* config to ignore event.ingested

* Update Cisco package to 0.8.0

* Mage fmt

* Update docs fields

* Use test case configuration to set numeric keywords

* Run `elastic-package format`

* Update dependencies

Co-authored-by: Adrian Serrano <adrisr83@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants