Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Fix Filebeat tests with new region_iso_code field #7678

Merged
merged 1 commit into from
Jul 23, 2018
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
70 changes: 70 additions & 0 deletions filebeat/docs/fields.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -305,6 +305,16 @@ type: keyword
The city name.


--

*`apache2.access.geoip.region_iso_code`*::
+
--
type: keyword

Region ISO code.


--

[float]
Expand Down Expand Up @@ -556,6 +566,16 @@ type: geo_point
The longitude and latitude.


--

*`auditd.log.geoip.region_iso_code`*::
+
--
type: keyword

Region ISO code.


--

[[exported-fields-beat]]
Expand Down Expand Up @@ -2000,6 +2020,16 @@ type: keyword
The city name.


--

*`iis.access.geoip.region_iso_code`*::
+
--
type: keyword

Region ISO code.


--

[float]
Expand Down Expand Up @@ -2166,6 +2196,16 @@ type: keyword
The city name.


--

*`iis.error.geoip.region_iso_code`*::
+
--
type: keyword

Region ISO code.


--

[[exported-fields-kafka]]
Expand Down Expand Up @@ -3353,6 +3393,16 @@ type: keyword
The city name.


--

*`nginx.access.geoip.region_iso_code`*::
+
--
type: keyword

Region ISO code.


--

[float]
Expand Down Expand Up @@ -3890,6 +3940,16 @@ type: geo_point
The longitude and latitude.


--

*`system.auth.ssh.geoip.region_iso_code`*::
+
--
type: keyword

Region ISO code.


--

[float]
Expand Down Expand Up @@ -4333,6 +4393,16 @@ type: keyword
The city name.


--

*`traefik.access.geoip.region_iso_code`*::
+
--
type: keyword

Region ISO code.


--

*`traefik.access.request_count`*::
Expand Down
2 changes: 1 addition & 1 deletion filebeat/include/fields.go

Large diffs are not rendered by default.

5 changes: 4 additions & 1 deletion filebeat/module/apache2/access/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -112,4 +112,7 @@
type: keyword
description: >
The city name.

- name: region_iso_code
type: keyword
description: >
Region ISO code.
4 changes: 4 additions & 0 deletions filebeat/module/auditd/log/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -77,3 +77,7 @@
type: geo_point
description: >
The longitude and latitude.
- name: region_iso_code
type: keyword
description: >
Region ISO code.
4 changes: 2 additions & 2 deletions filebeat/module/icinga/startup/test/test.log-expected.json
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
[
{
"@timestamp": "2018-06-27T06:22:36.186Z",
"@timestamp": "2018-07-23T11:50:38.896Z",
"fileset.module": "icinga",
"fileset.name": "startup",
"icinga.startup.facility": "cli",
Expand All @@ -11,7 +11,7 @@
"prospector.type": "log"
},
{
"@timestamp": "2018-06-27T06:22:36.186Z",
"@timestamp": "2018-07-23T11:50:38.896Z",
"fileset.module": "icinga",
"fileset.name": "startup",
"icinga.startup.facility": "cli",
Expand Down
4 changes: 4 additions & 0 deletions filebeat/module/iis/access/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -157,3 +157,7 @@
type: keyword
description: >
The city name.
- name: region_iso_code
type: keyword
description: >
Region ISO code.
2 changes: 2 additions & 0 deletions filebeat/module/iis/access/test/test.log-expected.json
Original file line number Diff line number Diff line change
Expand Up @@ -8,6 +8,7 @@
"iis.access.geoip.country_iso_code": "DE",
"iis.access.geoip.location.lat": 52.5167,
"iis.access.geoip.location.lon": 13.4,
"iis.access.geoip.region_iso_code": "DE-BE",
"iis.access.geoip.region_name": "Land Berlin",
"iis.access.method": "GET",
"iis.access.port": "80",
Expand Down Expand Up @@ -73,6 +74,7 @@
"iis.access.geoip.country_iso_code": "DE",
"iis.access.geoip.location.lat": 52.5167,
"iis.access.geoip.location.lon": 13.4,
"iis.access.geoip.region_iso_code": "DE-BE",
"iis.access.geoip.region_name": "Land Berlin",
"iis.access.hostname": "example.com",
"iis.access.http_version": "1.1",
Expand Down
4 changes: 4 additions & 0 deletions filebeat/module/iis/error/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -71,3 +71,7 @@
type: keyword
description: >
The city name.
- name: region_iso_code
type: keyword
description: >
Region ISO code.
3 changes: 3 additions & 0 deletions filebeat/module/iis/error/test/test.log-expected.json
Original file line number Diff line number Diff line change
Expand Up @@ -26,6 +26,7 @@
"iis.error.geoip.country_iso_code": "DE",
"iis.error.geoip.location.lat": 52.5167,
"iis.error.geoip.location.lon": 13.4,
"iis.error.geoip.region_iso_code": "DE-BE",
"iis.error.geoip.region_name": "Land Berlin",
"iis.error.http_version": "1.1",
"iis.error.method": "GET",
Expand All @@ -50,6 +51,7 @@
"iis.error.geoip.country_iso_code": "DE",
"iis.error.geoip.location.lat": 52.5167,
"iis.error.geoip.location.lon": 13.4,
"iis.error.geoip.region_iso_code": "DE-BE",
"iis.error.geoip.region_name": "Land Berlin",
"iis.error.http_version": "2.0",
"iis.error.method": "GET",
Expand All @@ -74,6 +76,7 @@
"iis.error.geoip.country_iso_code": "DE",
"iis.error.geoip.location.lat": 52.5167,
"iis.error.geoip.location.lon": 13.4,
"iis.error.geoip.region_iso_code": "DE-BE",
"iis.error.geoip.region_name": "Land Berlin",
"iis.error.queue_name": "-",
"iis.error.reason_phrase": "Timer_MinBytesPerSecond",
Expand Down
22 changes: 11 additions & 11 deletions filebeat/module/kafka/log/test/state-change-1.1.0.log-expected.json
Original file line number Diff line number Diff line change
@@ -1,15 +1,15 @@
[
{
"@timestamp": "2018-07-16T10:17:06.489Z",
"fileset.name": "log",
"fileset.module": "kafka",
"kafka.log.message": "Cached leader info PartitionState(controllerEpoch=25, leader=-1, leaderEpoch=15, isr=[10], zkVersion=15, replicas=[10], offlineReplicas=[10]) for partition __consumer_offsets-16 in response to UpdateMetadata request sent by controller 20 epoch 25 with correlation id 8",
"kafka.log.component": "Broker id=30",
"kafka.log.class": "state.change.logger",
"kafka.log.level": "TRACE",
"message": "[2018-07-16 10:17:06,489] TRACE [Broker id=30] Cached leader info PartitionState(controllerEpoch=25, leader=-1, leaderEpoch=15, isr=[10], zkVersion=15, replicas=[10], offlineReplicas=[10]) for partition __consumer_offsets-16 in response to UpdateMetadata request sent by controller 20 epoch 25 with correlation id 8 (state.change.logger)",
"offset": 0,
"input.type": "log",
"@timestamp": "2018-07-16T10:17:06.489Z",
"fileset.module": "kafka",
"fileset.name": "log",
"input.type": "log",
"kafka.log.class": "state.change.logger",
"kafka.log.component": "Broker id=30",
"kafka.log.level": "TRACE",
"kafka.log.message": "Cached leader info PartitionState(controllerEpoch=25, leader=-1, leaderEpoch=15, isr=[10], zkVersion=15, replicas=[10], offlineReplicas=[10]) for partition __consumer_offsets-16 in response to UpdateMetadata request sent by controller 20 epoch 25 with correlation id 8",
"message": "[2018-07-16 10:17:06,489] TRACE [Broker id=30] Cached leader info PartitionState(controllerEpoch=25, leader=-1, leaderEpoch=15, isr=[10], zkVersion=15, replicas=[10], offlineReplicas=[10]) for partition __consumer_offsets-16 in response to UpdateMetadata request sent by controller 20 epoch 25 with correlation id 8 (state.change.logger)",
"offset": 0,
"prospector.type": "log"
}
]
]
5 changes: 4 additions & 1 deletion filebeat/module/nginx/access/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -119,4 +119,7 @@
type: keyword
description: >
The city name.

- name: region_iso_code
type: keyword
description: >
Region ISO code.
3 changes: 3 additions & 0 deletions filebeat/module/nginx/access/test/test.log-expected.json
Original file line number Diff line number Diff line change
Expand Up @@ -65,6 +65,7 @@
"nginx.access.geoip.country_iso_code": "DE",
"nginx.access.geoip.location.lat": 52.5167,
"nginx.access.geoip.location.lon": 13.4,
"nginx.access.geoip.region_iso_code": "DE-BE",
"nginx.access.geoip.region_name": "Land Berlin",
"nginx.access.http_version": "1.1",
"nginx.access.method": "GET",
Expand Down Expand Up @@ -100,6 +101,7 @@
"nginx.access.geoip.country_iso_code": "DE",
"nginx.access.geoip.location.lat": 52.5167,
"nginx.access.geoip.location.lon": 13.4,
"nginx.access.geoip.region_iso_code": "DE-BE",
"nginx.access.geoip.region_name": "Land Berlin",
"nginx.access.http_version": "1.1",
"nginx.access.method": "GET",
Expand Down Expand Up @@ -133,6 +135,7 @@
"nginx.access.geoip.country_iso_code": "US",
"nginx.access.geoip.location.lat": 39.772,
"nginx.access.geoip.location.lon": -89.6859,
"nginx.access.geoip.region_iso_code": "US-IL",
"nginx.access.geoip.region_name": "Illinois",
"nginx.access.http_version": "1.1",
"nginx.access.method": "GET",
Expand Down
5 changes: 4 additions & 1 deletion filebeat/module/system/auth/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -79,7 +79,10 @@
type: geo_point
description: >
The longitude and latitude.

- name: region_iso_code
type: keyword
description: >
Region ISO code.
- name: sudo
type: group
description: >
Expand Down
1 change: 1 addition & 0 deletions filebeat/module/system/auth/test/test.log-expected.json
Original file line number Diff line number Diff line change
Expand Up @@ -61,6 +61,7 @@
"system.auth.ssh.geoip.country_iso_code": "CN",
"system.auth.ssh.geoip.location.lat": 22.5333,
"system.auth.ssh.geoip.location.lon": 114.1333,
"system.auth.ssh.geoip.region_iso_code": "CN-44",
"system.auth.ssh.geoip.region_name": "Guangdong",
"system.auth.ssh.ip": "116.31.116.24",
"system.auth.ssh.method": "password",
Expand Down
4 changes: 4 additions & 0 deletions filebeat/module/traefik/access/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -112,6 +112,10 @@
type: keyword
description: >
The city name.
- name: region_iso_code
type: keyword
description: >
Region ISO code.
- name: request_count
type: long
description: >
Expand Down
1 change: 1 addition & 0 deletions filebeat/module/traefik/access/test/test.log-expected.json
Original file line number Diff line number Diff line change
Expand Up @@ -35,6 +35,7 @@
"traefik.access.geoip.country_iso_code": "DE",
"traefik.access.geoip.location.lat": 52.5167,
"traefik.access.geoip.location.lon": 13.4,
"traefik.access.geoip.region_iso_code": "DE-BE",
"traefik.access.geoip.region_name": "Land Berlin",
"traefik.access.http_version": "1.1",
"traefik.access.method": "GET",
Expand Down
2 changes: 1 addition & 1 deletion testing/environments/args.yml
Original file line number Diff line number Diff line change
Expand Up @@ -7,4 +7,4 @@ services:
args:
DOWNLOAD_URL: https://snapshots.elastic.co/downloads
ELASTIC_VERSION: 7.0.0-alpha1-SNAPSHOT
CACHE_BUST: 20180501
CACHE_BUST: 20180723