Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[vSphere][datastore] Add additional metrics #40441

Merged
merged 28 commits into from
Aug 23, 2024
Merged
Show file tree
Hide file tree
Changes from 27 commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
ea05a06
add data collection
niraj-elastic Aug 6, 2024
decfc87
update changelog
niraj-elastic Aug 6, 2024
de913ec
update datacollection
niraj-elastic Aug 6, 2024
0b49482
update fields.yml
niraj-elastic Aug 6, 2024
88387bf
update test files
niraj-elastic Aug 7, 2024
42bb440
update field discriptions
niraj-elastic Aug 8, 2024
e5bb66c
address review comments
niraj-elastic Aug 9, 2024
b2197e4
address review comments
niraj-elastic Aug 12, 2024
7616495
address review commetns
niraj-elastic Aug 13, 2024
f6e481e
update fields
niraj-crest Aug 13, 2024
dffe460
update usint test
niraj-crest Aug 13, 2024
c14f4fd
address review comments
niraj-crest Aug 20, 2024
80549e1
update data_test file
niraj-crest Aug 20, 2024
de70715
update unit test
niraj-crest Aug 20, 2024
34ce371
address review comments
niraj-crest Aug 20, 2024
6cb96c4
update fields.asci
niraj-crest Aug 20, 2024
c37bde1
address review comments
niraj-crest Aug 20, 2024
98b627f
update data_test file
niraj-crest Aug 20, 2024
c38b06d
update go.mod file
niraj-crest Aug 21, 2024
3ffc570
update NOTICE.txt
niraj-crest Aug 21, 2024
a875047
address review comment
niraj-crest Aug 21, 2024
2e35a11
Merge branch 'elastic:main' into vsphere_datastore_metricset
niraj-elastic Aug 21, 2024
eaa3429
address review comments
niraj-crest Aug 22, 2024
e38f7e2
Merge branch 'vsphere_datastore_metricset' of https://github.com/nira…
niraj-crest Aug 22, 2024
4931d09
Merge branch 'main' of https://github.com/niraj-elastic/beats into vs…
niraj-crest Aug 22, 2024
3479446
mage update
niraj-crest Aug 22, 2024
47893ac
address review comments
niraj-crest Aug 22, 2024
bc8f19b
Address review comments
niraj-crest Aug 23, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions CHANGELOG.next.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -54,6 +54,7 @@ https://github.com/elastic/beats/compare/v8.8.1\...main[Check the HEAD diff]
- Allow metricsets to report their status via control v2 protocol. {pull}40025[40025]
- Remove fallback to the node limit for the `kubernetes.pod.cpu.usage.limit.pct` and `kubernetes.pod.memory.usage.limit.pct` metrics calculation
- Add support for Kibana status metricset in v8 format {pull}40275[40275]
- Add new metrics for the vSphere Datastore metricset. {pull}40441[40441]
- Update metrics for the vSphere Host metricset. {pull}40429[40429]

*Osquerybeat*
Expand Down
136 changes: 120 additions & 16 deletions metricbeat/docs/fields.asciidoc
Original file line number Diff line number Diff line change
Expand Up @@ -66861,54 +66861,108 @@ datastore



*`vsphere.datastore.name`*::
*`vsphere.datastore.capacity.free.bytes`*::
+
--
Datastore name
Free bytes of the datastore.


type: keyword
type: long

format: bytes

--

*`vsphere.datastore.capacity.total.bytes`*::
+
--
Total bytes of the datastore.


type: long

format: bytes

--

*`vsphere.datastore.capacity.used.bytes`*::
+
--
Used bytes of the datastore.


type: long

format: bytes

--

*`vsphere.datastore.capacity.used.pct`*::
+
--
Percentage of datastore capacity used.


type: scaled_float

format: percent

--

*`vsphere.datastore.fstype`*::
+
--
Filesystem type
Filesystem type.


type: keyword

--

*`vsphere.datastore.capacity.total.bytes`*::
*`vsphere.datastore.host.count`*::
+
--
Total bytes of the datastore
Number of hosts.


type: long

format: bytes
--

*`vsphere.datastore.host.names`*::
+
--
List of all the host names.

*`vsphere.datastore.capacity.free.bytes`*::

type: keyword

--

*`vsphere.datastore.iops`*::
+
--
Free bytes of the datastore
Storage I/O Control aggregated Input/Output Operations Per Second.


type: long

format: bytes
--

*`vsphere.datastore.name`*::
+
--
Datastore name.

*`vsphere.datastore.capacity.used.bytes`*::

type: keyword

--

*`vsphere.datastore.read.bytes`*::
+
--
Used bytes of the datastore
Rate of reading data from the datastore.


type: long
Expand All @@ -66917,15 +66971,65 @@ format: bytes

--

*`vsphere.datastore.capacity.used.pct`*::
*`vsphere.datastore.read.latency.total.ms`*::
+
--
Used percent of the datastore
Average amount of time for a read operation from the datastore in milliseconds.


type: scaled_float
type: long

format: percent
--

*`vsphere.datastore.status`*::
+
--
Status of the datastore.


type: keyword

--

*`vsphere.datastore.vm.count`*::
+
--
Number of VMs.


type: long

--

*`vsphere.datastore.vm.names`*::
+
--
List of all the VM names.


type: keyword

--

*`vsphere.datastore.write.bytes`*::
+
--
Rate of writing data to the datastore.


type: long

format: bytes

--

*`vsphere.datastore.write.latency.total.ms`*::
+
--
Average amount of time for a write operation from the datastore in milliseconds.


type: long

--

Expand Down
90 changes: 60 additions & 30 deletions metricbeat/module/vsphere/datastore/_meta/data.json
Original file line number Diff line number Diff line change
@@ -1,34 +1,64 @@
{
"@timestamp": "2017-10-12T08:05:34.853Z",
"event": {
"dataset": "vsphere.datastore",
"duration": 115000,
"module": "vsphere"
},
"metricset": {
"name": "datastore",
"period": 10000
},
"service": {
"address": "127.0.0.1:33365",
"type": "vsphere"
},
"vsphere": {
"datastore": {
"capacity": {
"free": {
"bytes": 37120094208
"@timestamp": "2017-10-12T08:05:34.853Z",
"event": {
"dataset": "vsphere.datastore",
"duration": 115000,
"module": "vsphere"
},
"metricset": {
"name": "datastore",
"period": 10000
},
"service": {
"address": "127.0.0.1:33365",
"type": "vsphere"
},
"vsphere": {
"datastore": {
"iops": 0,
"host": {
"count": 1,
"names": [
"DC3_H0"
]
},
"status": "green",
"vm": {
"count": 6,
"names": [
"DC3_H0_VM0"
]
},
"capacity": {
"free": {
"bytes": 37120094208
},
"total": {
"bytes": 74686664704
},
"used": {
"bytes": 37566570496,
"pct": 0.502988996026061
},
"read": {
"bytes": 0,
"latency": {
"total": {
"ms": 0
}
}
},
"total": {
"bytes": 74686664704
},
"used": {
"bytes": 37566570496,
"pct": 0.502988996026061
"write": {
"bytes": 337000,
"latency": {
"total": {
"ms": 0
}
}
}
},
"fstype": "local",
"name": "LocalDS_0"
}
}
},
"fstype": "local",
"name": "LocalDS_0"
}
}
}
70 changes: 56 additions & 14 deletions metricbeat/module/vsphere/datastore/_meta/fields.yml
Original file line number Diff line number Diff line change
Expand Up @@ -4,32 +4,74 @@
datastore
release: ga
harnish-elastic marked this conversation as resolved.
Show resolved Hide resolved
fields:
- name: name
type: keyword
description: >
Datastore name
- name: fstype
type: keyword
description: >
Filesystem type
- name: capacity.total.bytes
- name: capacity.free.bytes
type: long
description: >
Total bytes of the datastore
Free bytes of the datastore.
format: bytes
- name: capacity.free.bytes
- name: capacity.total.bytes
type: long
description: >
Free bytes of the datastore
Total bytes of the datastore.
format: bytes
- name: capacity.used.bytes
type: long
description: >
Used bytes of the datastore
Used bytes of the datastore.
format: bytes
- name: capacity.used.pct
type: scaled_float
description: >
Used percent of the datastore
Percentage of datastore capacity used.
format: percent
- name: fstype
type: keyword
description: >
Filesystem type.
- name: host.count
type: long
description: >
Number of hosts.
- name: host.names
type: keyword
description: >
List of all the host names.
- name: iops
type: long
description: >
Storage I/O Control aggregated Input/Output Operations Per Second.
- name: name
type: keyword
description: >
Datastore name.
- name: read.bytes
type: long
description: >
Rate of reading data from the datastore.
format: bytes
- name: read.latency.total.ms
type: long
description: >
Average amount of time for a read operation from the datastore in milliseconds.
- name: status
type: keyword
description: >
Status of the datastore.
- name: vm.count
type: long
description: >
Number of VMs.
- name: vm.names
type: keyword
description: >
List of all the VM names.
- name: write.bytes
type: long
description: >
Rate of writing data to the datastore.
format: bytes
- name: write.latency.total.ms
type: long
description: >
Average amount of time for a write operation from the datastore in milliseconds.

Loading
Loading