-
Notifications
You must be signed in to change notification settings - Fork 5.6k
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
feat(parsers.parquet): Add Apache Parquet Parser
fixes: #14785
- Loading branch information
Showing
36 changed files
with
674 additions
and
26 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,5 @@ | ||
| //go:build !custom || parsers || parsers.parquet | ||
|
|
||
| package all | ||
|
|
||
| import _ "github.com/influxdata/telegraf/plugins/parsers/parquet" // register plugin |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,54 @@ | ||
| # Parquet Parser Plugin | ||
|
|
||
| The Parquet parser allows for the parsing of Parquet files that were read in. | ||
|
|
||
| ## Configuration | ||
|
|
||
| ```toml | ||
| [[inputs.file]] | ||
| files = ["example"] | ||
|
|
||
| ## Data format to consume. | ||
| ## Each data format has its own unique set of configuration options, read | ||
| ## more about them here: | ||
| ## https://github.com/influxdata/telegraf/blob/master/docs/DATA_FORMATS_INPUT.md | ||
| data_format = "parquet" | ||
|
|
||
| ## Tag column is an array of columns that should be added as tags. | ||
| # tag_columns = [] | ||
|
|
||
| ## Name column is the column to use as the measurement name. | ||
| # measurement_column = "" | ||
|
|
||
| ## Timestamp column is the column containing the time that should be used to | ||
| ## create the metric. | ||
| # timestamp_column = "" | ||
|
|
||
| ## Timestamp format is the time layout that should be used to interpret the | ||
| ## timestamp_column. The time must be `unix`, `unix_ms`, `unix_us`, `unix_ns`, | ||
| ## or a time in the "reference time". To define a different format, arrange | ||
| ## the values from the "reference time" in the example to match the format | ||
| ## you will be using. For more information on the "reference time", visit | ||
| ## https://golang.org/pkg/time/#Time.Format | ||
| ## ex: json_time_format = "Mon Jan 2 15:04:05 -0700 MST 2006" | ||
| ## json_time_format = "2006-01-02T15:04:05Z07:00" | ||
| ## json_time_format = "01/02/2006 15:04:05" | ||
| ## json_time_format = "unix" | ||
| ## json_time_format = "unix_ms" | ||
| # timestamp_format = "" | ||
|
|
||
| ## Timezone allows you to provide an override for timestamps that | ||
| ## do not already include an offset | ||
| ## e.g. 04/06/2016 12:41:45 | ||
| ## | ||
| ## Default: "" which renders UTC | ||
| ## Options are as follows: | ||
| ## 1. Local -- interpret based on machine localtime | ||
| ## 2. "America/New_York" -- Unix TZ values like those found in | ||
| ## https://en.wikipedia.org/wiki/List_of_tz_database_time_zones | ||
| ## 3. UTC -- or blank/unspecified, will return timestamp in UTC | ||
| # timestamp_timezone = "" | ||
|
|
||
| ## Optional, default values for given tags | ||
| # tags = { "application": "hermes", "region": "central" } | ||
| ``` |
Oops, something went wrong.