Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Rollup] Support range aggregations #33041

Closed
polyfractal opened this issue Aug 21, 2018 · 4 comments
Closed

[Rollup] Support range aggregations #33041

polyfractal opened this issue Aug 21, 2018 · 4 comments
Labels
>enhancement :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)

Comments

@polyfractal
Copy link
Contributor

I think we can support some range aggregations on the existing data that we collect. E.g. if the ranges specify are compatible with the bucketing intervals collected by the date_histogram/histogram, ranges will work as expected.

We could also implement new groupings specifically for the range aggregation. It's a little less convenient, less efficient, and still has issues with bucket compatibility (there's no guarantee the ranges in the config match the ranges in the query).

@polyfractal polyfractal added >enhancement :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data labels Aug 21, 2018
@elasticmachine
Copy link
Collaborator

Pinging @elastic/es-search-aggs

@colings86
Copy link
Contributor

I think supporting ranges at query time is a good idea. I think we should separate out the index time question into a different issue as that requires more work and I'm personally not sure we could implement it in a way thats easy to explain to the user

@polyfractal
Copy link
Contributor Author

Agreed. Once we get #32052 merged, I think implementing query-time ranges should be reasonably straightforward. That PR does most of the heavy lifting wrt validating time intervals, so we can just piggyback on that and validate the ranges too.

@rjernst rjernst added the Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo) label May 4, 2020
@csoulios
Copy link
Contributor

The team discussed this issue and it looks this idea is far from the current approach for rollups/downsampling.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
>enhancement :StorageEngine/Rollup Turn fine-grained time-based data into coarser-grained data Team:Analytics Meta label for analytical engine team (ESQL/Aggs/Geo)
Projects
None yet
Development

No branches or pull requests

5 participants