Best practice to retrieve/scroll large result sets from Elasticsearch

[lorthirk]

Currently Elasticsearch has a default limit of 10000 items when returning a query results. This limit could be hit, for instance, when we perform a Data query with a broad enough date range. We should investigate our options in order to find the best strategy to overcome, or at least increase, such limit.

Some Elasticsearch documentation:

• From / Size
• Scroll
• Search After