Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Provide more performant storing options when importing geo data from maps #156858

Closed
Tracked by #154870
iverase opened this issue May 5, 2023 · 2 comments
Closed
Tracked by #154870
Labels
enhancement New value added to drive a business result Feature:Maps Team:Presentation Presentation Team for Dashboard, Input Controls, and Canvas

Comments

@iverase
Copy link

iverase commented May 5, 2023

Kibana maps currently supports importing geo data from geojson and shape files. In both cases it stores the geometry using a standard geo_shape field with the geometry encoded as geojson. This is probably not the most efficient way to store a geometry when it is going to be consumed by the vector tiles API so I propose to give some additional options on how to store them:

  • In Elasticsearch 8.8, it is possible to store a geometry as a store field (using store parameter set to true). The geometry is stored as WKB and the vector tiles will use that field if present as it is much faster to read the geometry from there. I wonder if we should give the option to the user to store the field, this will trade read performance from disk space.

  • Maybe when using a shape file, we can give the user the option to store the geometry as WKT. This format is more efficient to read from source than geojson. This is because when er read from source, we create an object model of the document in memory. In the case of geojson this means a lot of small allocations which is not GC friendly. In the case of WKT it is just allocating a string which is better when reading several documents.

@botelastic botelastic bot added the needs-team Issues missing a team label label May 5, 2023
@nreese nreese added enhancement New value added to drive a business result Team:Presentation Presentation Team for Dashboard, Input Controls, and Canvas Feature:Maps labels May 10, 2023
@elasticmachine
Copy link
Contributor

Pinging @elastic/kibana-presentation (Team:Presentation)

@botelastic botelastic bot removed the needs-team Issues missing a team label label May 10, 2023
@ThomThomson
Copy link
Contributor

Closing this and adding it to the maps icebox

@ThomThomson ThomThomson closed this as not planned Won't fix, can't repro, duplicate, stale Aug 24, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New value added to drive a business result Feature:Maps Team:Presentation Presentation Team for Dashboard, Input Controls, and Canvas
Projects
None yet
Development

No branches or pull requests

4 participants