Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Crawl extension #502

Open
gadomski opened this issue Oct 29, 2024 · 0 comments
Open

Crawl extension #502

gadomski opened this issue Oct 29, 2024 · 0 comments
Labels
[crate] extensions stac-extensions enhancement New feature or request

Comments

@gadomski
Copy link
Member

gadomski commented Oct 29, 2024

Over at https://github.com/gadomski/heystac I've implemented rudimentary crawling:

  • Visit each child catalog and collection
  • For each collection, fetch one item either from its item links or from its items endpoint

This seems generalizable to an extension, since the output could be useful it if were structured (things like crawl:start_datetime and crawl:end_datetime, roundtrip request times, etc). We should implement in stac-extensions, write up a spec and a json-schema for it, and then maybe make it its own https://github.com/stac-extensions.

@gadomski gadomski added enhancement New feature or request [crate] extensions stac-extensions labels Oct 29, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
[crate] extensions stac-extensions enhancement New feature or request
Projects
None yet
Development

No branches or pull requests

1 participant