Metadata

[zacdezgeo]

What's changed

• Metadata additions: Created a STAC catalog from parquet source file.
• New metadata files: Added STAC metadata files, including catalog.json, sources.json, and space2stats.json.
• Notebook updates: Added a notebook (metadata.ipynb) to handle metadata generation for Space2Stats.

How to test it

1. Open the metadata.ipynb notebook and run the cells to generate the STAC catalog.
2. Validate the metadata files in the stac folder for completeness and accuracy.
3. Run stac-check on the generated STAC catalog to verify metadata compliance.

Other Notes

• Closes Metadata needs research #15

[zacdezgeo]

@andresfchamorro, feel free to update the description or add comments here.

[zacdezgeo]

This is looking great @andresfchamorro! The only change requested is moving the folder to a better location.

I see three points where the metadata could come into play:

1. Letting a user browse the metadata and understand the dataset better - could be accomplished via a copy to the STAC browser. It would require that the copy be updated regularly. I tried using the GitHub repo file link directly and got a CORS error.
2. Retrieving fields—After discussing this with @alukach, I propose we continue relying on the database directly to retrieve the available list of fields.
3. Ensure consistency between metadata and data upon ingestion (Add checks to ensure data and metadata are in sync upon ingestion #73) - We should add some checks to avoid any drift between the metadata and underlying data in the database. This would make two more sensible.

[zacdezgeo]

@andresfchamorro @alukach; just need a ✅ to merge

[andresfchamorro]

@zacharyDez Did you make these changes manually, or can you update the notebook so that we don't recreate it in the future without these changes?

[andresfchamorro]

Somehow the content on catalog description and purpose got trimmed too...

[andresfchamorro]

ok i think i fixed what I mentioned in the comments so I will merge now :) also copied it to gh-pages so we can view it here: https://radiantearth.github.io/stac-browser/#/external/worldbank.github.io/DECAT_Space2Stats/stac/catalog.json?.language=en