Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Automatically enable metadata block when extracting metadata from FITS, NetCDF, or HDF5 #9410

Closed
pdurbin opened this issue Feb 27, 2023 · 3 comments
Labels
Feature: Geospatial pm.netcdf-hdf5.d All 3 aims are currently under this deliverable Size: 30 A percentage of a sprint. 21 hours. (formerly size:33)

Comments

@pdurbin
Copy link
Member

pdurbin commented Feb 27, 2023

  • if NetCDF/HDF5 detected and if lat/long
    • continue to create aux file
    • enable geospatial block
    • populate bounding box
  • if FITS
    • enable astro block
    • populate astro fields
  • if multiple files, create that many instances of the fields (e.g. bounding box)
@pdurbin pdurbin converted this from a draft issue Feb 27, 2023
@pdurbin pdurbin added the Size: 30 A percentage of a sprint. 21 hours. (formerly size:33) label Feb 27, 2023
@qqmyers
Copy link
Member

qqmyers commented Feb 27, 2023

This seems like it conflicts with the design of allowing collection admins to specify which blocks are on. Assuming one is OK with that:

  • if ~ingest becomes modular, can other plugins turn on other blocks?
  • if ~ingest is enhanced to allow it to be done remotely, I would expect Dataverse would get new metadata via the API - do we then need a special ~permission for ingesters to use the API (and turn on these blocks)?

Also - is there a potential interaction with #9388? I.e. I assume the reason that these blocks aren't on by default is because curators don't want users to see them. If these blocks were configured as system blocks, they would be hidden but would still be available (and in the future remote ingest would just need a key to add to them). This would also mean a key is required to change the values created automatically, which helps preserve the link between metadata and file contents but might also confuse users. A downside with the PR as is is that there is no way to have one block available for user input via the UI in some collections and to be protected/hidden in others and the astronomy and geospatial blocks today seem intended to serve both purposes (automated and manual inputs). Perhaps future work re #9388 could allow values added with a key to be protected while making it optional for manual/editable values to also be addable.

@mreekie mreekie added the pm.netcdf-hdf5.d All 3 aims are currently under this deliverable label Feb 28, 2023
@mreekie
Copy link

mreekie commented Feb 28, 2023

Grooming:

  • Added deliverable label

@cmbz
Copy link

cmbz commented Jan 8, 2024

2024/01/08: Closing due to complexity with UI and disagreement related to how automatic the process should be. We can reopen or create a new issue once the SPA Beta is available.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Feature: Geospatial pm.netcdf-hdf5.d All 3 aims are currently under this deliverable Size: 30 A percentage of a sprint. 21 hours. (formerly size:33)
Projects
None yet
Development

No branches or pull requests

4 participants