-
Notifications
You must be signed in to change notification settings - Fork 2
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Integrate new provenance.py
script into operational deployment to tag products with Provenance information
#141
Comments
provence.py
script into operational deployment to tag products with Provenance informationprovenance.py
script into operational deployment to tag products with Provenance information
Steps to migrate:
We need to re-index because the documents have been previously indexed (that sounds obvious, isn't it). What that does mean is: if the schema is updated that does not apply on document previously indexed. This should be done in a script because that will need to be applied every build as we are expecting upgrades of the registry schema. Overall we want to re-analyze how the provenance/all/latest feature is managed in the registry so to have an acceptable robustness/availability of the registries. |
@jimmie wrapping up documentation today. then heading onto schema updates |
all sub-tasks completed. demoed at 2/23 sprint review and a couple minor tweaks to be wrapped up today |
💡 Description
Follow-on to:
Need to setup cron or lambda function or ??? to run on semi-regular cadence (every 45 minutes?) to update the operational indexes with the appropriate
superseded_by
metadata.Rationale for 45 minute cadence:
Per discussion on NASA-PDS/registry-api#441, the script takes ~15 minutes to run on a few million products, so 45 minutes should give us plenty of leeway. Additionally, we can then tell node folks to expect their products to be life through the API ~60 minutes after they tag the products for release using Registry Manager.
The text was updated successfully, but these errors were encountered: