Catalog metadata checkums/DSWx ISO metadata creation #76
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Closed
JimHofman
reviewed
Mar 29, 2022
JimHofman
reviewed
Mar 29, 2022
JimHofman
reviewed
Mar 29, 2022
JimHofman
reviewed
Mar 29, 2022
JimHofman
reviewed
Mar 29, 2022
JimHofman
reviewed
Mar 29, 2022
| rendered_template = render_jinja2(iso_template_path, iso_metadata, self.logger) | ||
|
|
||
| return rendered_template | ||
|
|
JimHofman
reviewed
Mar 30, 2022
| output_product_path = abspath(self.output_product_path) | ||
| output_products = [join(output_product_path, filename) | ||
| for filename in os.listdir(output_product_path) | ||
| if isfile(join(output_product_path, filename))] |
There was a problem hiding this comment.
I guess I better get used to this pattern.
JimHofman
reviewed
Mar 30, 2022
| catalog_metadata = { | ||
| 'PGE_Name': "BASE_PGE_TEST", | ||
| 'PGE_Version': "1.0.test", | ||
| 'SAS_Version': "2.0.test", | ||
| 'Input_Files': ["input/input_file01.h5", "input/input_file02.h5"], | ||
| 'Ancillary_Files': ["input/input_dem.vrt"], | ||
| 'Production_DateTime': "2022-01-20T12:07:10.9143060000Z" |
added 9 commits
March 30, 2022 10:14
…l object, added caching of metadata obtained from a tif file, and modified get_hls_filename_fields() to match file name format expected within geotiff metadata
…than have it handle file I/O step as well
…tive to expected template location within repository
…e_pge.PostProcessorMixin While base_pge.py now contains the hooks for ISO metadata generation, the base PgeExecutor class itself does not generate ISO metadata.
The DSWx-HLS ISO metadata is collected from the runconfig, output product(s) and catalog metdata, and then used to render the ISO jinja2 template. dswx_pge.py then relies on inherited functionality from base_pge.py for writing the actual metadata XML file to disk.
collinss-jpl
force-pushed
the
72_iso_metadata_collection
branch
from
4f81a1e to
dc9491c
Compare
|
I checked the changes and it all looks good. |
JimHofman
approved these changes
Mar 30, 2022
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR wraps up work for two tickets, one to add MD5 checksums for output products to the catalog metadata, and another to add ISO metadata creation support to the DSWx-HLS PGE.
The necessary metadata for the ISO template is collected by the
_create_iso_metadata()implementation within DSWxPostProcessorMixin. The rendered version of the template is returned by this method, from which the base implementation of_stage_output_files()inbase_pge.pyhandles the output of the file to disk.Closes #72
Closes #73