pypromicev1.4.0 (without squashing commits) #294
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This reverts commit af09818.
get_l2 were previously also loading vars and meta in addition to AWS. AWS is populating meta with source information during instantiation.
…tadata files * Refactor getVar getMeta * Use pypromice.resources instaed of pkg_resources
The format string was previously selected from the last l0 file.
* Added test case for output meta data * Added json formatted source string to attributes * Added title string to attributes * Updated ID string to include level * Added utility function for fetching git commit id
* Added test station configuration * Cleanup test data files
* Added data issues path to process_test.yml
Validate attribute keys in e2e test
* passing adjustment_dir to L2toL3.py * fixing attributes in join_l3 - station_attribute containing info from merged dataset was lost when concatenating the datasets - The key "source" is not present in the attributes of the old GC-Net files so `station_source = json.loads(station_attributes["source"])` was throwing an error * give data_issues_path to get_l2tol3 in test_process * using data_adjustments_dir as input in AWS.getL3 * adding path to dummy data_issues folder to process_test * making sure data_issues_path is Path in get_l2tol3
This was referenced Aug 27, 2024
Closed
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Bringing all changes from develop to main branch:
Producing data in its new structure: level 2 statin data + level 3 site data
fixing #246, #247, #175
Merging of data from different stations at the same site + historical GC-Net station data are appended to GEUS GC-Net station data
fixing #175
Calculation of gap-free and smoothed
lat,lonandaltand mean coords as attributesfixing #236, #173, #124
Calculation of a continuous surface height, ice surface height and snow height variables
z_surf_combined,z_ice_surfandsnow_heightfixing #10
Calculation of the thermistors' depth
fixing #248
Reading station configutation files from
AWS-L0/metadata/station_configurationfixing #217
Updating metadata CSV automatically
fixing #142
Also: