-
Notifications
You must be signed in to change notification settings - Fork 120
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
[develop] Change the build log output file extension from log to txt #690
[develop] Change the build log output file extension from log to txt #690
Conversation
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Looks good to me.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@BruceKropp-Raytheon These changes look good to me!
@BruceKropp-Raytheon Due to the current communication issue between Jenkins and Jet, the Jet tests were aborted (why the However, I've noticed some weird behavior with the Publish artifacts to S3 Bucket entries for both Build and Test. It reports that access is denied and fails to push the artifacts to the S3 bucket:
Also, I'm not seeing the generation of a srw_build-${PLATFORM}-${COMPILER}.txt file or it's inclusion in the S3 bucket. I just want to make sure that everything looks correct on your end before merging this work in. Thanks! |
@BruceKropp-Raytheon I have merged @kbooker79's PR to update the path to the S3 bucket to the OAR account. Once you have merged the latest develop into your branch and corrected the conflicts, I will be able to move forward with these changes. Thanks! |
41c25f0
to
bd80d94
Compare
@BruceKropp-Raytheon Is there a specific reason that you closed this PR and opened PR #706? Since the approvals have been given and testing completed in this PR, it would be best to continue within this PR rather than open a new one. Please close PR #706 and reopen this PR, and I can move forward with merging this work. Please let me know if there are issues with doing so. Thank you very much. |
Reopening previously reviewed PR. So long as the necessary changes are available, will merge this work into develop. |
@BruceKropp-Raytheon The changes in this PR are identical to those in PR #706. I will move forward with merging these changes to develop now. Thank you very much! |
* [develop] Adds a YAML interface for creating a Rocoto XML. (ufs-community#676) Refactors the creation of a Rocoto XML to use a very generic Jinja2 template that is flexible enough to meet the needs of various workflow configurations supported by SRW. Specifically, it allows for a completely arbitrary workflow to be created under SRW, which includes the addition of completely arbitrary tasks on top of the predefined ones. --------- Co-authored-by: Michael Kavulich <kavulich@ucar.edu> * [develop] Change the build log output file extension from log to txt (ufs-community#690) When pipeline files are archived to s3 bucket, retrieving the file via a browser attempts to render/display files of known extensions. A browser doesn't generally understand what to do with a .log extension (e.g. build.log). For ease of use in the CI Dashboard, which is a static HTML page, the s3 archived build log needs a .txt extension (e.g. build.txt). * Add "MET_TOOL" definitions to new XML definition YAMLs * Fix incorrect YAML if block in config_defaults, remove non-needed "USCORE_ENSMEM_NAME_OR_NULL" variable * - Convert new test "MET_ensemble_verification_only_vx" to new YAML format - Fix f-string for utils.py error message * Fixing more failures (still more to go) * More fixes, got stand-alone verification test to pass! - Fix copy-paste errors in parm/workflow yamls - Update corrected variables for new names in exscripts * Improvement for monitor jobs script: if in debug mode, print the number of tasks that succeeded and failed for failed experiments * Forgot to include VX_FCST_INPUT_DIR definition for MET_ensemble_verification_only_vx test * Correct script for task_run_MET_EnsembleStat_vx_APCP * Pull out CATE and ENSMEM_INDEX from default VX_FCST_INPUT_DIR. My naive attempt to simplify things was the root of all my problems! * Everything working! Just need to solve problem of non-existent metatask dependencies! * Fix last failing ensemble test, fundamental tests and all verification tests now pass on Hera! --------- Co-authored-by: Christina Holt <56881914+christinaholtNOAA@users.noreply.github.com> Co-authored-by: Bruce Kropp - Raytheon <104453151+BruceKropp-Raytheon@users.noreply.github.com>
DESCRIPTION OF CHANGES:
When pipeline files are archived to s3 bucket, retrieving the file via a browser attempts to render/display files of known extensions. A browser doesn't generally understand what to do with a .log extension (e.g. build.log). For ease of use in the CI Dashboard, which is a static HTML page, the s3 archived build log needs a .txt extension (e.g. build.txt).
Type of change
TESTS CONDUCTED:
This is CI/CD support, not model or app code. The resulting build log (.txt) was viewed within a browser following manual steps.
DEPENDENCIES:
would need a pipeline PR build stage (test stage not required) to see that the correct file extension is applied
DOCUMENTATION:
Any material that mentions the build log filename explicitly, in form of: srw_build-${PLATFORM}-${COMPILER}.log
ISSUE:
CHECKLIST
LABELS (optional):
A Code Manager needs to add the following labels to this PR:
CONTRIBUTORS (optional):