[develop:] update hpc-stack location for Gaea, miniconda3, Lmod initialization, Lua modulefiles #1617
Conversation
natalie-perlin
changed the title
jkbk2004
requested review from
BrianCurtis-NOAA,
DeniseWorthen,
jkbk2004 and
SadeghTabas-NOAA
|
@natalie-perlin if we use lua on gaea, do we need to keep ufs_gaea.intel and ufs_gaea.intel_debug? |
|
@natalie-perlin Is it ok to remove ufs_gaea.intel and ufs_gaea.intel_debug ? |
|
@jkbk2004 - yes, they have to be removed! |
|
@jkbk2004 - |
|
@natalie-perlin would you be able to answer Jong's question above and create PR to merge into Cameron's #1640 ? |
|
@natalie-perlin then clean up those unnecessary files, please! |
The files ufs_gaea.intel and ufs_gaea.intel_debug have been already removed in this PR! |
Oh! sorry about that. I was confused. |
There was a problem hiding this comment.
Also needs to be tested with Rocoto.
I'm working on these things now in the combined PR #1645
| @@ -15,7 +15,7 @@ echo -n " $( date +%s )," > job_timestamp.txt | |||
| cd $PBS_O_WORKDIR | |||
|
|
|||
| set +x | |||
| module use $( pwd -P ) | |||
| module use modulefiles | |||
There was a problem hiding this comment.
These should be absolute paths so that they'll still work if the directory changes.
| module use modulefiles | |
| module use $PWD/modulefiles |
| @@ -16,7 +16,7 @@ echo -n " $( date +%s )," > job_timestamp.txt | |||
| set +x | |||
| MACHINE_ID=hera | |||
| source ./module-setup.sh | |||
| module use $( pwd -P ) | |||
| module use modulefiles | |||
There was a problem hiding this comment.
This should use an absolute path so it'll still work if the directory changes.
| module use modulefiles | |
| module use $PWD/modulefiles |
| @@ -17,7 +17,7 @@ echo -n " $( date +%s )," > job_timestamp.txt | |||
| set +x | |||
| MACHINE_ID=jet | |||
| source ./module-setup.sh | |||
| module use $( pwd -P ) | |||
| module use modulefiles | |||
There was a problem hiding this comment.
This should use an absolute path so it'll still work if the directory changes.
| module use modulefiles | |
| module use $PWD/modulefiles |
Description
Location of the HPC-stack updated for Gaea, Lmod 8.7.12 initialization and miniconda3 loading for Gaea, transition to use of lua modulefiles. A correction to the use of Lmod for loading modulefiles for RT setup. All regression tests pass.
This PR addresses the following issues:
Software stack and miniconda3 location are updated for Gaea, which started in Issue-1465, resolved for all other Tier-1 platforms in RT-1596. An updated location for Gaea is
/lustre/f2/dev/role.epic/contrib/hpc-stack/intel-2021.3.0_noarch/modulefiles/stackLmod 8.7.12 initialization and module loading is properly set for Gaea. Modulefiles are transitioned to lua format.
A working directory for the RT now creates a separate directory for modulefiles, and is not mixed with all the input/output and setup data. It otherwise creates a problem for Lmod when a large number of non-modulefiles are found in a directory that is stored as $MODULEPATH environmental (added to MODULEPATH by "module use ").
All the Regression Tests pass on Gaea successfully, as could be viewed in
/lustre/f2/scratch/ncep/Natalie.Perlin/UFS-WM/ufs-wm-hpcepic/tests
/lustre/f2/scratch/role.epic/FV3_RT/rt_14526/
-->
Top of commit queue on: TBD
Input data additions/changes
Anticipated changes to regression tests:
Subcomponents involved:
Combined with PR's (If Applicable):
Commit Queue Checklist:
Linked PR's and Issues:
Testing Day Checklist:
Testing Log (for CM's):
RegressionTests_gaea.intel.log