Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

build with latest netcdf #166

Closed
aekiss opened this issue Sep 2, 2019 · 13 comments
Closed

build with latest netcdf #166

aekiss opened this issue Sep 2, 2019 · 13 comments
Assignees

Comments

@aekiss
Copy link
Contributor

aekiss commented Sep 2, 2019

from https://opus.nci.org.au/display/Help/Gadi%3A+NCI%27s+New+Supercomputer
"Only the latest versions of third-party software packages will be built and installed on the new HPC system."

so I guess we should get NCI to install netcdf 4.7.0 and build with that?

Also see #157, COSIMA/libaccessom2#24

@russfiedler
Copy link

Also if/when we decide to use PIO in CICE we'll need 4.7.0.

@aekiss
Copy link
Contributor Author

aekiss commented Sep 9, 2019

Update - netCDF 4.7.1 has now been released.
And version 4.5.1 of the netCDF-Fortran library.

@aekiss
Copy link
Contributor Author

aekiss commented Sep 9, 2019

@russfiedler: "PIO can use NetCDF (version 4.6.1+)": https://github.com/NCAR/ParallelIO

@aekiss
Copy link
Contributor Author

aekiss commented Sep 9, 2019

link to related PIO issue in CICE: COSIMA/cice5#34

@russfiedler
Copy link

@aekiss Actually, the problem is with the HDF5 library that NCI have linked V4.6.1 to. The bug is fixed in 1.10.4. It's likely we don't trigger the bug as it's related to processors failing to take part in the collective writes I think, but you never know...

https://groups.google.com/forum/#!topic/parallelio/LE7qnAlhP38

@aekiss
Copy link
Contributor Author

aekiss commented Sep 10, 2019

note to self: NetCDF 4.7.1. install request: https://track.nci.org.au/servicedesk/customer/portal/5/HELP-163544

@aekiss
Copy link
Contributor Author

aekiss commented Sep 11, 2019

The NetCDF version would need to be updated in numerous places:

${ACCESS_OM_DIR}/src/mom/bin/environs.nci
${ACCESS_OM_DIR}/src/cice5/bld/config.nci.auscom.360x300 
${ACCESS_OM_DIR}/src/cice5/bld/config.nci.auscom.1440x1080 
${ACCESS_OM_DIR}/src/cice5/bld/config.nci.auscom.3600x2700 
${ACCESS_OM_DIR}/src/libaccessom2/build_on_raijin.sh 
${ACCESS_OM_DIR}/src/libaccessom2/build/oasis3-mct-prefix/src/oasis3-mct/util/make_dir/config.nci

Have I missed anything?

libcheck.sh is intended to give us an overview of all this.

@aekiss
Copy link
Contributor Author

aekiss commented Sep 13, 2019

Netcdf 4.7.1 is now installed on raijin on top of hdf5/1.10.5. The parallel version, 4.7.1p (and hdf5/1.10.5p), is build with openmpi/4.0.1.

@nichannah nichannah self-assigned this Sep 20, 2019
@aekiss
Copy link
Contributor Author

aekiss commented Oct 23, 2019

Netcdf 4.7.1 was compiled with Intel 19 so the model components all need to be compiled with this version to use Netcdf 4.7.1.

@aekiss
Copy link
Contributor Author

aekiss commented Dec 3, 2019

#178 builds with
intel-compiler/2019.5.281
netcdf/4.7.1
openmpi/4.0.1

@aekiss
Copy link
Contributor Author

aekiss commented Apr 16, 2020

netCDF 4.7.3 is the latest currently installed on gadi, and we're currently compiling with netcdf/4.7.1
netCDF 4.7.4 was released on 2 April. Should we request this for gadi?
The latest NetCDF-Fortran release is v4.5.2 (newer than NetCDF-Fortran v4.5.1 that goes with netCDF 4.7.1).

@aekiss aekiss reopened this Apr 16, 2020
@aekiss
Copy link
Contributor Author

aekiss commented May 20, 2020

From @nichannah on slack

the latest version of netcdf (4.7.4) supports compression with parallel I/O writes

https://www.unidata.ucar.edu/software/netcdf/docs/RELEASE_NOTES.html#autotoc_md1
Compression will be great to have with PIO in CICE (COSIMA/cice5#34).

@aekiss
Copy link
Contributor Author

aekiss commented Nov 5, 2020

closing - we're now building access-om2 with netcdf/4.7.4 and netcdf/4.7.4p.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants