Error when installing MET-12.0.0-beta6 when compiling NetCDF-C

[jinfanti]

Hello!
I am installing an updated version of MET (MET-12.0.0-beta6) on one of our CPC systems, and have run into an error at the step where NetCDF-C compiles. This looks like the error noted in this discussion: #2010, but I have tried a number of the solutions in that discussion and the error persists. The error from the configure.log file is

configure: error: curl required for remote access. Install curl or build with --disable-dap.
And from the output in my terminal:

Compiling NetCDF-C at Wed Nov  6 21:26:17 UTC 2024
cd /cpc/met/MET11/MET-12.0.0-beta6/external_libs/netcdf/netcdf-c-4.7.4
./configure --prefix=/cpc/met/MET11/MET-12.0.0-beta6/external_libs CFLAGS=-fPIC CXXFLAGS=-fPIC LDFLAGS=-L/cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib CPPFLAGS=-I/cpc/met/MET11/MET-12.0.0-beta6/external_libs/include > configure.log 2>&1
configure returned with non-zero (1) status

My attempts at solving included (1) pointing to our internal install of curl by setting CURL_LIB_DIR and CURL_INC_DIR in install_met_env_cpc_clean.txt (see below), and modifying the corresponding line in the compile shell script. (2) Installing curl under external_libs and compiling (using the standard compile script with no modifications), (3) pointing to this new install of curl by setting CURL_LIB_DIR and CURL_INC_DIR and modifying the corresponding line in the compile shell script.

I attached a number of files, including my install script, an example of the compile script with the CURL_LIB_DIR and CULR_INC_DIR included, and the configure.log and config.log files found in the netcdf-c-4.7.4 directory. I would appreciate any help!!! Thank you!! Please let me know if I can provide any additional information. I have a number of other compile/install scripts I tried as well.

config.log
configure.log
install_met_env_cpc_clean.txt
compile_MET_all.new.curltest2.sh.txt

[jprestop]

Hi @jinfanti. Thanks for this information and for sending the files.

Can you please send the directory listing output of the following directories? (e.g. ls /cpc/prod/cpcfcst/software/miniconda-rh7/lib)

export CURL_LIB_DIR=/cpc/prod/cpcfcst/software/miniconda-rh7/lib
export CURL_INC_DIR=/cpc/prod/cpcfcst/software/miniconda-rh7/include

Also, I noticed you had previously set the following and then commented it out. Did you install curl in those locations also? If so, please send the directory listing output of those directories as well?

#export CURL_LIB_DIR=/cpc/met/MET11/MET-12.0.0-beta6/external_libs
#export CURL_INC_DIR=/cpc/met/MET11/MET-12.0.0-beta6/external_libs/include

Thanks!

[jinfanti]

Hi Julie! Thanks for the response.

1. Output from directories (I am just including output for curl since the directory listing is very long, but let me know if you want more information.

ls /cpc/prod/cpcfcst/software/miniconda-rh7/lib/*curl*
/cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.a   /cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.so.4
/cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.so  /cpc/prod/cpcfcst/software/miniconda-rh7/lib/libcurl.so.4.6.0

ls /cpc/prod/cpcfcst/software/miniconda-rh7/include/*curl*
curl.h  curlver.h  easy.h  mprintf.h  multi.h  stdcheaders.h  system.h  typecheck-gcc.h  urlapi.h

2. Yes I did install and test curl in that directory. I tested the compile with that install in a few ways, just a plain compile without explicitly pointing to the directories, and with explicit pointing. I have it commented out since I was trying to get it to point to our typical install instead of the one I did. Here is the output from these dirs. I may need to set these to /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/ and second one to /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include? But I'm also possibly not understanding.

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs
bin  bufrlib  curl  g2clib  gsl  hdf5  include  jasper  lib  libpng  man  netcdf  share  zlib

And just in the curl dir:

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0
acinclude.m4  buildconf.bat  CMakeLists.txt  config.log     configure     curl-config     docs        lib            libtool    MacOSX-Framework  Makefile.in  packages  README         src          winbuild
aclocal.m4    CHANGES        compile         config.status  configure.ac  curl-config.in  include     libcurl.pc     ltmain.sh  Makefile          maketgz      plan9     RELEASE-NOTES  test-driver
buildconf     CMake          config.guess    config.sub     COPYING       depcomp         install-sh  libcurl.pc.in  m4         Makefile.am       missing      projects  scripts        tests

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/include/
drstemplates.h   H5Apublic.h   H5Epublic.h   H5FDlog.h     H5FDros3.h      H5Gpublic.h   H5MMpublic.h  H5Ppublic.h   H5TBpublic.h              H5VLpassthru.h  libpng16        zlib.h
grib2.h          H5Cpublic.h   H5ESpublic.h  H5FDmirror.h  H5FDsec2.h      H5IMpublic.h  H5Mpublic.h   H5PTpublic.h  H5Tpublic.h               H5VLpublic.h    pdstemplates.h
gridtemplates.h  H5DOpublic.h  H5FDcore.h    H5FDmpi.h     H5FDsplitter.h  H5Ipublic.h   H5Opublic.h   H5pubconf.h   H5version.h               H5Zpublic.h     pngconf.h
gsl              H5Dpublic.h   H5FDdirect.h  H5FDmpio.h    H5FDstdio.h     H5LDpublic.h  H5overflow.h  H5public.h    H5VLconnector.h           hdf5.h          png.h
H5ACpublic.h     H5DSpublic.h  H5FDfamily.h  H5FDmulti.h   H5FDwindows.h   H5Lpublic.h   H5PLextern.h  H5Rpublic.h   H5VLconnector_passthru.h  hdf5_hl.h       pnglibconf.h
H5api_adpt.h     H5Epubgen.h   H5FDhdfs.h    H5FDpublic.h  H5Fpublic.h     H5LTpublic.h  H5PLpublic.h  H5Spublic.h   H5VLnative.h              jasper          zconf.h

[jprestop]

Thank you for this information.

Could you also please send the output of the directory listing for the following?

• /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib
• /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/
• /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include

Thank you! I will be out of the office tomorrow, just FYI.

[jinfanti]

Sure!! See below and have a great day off and weekend :)

/cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib

 ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib
libbufr.a       libgslcblas.so        libgsl.so.19      libhdf5_hl.so          libhdf5.so          libpng16.a           libpng.a   libz.so.1.2.11
libgrib2c.a     libgslcblas.so.0      libgsl.so.19.0.0  libhdf5_hl.so.200      libhdf5.so.200      libpng16.la          libpng.la  pkgconfig
libgsl.a        libgslcblas.so.0.0.0  libhdf5.a         libhdf5_hl.so.200.1.0  libhdf5.so.200.2.0  libpng16.so          libpng.so
libgslcblas.a   libgsl.la             libhdf5_hl.a      libhdf5.la             libjasper.a         libpng16.so.16       libz.so
libgslcblas.la  libgsl.so             libhdf5_hl.la     libhdf5.settings       libjasper.la        libpng16.so.16.37.0  libz.so.1

/cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/
acinclude.m4   CMake           config.status  curl-config     install-sh     ltmain.sh         Makefile.in  projects       test-driver
aclocal.m4     CMakeLists.txt  config.sub     curl-config.in  lib            m4                maketgz      README         tests
buildconf      compile         configure      depcomp         libcurl.pc     MacOSX-Framework  missing      RELEASE-NOTES  winbuild
buildconf.bat  config.guess    configure.ac   docs            libcurl.pc.in  Makefile          packages     scripts
CHANGES        config.log      COPYING        include         libtool        Makefile.am       plan9        src

/cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include
curl  Makefile  Makefile.am  Makefile.in  README.md

And just in case ....
/cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include/curl/

ls /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include/curl/
curl.h     easy.h    Makefile     Makefile.in  multi.h    stdcheaders.h  typecheck-gcc.h  websockets.h
curlver.h  header.h  Makefile.am  mprintf.h    options.h  system.h       urlapi.h

[jprestop]

Hi @jinfanti. My sincere apologies for the long delay in getting back to you. Thank you for your patience.

Thank you so much for sending the contents of "/cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include/curl/" as well.

Could you please run the following commands?

cp /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/include/curl/* /cpc/met/MET11/MET-12.0.0-beta6/external_libs/include
cp /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/lib/* /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib

Then, set the following in the configuration file for compile_MET_all.sh:

export CURL_LIB_DIR=/cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib
export CURL_INC_DIR=/cpc/met/MET11/MET-12.0.0-beta6/external_libs/include

Getting those files copied over to the include and lib subdirectories in the external_libs subdirectories should allow them to be found. Using the curl available in miniconda may also be ok but I worry about potential netCDF/HDF conflicts.

On a separate note, please modify:

export COMPILER=gnu_4.8.5

to be

export COMPILER=gnu_8.5.0

I see in your config.log file that GNU 8.5.0 is being used:

configure:5012: gcc --version >&5
gcc (GCC) 8.5.0 20210514 (Red Hat 8.5.0-22)

Then, please try rerunning the compilation script and let us know how it goes.

[jinfanti]

Hey Julie! Thanks you again so much for the response - unfortunately I'm still getting the same error related to curl :(

1. Here is the output from the directories after copying the files as suggested above (just including the output for curl) - It definitely looks like what should be in these dirs is there now... Note for anyone who may look at this later, for the cp I did need to use:
   cp -r /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/lib/* /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib

ls -lh /cpc/met/MET11/MET-12.0.0-beta6/external_libs/include/*curl*
-rw-r--r--. 1 jinfanti wd5 125K Nov 21 19:33 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/include/curl.h
-rw-r--r--. 1 jinfanti wd5 3.0K Nov 21 19:33 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/include/curlver.h

ls -lh /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/*curl*
-rw-r--r--. 1 jinfanti wd5  16K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_addrinfo.c
-rw-r--r--. 1 jinfanti wd5 3.3K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_addrinfo.h
-rw-r--r--. 1 jinfanti wd5 1.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_base64.h
-rw-rw-r--. 1 jinfanti wd5  26K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_config.h
-rw-r--r--. 1 jinfanti wd5  22K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_config.h.cmake
-rw-r--r--. 1 jinfanti wd5  24K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_config.h.in
-rw-r--r--. 1 jinfanti wd5 2.0K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_ctype.h
-rw-r--r--. 1 jinfanti wd5 2.2K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_des.c
-rw-r--r--. 1 jinfanti wd5 1.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_des.h
-rw-r--r--. 1 jinfanti wd5 2.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_endian.c
-rw-r--r--. 1 jinfanti wd5 1.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_endian.h
-rw-r--r--. 1 jinfanti wd5  11K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_fnmatch.c
-rw-r--r--. 1 jinfanti wd5 1.8K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_fnmatch.h
-rw-r--r--. 1 jinfanti wd5 3.2K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_gethostname.c
-rw-r--r--. 1 jinfanti wd5 1.4K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_gethostname.h
-rw-r--r--. 1 jinfanti wd5 2.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_get_line.c
-rw-r--r--. 1 jinfanti wd5 1.3K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_get_line.h
-rw-r--r--. 1 jinfanti wd5 4.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_gssapi.c
-rw-r--r--. 1 jinfanti wd5 2.2K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_gssapi.h
-rw-r--r--. 1 jinfanti wd5 2.9K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_hmac.h
-rw-r--r--. 1 jinfanti wd5 1.9K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_krb5.h
-rw-r--r--. 1 jinfanti wd5 1.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_ldap.h
-rw-r--r--. 1 jinfanti wd5 1.4K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_md4.h
-rw-r--r--. 1 jinfanti wd5 2.6K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_md5.h
-rw-r--r--. 1 jinfanti wd5 6.1K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_memory.h
-rw-r--r--. 1 jinfanti wd5 1.8K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_memrchr.c
-rw-r--r--. 1 jinfanti wd5 1.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_memrchr.h
-rw-r--r--. 1 jinfanti wd5 4.4K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_multibyte.c
-rw-r--r--. 1 jinfanti wd5 3.4K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_multibyte.h
-rw-r--r--. 1 jinfanti wd5  21K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_ntlm_core.c
-rw-r--r--. 1 jinfanti wd5 3.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_ntlm_core.h
-rw-r--r--. 1 jinfanti wd5  15K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_ntlm_wb.c
-rw-r--r--. 1 jinfanti wd5 1.8K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_ntlm_wb.h
-rw-r--r--. 1 jinfanti wd5 6.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_path.c
-rw-r--r--. 1 jinfanti wd5 1.7K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_path.h
-rw-r--r--. 1 jinfanti wd5 1.7K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_printf.h
-rw-r--r--. 1 jinfanti wd5 3.2K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_range.c
-rw-r--r--. 1 jinfanti wd5 1.3K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_range.h
-rw-r--r--. 1 jinfanti wd5  13K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_rtmp.c
-rw-r--r--. 1 jinfanti wd5 1.5K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_rtmp.h
-rw-r--r--. 1 jinfanti wd5  24K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_sasl.c
-rw-r--r--. 1 jinfanti wd5 6.4K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_sasl.h
-rw-r--r--. 1 jinfanti wd5  24K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_setup.h
-rw-r--r--. 1 jinfanti wd5  12K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_setup_once.h
-rw-r--r--. 1 jinfanti wd5 1.7K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_sha256.h
-rw-r--r--. 1 jinfanti wd5 7.1K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_sspi.c
-rw-r--r--. 1 jinfanti wd5  12K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_sspi.h
-rw-r--r--. 1 jinfanti wd5 3.8K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_threads.c
-rw-r--r--. 1 jinfanti wd5 2.7K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curl_threads.h
-rw-r--r--. 1 jinfanti wd5 3.7K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/curlx.h
-rw-rw-r--. 1 jinfanti wd5  778 Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/libcurl.plist
-rw-r--r--. 1 jinfanti wd5  820 Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/libcurl.plist.in
-rw-r--r--. 1 jinfanti wd5 2.2K Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/libcurl.rc
-rw-rw-r--. 1 jinfanti wd5   97 Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/libcurl.vers
-rw-r--r--. 1 jinfanti wd5  130 Nov 21 19:34 /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/libcurl.vers.in

2. I changed the compiler and added the two lines you noted to the "install_met_env_cpc_clean.txt" file (and you can see I tried a few other options as well per my commenting in and out of export statements!).

Attached again the files. So strange it cant seem to find curl!!

configure.log
config.log
install_met_env_cpc_clean.txt
compile_MET_all.new.curltest2.sh (2).txt

(Apologies for the deleted comment, I wrote this in the wrong spot on github initially!)

[jprestop]

Hi @jinfanti. Thank you for this information.

I had you run the command:

cp -r /cpc/met/MET11/MET-12.0.0-beta6/external_libs/curl/curl-7.87.0/lib/* /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib 

and from the curl output that you listed that now exists in:

/cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/*curl*

It looks like the curl library did not build successfully, as I do not see files of this sort:

libcurl.a
libcurl.so

Thankfully, this explains why the curl library can still not be found.

Please run these commands to compile and install curl, then try compiling MET again, and let us know how it goes.

rm /cpc/met/MET11/MET-12.0.0-beta6/external_libs/include/*curl*
rm /cpc/met/MET11/MET-12.0.0-beta6/external_libs/lib/*curl*
cd /cpc/met/MET11/MET-12.0.0-beta6/external_libs
mkdir curl
cd curl
wget https://curl.se/download/curl-8.1.0.tar.gz
tar -zxf curl-8.1.0.tar.gz
cd curl-8.1.0
./configure --prefix=/cpc/met/MET11/MET-12.0.0-beta6/external_libs --without-ssl
make install > & make_install.curl.log

Hopefully, this will take care of everything and you'll get a successful installation of MET!

[jinfanti]

Julie, I'll do some testing and make sure everything is good to go with the install. Since this was a series of problems I'll try and write up a summary answer to mark. THANK YOU SO MUCH!!!!

[jprestop]

That sounds great, Johnna, thank you!

[jinfanti]

Hi @jprestop
Bad news :( I think the compile went fine but I'm running into problems when I run METplus using Python Embedding. I took a look through the other discussions and I think I may need to recompile with some additional settings.

The error I'm getting is:

01/21 20:17:09.084Z metplus (command_runner.py:122) DEBUG: log_name is: grid_stat, output sent to: /cpc/home/jinfanti/MET/S2S/nmme_dev/nmme_met_development/output1/logs/metplus.log.20250121201709
OUTPUT:
DEBUG 1: Start grid_stat by jinfanti(1074) at 2025-01-21 20:17:09Z  cmd: /cpc/met/MET12/MET-12.0.0-rc1/bin/grid_stat -v 2 PYTHON_NUMPY PYTHON_NUMPY /cpc/met/MET11/METplus-5.0.1/parm/met_config/GridStatConfig_wrapped -outdir /cpc/home/jinfanti/MET/S2S/nmme_dev/nmme_met_development/output1/NMME/prate/GridStat
DEBUG 2: OpenMP running on 1 thread(s).
DEBUG 1: Default Config File: /cpc/met/MET12/MET-12.0.0-rc1/share/met/config/GridStatConfig_default
DEBUG 1: User Config File: /cpc/met/MET11/METplus-5.0.1/parm/met_config/GridStatConfig_wrapped
Traceback (most recent call last):
  File "/cpc/met/MET12/MET-12.0.0-rc1/share/met/python/met/dataplane.py", line 4, in <module>
    import numpy as np
ModuleNotFoundError: No module named 'numpy'

I tried setting my MET_PYTHON_EXE to:
MET_PYTHON_EXE=/cpc/met/MET11/python-env/bin/python

And it gets slightly further into the process but eventually comes up with the same error related to dataplane.

I'm wondering if its my conda environment(s) that are the issue here. When I installed MET12 I needed some packages that were not natively installed on our systems, like cmake, so I made a new python environment with cmake included. We also have a different conda environment that has the suggested packages installed to use MET and METplus, like numpy, xarray, etc, that we use when running METplus.

Could this be causing an issue, if I compiled with one environment and then run using a different one?

[jprestop]

Hi @jinfanti. I'm sorry you're still troubleshooting.

If you run simply:

/cpc/met/MET11/python-env/bin/python

and then run

import numpy

Does numpy load?

Is the python at /cpc/met/MET11/python-env/ the same Python you used to compile MET with? If not, that is ok, but please see this section in our documentation with the Python packages needed when installing MET. If you used a different version of Python to compile MET, please load that version of Python and try running import numpy and see if numpy loads.

Also, it looks like you're using METplus-5.0.1, however, if you're using MET-12.0.0-rc1, please use the METplus-6.0.0-rc1 release as well.

[jinfanti]

Hi, sorry I meant to add that information in my original post, but that conda environment (/cpc/met/MET11/python-env/) does have numpy installed, so I'm not sure why it can't find it. I tried a few different environments (all of which with numpy) and pointing to MET_PYTHON_EXE accordingly and no luck.

I did use a different environment to compile MET vs. running it, so I will double check the numpy situation with the env I used to compile.
If I dont get anywhere with that I'll look at the documentation you linked and see if I need to add anything to the conda env I used for the compile and re-compile. I'll also grab METplus-6.0.0.-rc1!! I'll report back once I make those changes.

Thanks again!