Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Don't compress MOM outputs/restarts until collation #168

Closed
aekiss opened this issue Oct 3, 2019 · 1 comment
Closed

Don't compress MOM outputs/restarts until collation #168

aekiss opened this issue Oct 3, 2019 · 1 comment

Comments

@aekiss
Copy link
Contributor

aekiss commented Oct 3, 2019

It's probably better to compress outputs and restarts in the collation step to avoid the overhead of compressing in MOM and then decompressing and recompressing in mppnccombine. This also reduces the need for mppnccombine-fast.

Requires deflate_level=-1 in input.nml and restart: True in the collation section of config.yaml. mppnccombine will compress by default.
aekiss added a commit to COSIMA/01deg_jra55_iaf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
2e1839a 
…m2#168
aekiss added a commit to COSIMA/01deg_jra55_ryf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
ad006bd 
…m2#168
aekiss added a commit to COSIMA/025deg_core2_nyf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
5079e88 
…m2#168
aekiss added a commit to COSIMA/025deg_jra55_iaf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
fca9b84 
…m2#168
aekiss added a commit to COSIMA/025deg_jra55_ryf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
7776385 
…m2#168
aekiss added a commit to COSIMA/1deg_core_nyf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
3859366 
…m2#168
aekiss added a commit to COSIMA/1deg_jra55_iaf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
55837b7 
…m2#168
aekiss added a commit to COSIMA/1deg_jra55_ryf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
cfbe4d8 
…m2#168
aekiss added a commit to COSIMA/minimal_01deg_jra55_iaf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
3e4cc3a 
…m2#168
aekiss added a commit to COSIMA/minimal_01deg_jra55_ryf that referenced this issue Oct 3, 2019
@aekiss
Don't compress MOM outputs/restarts until collation - COSIMA/access-o…
c8f8cc4 
…m2#168
@aekiss aekiss closed this as completed Oct 3, 2019
This was referenced Dec 16, 2019
Merged
Merged
Merged
Merged
Merged
Merged
@aekiss
Copy link
Contributor Author

aekiss commented Apr 28, 2020 •
edited
Loading

also see #154 - at 0.1 deg and 0.25 deg we now compress output and use mppnccombine-fast

@aekiss aekiss mentioned this issue Apr 28, 2020
Closed
aekiss added a commit to COSIMA/01deg_jra55_iaf that referenced this issue Apr 28, 2020
@aekiss
compress MOM outputs and collate with mppnccombine-fast - see COSIMA/…
e48a117 
…access-om2#154 and COSIMA/access-om2#168
aekiss added a commit to COSIMA/01deg_jra55_ryf that referenced this issue Apr 28, 2020
@aekiss
compress MOM outputs and collate with mppnccombine-fast - see COSIMA/…
9e8b4be 
…access-om2#154 and COSIMA/access-om2#168
aekiss added a commit to COSIMA/025deg_jra55_iaf that referenced this issue Apr 29, 2020
@aekiss
compress MOM outputs and collate with mppnccombine-fast - see COSIMA/…
f17f045 
…access-om2#154 and COSIMA/access-om2#168
aekiss added a commit to COSIMA/025deg_jra55_ryf that referenced this issue Apr 29, 2020
@aekiss
compress MOM outputs and collate with mppnccombine-fast - see COSIMA/…
fc3400c 
…access-om2#154 and COSIMA/access-om2#168
aekiss added a commit to COSIMA/1deg_jra55_iaf that referenced this issue Apr 29, 2020
@aekiss
compress restarts - see COSIMA/access-om2#168
cf26870
aekiss added a commit to COSIMA/1deg_jra55_ryf that referenced this issue Apr 29, 2020
@aekiss
compress restarts - see COSIMA/access-om2#168
ca954a9
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@aekiss