Code

More work on getting Dataflow to run#9

Code

Merged

jbusecke merged 67 commits intomainleap-stc/eNATL_feedstock:mainfrom recipe-id-wo-underscoreleap-stc/eNATL_feedstock:recipe-id-wo-underscoreCopy head branch name to clipboardAug 23, 2024

+87-45

Commits

Commits on Jul 12, 2024

• Fix recipe_id naming

  jbusecke

  authored
  71140d0

  Copy full SHA for 71140d0

• Update catalog.yaml

  jbusecke

  authored
  1ed8bba

  Copy full SHA for 1ed8bba

• Update catalog.yaml

  jbusecke

  authored
  6c4f75d

  Copy full SHA for 6c4f75d

• Update meta.yaml

  jbusecke

  authored
  cc99385

  Copy full SHA for cc99385

• fix dependencies

  jbusecke

  authored
  d39ce90

  Copy full SHA for d39ce90

• bump pgf-recipes

  jbusecke

  authored
  66b4088

  Copy full SHA for 66b4088

• Update config_dataflow.py

  jbusecke

  authored
  6816b1a

  Copy full SHA for 6816b1a

• move final output to persistent bucket

  jbusecke

  authored
  92102ab

  Copy full SHA for 92102ab

• Re add logic for copy stage

  jbusecke

  authored
  363fb00

  Copy full SHA for 363fb00

• Update eNATL60.py

  jbusecke

  authored
  3c183f1

  Copy full SHA for 3c183f1

• remove prune and reduce machine size

  jbusecke

  authored
  e9ae02d

  Copy full SHA for e9ae02d

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for b19e7a3
  pre-commit-ci[bot]

  committed
  b19e7a3

  Copy full SHA for b19e7a3

• Update eNATL60.py

  jbusecke

  authored
  6152eb6

  Copy full SHA for 6152eb6

• Update eNATL60.py

  jbusecke

  authored
  57d68ed

  Copy full SHA for 57d68ed

• Update eNATL60.py

  jbusecke

  authored
  9e27af0

  Copy full SHA for 9e27af0

Commits on Jul 22, 2024

• Update config_dataflow.py

  jbusecke

  authored
  4f89453

  Copy full SHA for 4f89453

Commits on Jul 23, 2024

• Update eNATL60.py

  jbusecke

  authored
  4258766

  Copy full SHA for 4258766

• Update eNATL60.py

  jbusecke

  authored
  de123d0

  Copy full SHA for de123d0

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 558b7c0
  pre-commit-ci[bot]

  committed
  558b7c0

  Copy full SHA for 558b7c0

• Update eNATL60.py

  jbusecke

  authored
  ec2da10

  Copy full SHA for ec2da10

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for 49728c3
  pre-commit-ci[bot]

  committed
  49728c3

  Copy full SHA for 49728c3

• Update eNATL60.py

  jbusecke

  authored
  4f64075

  Copy full SHA for 4f64075

Commits on Aug 8, 2024

• converts cftime.DatetimeGregorian datetime64[ns]

  norlandrhagen

  committed
  dc648fd

  Copy full SHA for dc648fd

• pruned + job name

  norlandrhagen

  committed
  d3c8464

  Copy full SHA for d3c8464

• adds copy stage & echo

  norlandrhagen

  committed
  09ae870

  Copy full SHA for 09ae870

• noprune

  norlandrhagen

  committed
  f60775c

  Copy full SHA for f60775c

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for da43ea3
  pre-commit-ci[bot]

  committed
  da43ea3

  Copy full SHA for da43ea3

Commits on Aug 9, 2024

• hardcode dataflow name + prune

  norlandrhagen

  committed
  d9cf730

  Copy full SHA for d9cf730

• Merge branch 'recipe-id-wo-underscore' of https://github.com/leap-stc/eNATL_feedstock into recipe-id-wo-underscore

  norlandrhagen

  committed
  04c119b

  Copy full SHA for 04c119b

• 1 month + prod copy

  norlandrhagen

  committed
  6c592b7

  Copy full SHA for 6c592b7

• hardcode naming

  norlandrhagen

  committed
  15b4ad9

  Copy full SHA for 15b4ad9

• naming nit

  norlandrhagen

  committed
  f9d03e8

  Copy full SHA for f9d03e8

Commits on Aug 13, 2024

• max_concurrency=1 & prune off

  norlandrhagen

  committed
  72861b2

  Copy full SHA for 72861b2

• prune bool - does this work

  norlandrhagen

  committed
  023d13a

  Copy full SHA for 023d13a

• disable prime, add e2-highmem-4

  norlandrhagen

  committed
  47ecf4c

  Copy full SHA for 47ecf4c

• bump machine size

  norlandrhagen

  committed
  8ef929f

  Copy full SHA for 8ef929f

• new approach

  norlandrhagen

  committed
  4fb61ff

  Copy full SHA for 4fb61ff

• [pre-commit.ci] auto fixes from pre-commit.com hooks

  Show description for aff5758
  pre-commit-ci[bot]

  committed
  aff5758

  Copy full SHA for aff5758

• lint

  norlandrhagen

  committed
  84caede

  Copy full SHA for 84caede

• Merge branch 'recipe-id-wo-underscore' of https://github.com/leap-stc/eNATL_feedstock into recipe-id-wo-underscore

  norlandrhagen

  committed
  55a8a60

  Copy full SHA for 55a8a60

• pooch

  norlandrhagen

  committed
  39bfabe

  Copy full SHA for 39bfabe

• pooch 5 timesteps

  norlandrhagen

  committed
  8ce62e1

  Copy full SHA for 8ce62e1

• update reqs

  norlandrhagen

  committed
  4cb16c9

  Copy full SHA for 4cb16c9

• 5 to 32 days

  norlandrhagen

  committed
  4b18288

  Copy full SHA for 4b18288

Commits on Aug 14, 2024

• smaller worker

  norlandrhagen

  committed
  ee1dbaa

  Copy full SHA for ee1dbaa

• trying out ARM machine

  norlandrhagen

  committed
  7159713

  Copy full SHA for 7159713

• small standard worker

  norlandrhagen

  committed
  b7d28e3

  Copy full SHA for b7d28e3

• single worker + highmem

  norlandrhagen

  committed
  23a37a9

  Copy full SHA for 23a37a9

• task

  norlandrhagen

  committed
  4ddfd92

  Copy full SHA for 4ddfd92

• disk size

  norlandrhagen

  committed
  c529398

  Copy full SHA for c529398

• 300GB storage

  norlandrhagen

  committed
  5c41c75

  Copy full SHA for 5c41c75

• 120 days

  norlandrhagen

  committed
  95211e4

  Copy full SHA for 95211e4

• weird z3 machine

  norlandrhagen

  committed
  39b7d1f

  Copy full SHA for 39b7d1f

• region for z3

  norlandrhagen

  committed
  642af62

  Copy full SHA for 642af62

• use_shuffle = False + fork of runner with new opts

  norlandrhagen

  committed
  1f91f7a

  Copy full SHA for 1f91f7a

• nit

  norlandrhagen

  committed
  c2c8b80

  Copy full SHA for c2c8b80

• max_num_workers=1

  norlandrhagen

  committed
  26baa53

  Copy full SHA for 26baa53

• tmask

  norlandrhagen

  committed
  dcf3066

  Copy full SHA for dcf3066

• shuffle off retry + 34 days

  norlandrhagen

  committed
  aa09a95

  Copy full SHA for aa09a95

• nit

  norlandrhagen

  committed
  ff79c11

  Copy full SHA for ff79c11

• pruned version, no copy w/ shuffle and ssd

  norlandrhagen

  committed
  b9d9ea7

  Copy full SHA for b9d9ea7

• eNATL full recipe + shuffle no copy

  norlandrhagen

  committed
  99af8c6

  Copy full SHA for 99af8c6

• pooch concurrent test

  norlandrhagen

  committed
  53c6683

  Copy full SHA for 53c6683

Commits on Aug 15, 2024

• coord update

  norlandrhagen

  committed
  231d1de

  Copy full SHA for 231d1de

• 1 worker

  norlandrhagen

  committed
  8f3b264

  Copy full SHA for 8f3b264

• config update

  norlandrhagen

  committed
  5d32583

  Copy full SHA for 5d32583

Commits on Aug 22, 2024

• incorporate review + smaller worker + prune

  norlandrhagen

  committed
  1c33507

  Copy full SHA for 1c33507