Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

🚸 Walkthrough on handling multi-resolution climate data #91

Merged
merged 7 commits into from
Apr 17, 2023

Conversation

weiji14
Copy link
Owner

@weiji14 weiji14 commented Apr 5, 2023

Tutorial on loading climate datasets with different spatial resolutions for a super-resolution task. Will be looking at one of the CMIP6 model outputs and CarbonPlan's super-resolution (DeepSD) product.

Preview at https://zen3geo--91.org.readthedocs.build/en/91/multi-resolution.html

Maximum temperature from a Global Climate Model output versus a super-resolution downscaled output

TODO:

  • Show how to load Zarr datasets using xarray
  • Stack different spatial resolution datasets into an xarray.DataTree
  • Slice the xarray.DataTree into chips

References:

Initial draft tutorial on loading climate datasets with different spatial resolutions for a super-resolution task. Will be looking at one of the CMIP6 model outputs and CarbonPlan's super-resolution (DeepSD) product.
@weiji14 weiji14 added the documentation Improvements or additions to documentation label Apr 5, 2023
@weiji14 weiji14 added this to the 0.6.0 milestone Apr 5, 2023
@weiji14 weiji14 self-assigned this Apr 5, 2023
Hierarchical tree-like data structures for xarray!
Show a side by side comparison of daily maximum near-surface air temperature in Aug 2089 over South Asia from the Global Climate Model (GCM) and GARD-MV dowscaled product. Adapted from Figure 1 of https://carbonplan.org/research/cmip6-downscaling-explainer

Also converted arc degree units to arc minutes and fixed a broken link to the Zarr docs.
Show how to stack xarray.Dataset objects with different spatial resolutions into a nested DataTree structure. Showing the DataPipe graph too for good measure. Also added intersphinx link for xarray-datatree.
Show how to select data from a DataTree object that fits within a particular geographical bounding box and time range. Had to convert the low-resolution GCM's longitude coordinates from 0-360 to -180-180 first to match the DeepSD grid. Plotted the subsetted output for the Philippines on Dec 2030, and added a note about how one should approach pixel alignment and reprojection/resampling before performing spatial subsets.
Completing the multi-resolution tutorial hastily. Binning the temperature data in a monthly manner and chucking it into DataLoader2. Hopefully able to do multi-resolution spatial subsetting some day with changes in xbatcher!
Clarify that the climate dataset slicing is only on the time dimension and not the spatial dimensions for now. Also fixed a few typos here and there.
@weiji14 weiji14 marked this pull request as ready for review April 17, 2023 21:12
@weiji14 weiji14 mentioned this pull request Apr 17, 2023
12 tasks
@weiji14 weiji14 merged commit bdd21e8 into main Apr 17, 2023
@weiji14 weiji14 deleted the multi-resolution branch April 17, 2023 21:45
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
documentation Improvements or additions to documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant