-
Notifications
You must be signed in to change notification settings - Fork 9
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Bnb/dh refactor #220
base: main
Are you sure you want to change the base?
Bnb/dh refactor #220
Commits on Jul 23, 2024
-
removed agg factors from exo extracters and exo data handler. these w…
…erent being used anymore after changing spatial agg to use mean over overlapping gids. Dont need exo_resolution input resolution input anymore either.
Configuration menu - View commit details
-
Copy full SHA for 11a42c6 - Browse repository at this point
Copy the full SHA 11a42c6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2a149b6 - Browse repository at this point
Copy the full SHA 2a149b6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 717df31 - Browse repository at this point
Copy the full SHA 717df31View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5c3e375 - Browse repository at this point
Copy the full SHA 5c3e375View commit details -
sample count testing for base batch handlers and advanced count testi…
…ng for dc handlers. old doc string clean up and some simplifying combinations in batch qeue.
Configuration menu - View commit details
-
Copy full SHA for c3c1312 - Browse repository at this point
Copy the full SHA c3c1312View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9b143a4 - Browse repository at this point
Copy the full SHA 9b143a4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4659142 - Browse repository at this point
Copy the full SHA 4659142View commit details -
removed plotting methods used only for conditional tests. removed old…
… kwargs from bias and qa
Configuration menu - View commit details
-
Copy full SHA for 55e7e7a - Browse repository at this point
Copy the full SHA 55e7e7aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 430f4a3 - Browse repository at this point
Copy the full SHA 430f4a3View commit details -
Configuration menu - View commit details
-
Copy full SHA for 78f7c54 - Browse repository at this point
Copy the full SHA 78f7c54View commit details -
Configuration menu - View commit details
-
Copy full SHA for d28473b - Browse repository at this point
Copy the full SHA d28473bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2e94f2e - Browse repository at this point
Copy the full SHA 2e94f2eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f1e430e - Browse repository at this point
Copy the full SHA f1e430eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 303da0e - Browse repository at this point
Copy the full SHA 303da0eView commit details -
Configuration menu - View commit details
-
Copy full SHA for b3651ed - Browse repository at this point
Copy the full SHA b3651edView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2d84896 - Browse repository at this point
Copy the full SHA 2d84896View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4c39c68 - Browse repository at this point
Copy the full SHA 4c39c68View commit details -
added mask for regridder to use single site if within min distance. u…
…pdates to dc exo training tests
Configuration menu - View commit details
-
Copy full SHA for 8a4d730 - Browse repository at this point
Copy the full SHA 8a4d730View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0db46cd - Browse repository at this point
Copy the full SHA 0db46cdView commit details -
moved DataRetrievalBase to bias.base. Added new class __repr__ in fac…
…tory meta class. moved bias correct from ForwardPass, done for each chunk, to ForwardPassStrategy init.
Configuration menu - View commit details
-
Copy full SHA for 3ccb237 - Browse repository at this point
Copy the full SHA 3ccb237View commit details -
Configuration menu - View commit details
-
Copy full SHA for 30c763f - Browse repository at this point
Copy the full SHA 30c763fView commit details -
test added for solar multi step gan with exo data. this covers the `E…
…xoData.split` method.
Configuration menu - View commit details
-
Copy full SHA for 7fd0607 - Browse repository at this point
Copy the full SHA 7fd0607View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6a51cbb - Browse repository at this point
Copy the full SHA 6a51cbbView commit details -
add log interp to
Interpolator
so era data can be loaded with a han……dler which invoked log interp. Thus the log interp methods from era_downloader can be removed and LogLinInterpolator can also be removed.
Configuration menu - View commit details
-
Copy full SHA for 7289b40 - Browse repository at this point
Copy the full SHA 7289b40View commit details -
Configuration menu - View commit details
-
Copy full SHA for b2cdfa9 - Browse repository at this point
Copy the full SHA b2cdfa9View commit details -
_compute_if_dask and _compute_chunks_if_dask wrapper methods to handl…
…e dask vs numpy arrays
Configuration menu - View commit details
-
Copy full SHA for c96dc79 - Browse repository at this point
Copy the full SHA c96dc79View commit details -
Configuration menu - View commit details
-
Copy full SHA for e5265a2 - Browse repository at this point
Copy the full SHA e5265a2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 4fd32de - Browse repository at this point
Copy the full SHA 4fd32deView commit details -
test train dual test updates with separate validation queue. removed …
…old Feature class since we now have `parse_feature` method.
Configuration menu - View commit details
-
Copy full SHA for c38c3e3 - Browse repository at this point
Copy the full SHA c38c3e3View commit details -
Configuration menu - View commit details
-
Copy full SHA for abc6614 - Browse repository at this point
Copy the full SHA abc6614View commit details -
Configuration menu - View commit details
-
Copy full SHA for babe2dd - Browse repository at this point
Copy the full SHA babe2ddView commit details -
Configuration menu - View commit details
-
Copy full SHA for fd86c9b - Browse repository at this point
Copy the full SHA fd86c9bView commit details -
Configuration menu - View commit details
-
Copy full SHA for e732105 - Browse repository at this point
Copy the full SHA e732105View commit details -
Configuration menu - View commit details
-
Copy full SHA for ca15e3f - Browse repository at this point
Copy the full SHA ca15e3fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4757e1e - Browse repository at this point
Copy the full SHA 4757e1eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 48363d8 - Browse repository at this point
Copy the full SHA 48363d8View commit details -
Configuration menu - View commit details
-
Copy full SHA for b039236 - Browse repository at this point
Copy the full SHA b039236View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1b76299 - Browse repository at this point
Copy the full SHA 1b76299View commit details -
Configuration menu - View commit details
-
Copy full SHA for 02e76c4 - Browse repository at this point
Copy the full SHA 02e76c4View commit details -
moved some kwargs to input_handler_kwargs for ExoExtracter and ExoDat…
…aHandler, following common signature
Configuration menu - View commit details
-
Copy full SHA for e98d10a - Browse repository at this point
Copy the full SHA e98d10aView commit details -
Configuration menu - View commit details
-
Copy full SHA for a21a42b - Browse repository at this point
Copy the full SHA a21a42bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 35a065f - Browse repository at this point
Copy the full SHA 35a065fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4355475 - Browse repository at this point
Copy the full SHA 4355475View commit details -
Configuration menu - View commit details
-
Copy full SHA for a417a06 - Browse repository at this point
Copy the full SHA a417a06View commit details -
broke up file_handling in writer directory. direct data handler which…
… returns type specific handler based on file type
Configuration menu - View commit details
-
Copy full SHA for f65c3e9 - Browse repository at this point
Copy the full SHA f65c3e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 66ca67a - Browse repository at this point
Copy the full SHA 66ca67aView commit details -
Configuration menu - View commit details
-
Copy full SHA for a1a0034 - Browse repository at this point
Copy the full SHA a1a0034View commit details -
hadnt added
batch_handler.stop()
inSup3rCondMom.train().
Could b……e why the hanging tests.
Configuration menu - View commit details
-
Copy full SHA for 65619e1 - Browse repository at this point
Copy the full SHA 65619e1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0111f79 - Browse repository at this point
Copy the full SHA 0111f79View commit details -
Configuration menu - View commit details
-
Copy full SHA for 368d2bd - Browse repository at this point
Copy the full SHA 368d2bdView commit details -
duplicate logger get removed. moved
get_exo_chunk
to `ExoData.get_c……hunk` instance method
Configuration menu - View commit details
-
Copy full SHA for 01f46b2 - Browse repository at this point
Copy the full SHA 01f46b2View commit details -
type agnostic data handlers, loaders, and topo extracters. can remove…
… input type check in fwp and exo handler name arg in exo data handler.
Configuration menu - View commit details
-
Copy full SHA for d7309c9 - Browse repository at this point
Copy the full SHA d7309c9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 662b742 - Browse repository at this point
Copy the full SHA 662b742View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1746967 - Browse repository at this point
Copy the full SHA 1746967View commit details -
Configuration menu - View commit details
-
Copy full SHA for f37d992 - Browse repository at this point
Copy the full SHA f37d992View commit details -
Configuration menu - View commit details
-
Copy full SHA for 69ec57e - Browse repository at this point
Copy the full SHA 69ec57eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 021b8f4 - Browse repository at this point
Copy the full SHA 021b8f4View commit details -
pytest-env test dep for global env vars during testing. global pytest…
… vars in pytest_config fixture. used these vars to clean up tests. lin_bc added to bias cli test.
Configuration menu - View commit details
-
Copy full SHA for 73dbbc3 - Browse repository at this point
Copy the full SHA 73dbbc3View commit details -
Configuration menu - View commit details
-
Copy full SHA for b2f8cc3 - Browse repository at this point
Copy the full SHA b2f8cc3View commit details -
Configuration menu - View commit details
-
Copy full SHA for a68193d - Browse repository at this point
Copy the full SHA a68193dView commit details -
Configuration menu - View commit details
-
Copy full SHA for dd09592 - Browse repository at this point
Copy the full SHA dd09592View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0178d32 - Browse repository at this point
Copy the full SHA 0178d32View commit details -
Configuration menu - View commit details
-
Copy full SHA for 431a93f - Browse repository at this point
Copy the full SHA 431a93fView commit details -
some upper -> lower case changes to just reduce some local warnings. …
…added pytest.warns() catches for some intentional checks.
Configuration menu - View commit details
-
Copy full SHA for bc6dc6b - Browse repository at this point
Copy the full SHA bc6dc6bView commit details -
Configuration menu - View commit details
-
Copy full SHA for d8b8f9f - Browse repository at this point
Copy the full SHA d8b8f9fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 32ef4de - Browse repository at this point
Copy the full SHA 32ef4deView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e53679 - Browse repository at this point
Copy the full SHA 7e53679View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6532057 - Browse repository at this point
Copy the full SHA 6532057View commit details -
Configuration menu - View commit details
-
Copy full SHA for 605b6d6 - Browse repository at this point
Copy the full SHA 605b6d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9657848 - Browse repository at this point
Copy the full SHA 9657848View commit details -
Configuration menu - View commit details
-
Copy full SHA for 37d98e9 - Browse repository at this point
Copy the full SHA 37d98e9View commit details -
Configuration menu - View commit details
-
Copy full SHA for af3f6f3 - Browse repository at this point
Copy the full SHA af3f6f3View commit details -
safe_serialize method for handling objects like datetimeindex in json…
….dumps. fwp with bc in cli test. updated nc output.
Configuration menu - View commit details
-
Copy full SHA for 9033b47 - Browse repository at this point
Copy the full SHA 9033b47View commit details -
need to pass time_index to bias_transforms as list bc it gets convert…
…ed to string with ellipsis as a datetimeindex for the command string when time index is long.
Configuration menu - View commit details
-
Copy full SHA for d56a0ed - Browse repository at this point
Copy the full SHA d56a0edView commit details -
Configuration menu - View commit details
-
Copy full SHA for 4660b5e - Browse repository at this point
Copy the full SHA 4660b5eView commit details -
Configuration menu - View commit details
-
Copy full SHA for f2986f1 - Browse repository at this point
Copy the full SHA f2986f1View commit details -
Configuration menu - View commit details
-
Copy full SHA for dea1b60 - Browse repository at this point
Copy the full SHA dea1b60View commit details -
swapping out time_index arg for date_range_kwargs. Time indices can b…
…e too long to pass through cli and are non serializable.
Configuration menu - View commit details
-
Copy full SHA for eb7dc4a - Browse repository at this point
Copy the full SHA eb7dc4aView commit details -
Configuration menu - View commit details
-
Copy full SHA for 22ebb83 - Browse repository at this point
Copy the full SHA 22ebb83View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d33713 - Browse repository at this point
Copy the full SHA 8d33713View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7c5cb36 - Browse repository at this point
Copy the full SHA 7c5cb36View commit details -
Configuration menu - View commit details
-
Copy full SHA for cc67308 - Browse repository at this point
Copy the full SHA cc67308View commit details -
refact: removed getattr -> fwp strat in fwp, removed output handler a…
…rg - can be defined right before writing.
Configuration menu - View commit details
-
Copy full SHA for b8e1f92 - Browse repository at this point
Copy the full SHA b8e1f92View commit details -
Configuration menu - View commit details
-
Copy full SHA for e5c7221 - Browse repository at this point
Copy the full SHA e5c7221View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2df1c0e - Browse repository at this point
Copy the full SHA 2df1c0eView commit details -
Configuration menu - View commit details
-
Copy full SHA for d27dca4 - Browse repository at this point
Copy the full SHA d27dca4View commit details -
refact: removed uneeded attrs in ForwardPass
feat: default fwp_chunk_shape for None input fix: moved get chunk to after check for exisitng output file.
Configuration menu - View commit details
-
Copy full SHA for c6503ae - Browse repository at this point
Copy the full SHA c6503aeView commit details -
Configuration menu - View commit details
-
Copy full SHA for ac3f176 - Browse repository at this point
Copy the full SHA ac3f176View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3721cde - Browse repository at this point
Copy the full SHA 3721cdeView commit details -
refact: cleaned up fwp strategy init and setup skip of some init rout…
…ines when running on a head_node
Configuration menu - View commit details
-
Copy full SHA for 4d0fc4d - Browse repository at this point
Copy the full SHA 4d0fc4dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5b4ba1f - Browse repository at this point
Copy the full SHA 5b4ba1fView commit details -
Configuration menu - View commit details
-
Copy full SHA for 2651f55 - Browse repository at this point
Copy the full SHA 2651f55View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6ab0873 - Browse repository at this point
Copy the full SHA 6ab0873View commit details -
adds: repeat topo over time to be consistently 3d across features.
fix: use low res to compute means / stds if features are lr only. fix: ensure correct feature order and feature divisions for dual samplers.
Configuration menu - View commit details
-
Copy full SHA for 3f7d7c3 - Browse repository at this point
Copy the full SHA 3f7d7c3View commit details -
refact: simplifying stats compute methods.
test: added full domain loading for rasterized h5 file
Configuration menu - View commit details
-
Copy full SHA for 28ee2f0 - Browse repository at this point
Copy the full SHA 28ee2f0View commit details -
Configuration menu - View commit details
-
Copy full SHA for d435804 - Browse repository at this point
Copy the full SHA d435804View commit details -
Configuration menu - View commit details
-
Copy full SHA for 45383f6 - Browse repository at this point
Copy the full SHA 45383f6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 10dc3af - Browse repository at this point
Copy the full SHA 10dc3afView commit details -
Configuration menu - View commit details
-
Copy full SHA for e6132b7 - Browse repository at this point
Copy the full SHA e6132b7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 31ea00f - Browse repository at this point
Copy the full SHA 31ea00fView commit details -
added
sample
method to quickly access data for batching. updated fr……om legacy np.random
Configuration menu - View commit details
-
Copy full SHA for 1d0bada - Browse repository at this point
Copy the full SHA 1d0badaView commit details -
Configuration menu - View commit details
-
Copy full SHA for eb68749 - Browse repository at this point
Copy the full SHA eb68749View commit details -
Configuration menu - View commit details
-
Copy full SHA for 60e48f9 - Browse repository at this point
Copy the full SHA 60e48f9View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3d4a027 - Browse repository at this point
Copy the full SHA 3d4a027View commit details -
Configuration menu - View commit details
-
Copy full SHA for dd6a0ee - Browse repository at this point
Copy the full SHA dd6a0eeView commit details -
removed default device from model load (now included in params). some…
… micro opts in loaders
Configuration menu - View commit details
-
Copy full SHA for 41b9cb1 - Browse repository at this point
Copy the full SHA 41b9cb1View commit details -
Configuration menu - View commit details
-
Copy full SHA for ffb4d5c - Browse repository at this point
Copy the full SHA ffb4d5cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 53069e4 - Browse repository at this point
Copy the full SHA 53069e4View commit details -
Configuration menu - View commit details
-
Copy full SHA for ef76b6e - Browse repository at this point
Copy the full SHA ef76b6eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8fc0600 - Browse repository at this point
Copy the full SHA 8fc0600View commit details -
Configuration menu - View commit details
-
Copy full SHA for fbe8e86 - Browse repository at this point
Copy the full SHA fbe8e86View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6be9677 - Browse repository at this point
Copy the full SHA 6be9677View commit details -
Configuration menu - View commit details
-
Copy full SHA for 7c9b991 - Browse repository at this point
Copy the full SHA 7c9b991View commit details -
Configuration menu - View commit details
-
Copy full SHA for a58d720 - Browse repository at this point
Copy the full SHA a58d720View commit details -
Configuration menu - View commit details
-
Copy full SHA for b1b5bf5 - Browse repository at this point
Copy the full SHA b1b5bf5View commit details -
pickle doesnt like un-computed mask from argmin. added compute call. …
…fixed cacher dims parsing
Configuration menu - View commit details
-
Copy full SHA for d3dd59b - Browse repository at this point
Copy the full SHA d3dd59bView commit details -
enforcing same rng state across all tests. some logging added to era …
…downloader and type conversion to np.float32.
Configuration menu - View commit details
-
Copy full SHA for 43fb3b3 - Browse repository at this point
Copy the full SHA 43fb3b3View commit details -
Configuration menu - View commit details
-
Copy full SHA for b9e65f4 - Browse repository at this point
Copy the full SHA b9e65f4View commit details -
Configuration menu - View commit details
-
Copy full SHA for bf21ea6 - Browse repository at this point
Copy the full SHA bf21ea6View commit details -
Configuration menu - View commit details
-
Copy full SHA for a1624b6 - Browse repository at this point
Copy the full SHA a1624b6View commit details -
stats args removed from batch queue. this is now handled just by stat…
…s collection and batch handler init
Configuration menu - View commit details
-
Copy full SHA for 76b95c4 - Browse repository at this point
Copy the full SHA 76b95c4View commit details -
Configuration menu - View commit details
-
Copy full SHA for 88819d6 - Browse repository at this point
Copy the full SHA 88819d6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 744939c - Browse repository at this point
Copy the full SHA 744939cView commit details
Commits on Jul 24, 2024
-
methods in bias transforms currently need eager loading for some arra…
…ys, which slows down the fwp.
Configuration menu - View commit details
-
Copy full SHA for 6c7e3cd - Browse repository at this point
Copy the full SHA 6c7e3cdView commit details -
enabled loading of bc factor files with Extracter class. currently co…
…mputing param arrays passed to QDM() bc rex asserts that these are ndarrays and doesnt allow for da.core.Array types.
Configuration menu - View commit details
-
Copy full SHA for e48cc9d - Browse repository at this point
Copy the full SHA e48cc9dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9fc1e15 - Browse repository at this point
Copy the full SHA 9fc1e15View commit details -
unused fixture in qdm tests. date_range_kwargs in presat tests. datas…
…et checks in h5 loading
Configuration menu - View commit details
-
Copy full SHA for 9b250fb - Browse repository at this point
Copy the full SHA 9b250fbView commit details -
Configuration menu - View commit details
-
Copy full SHA for f38133c - Browse repository at this point
Copy the full SHA f38133cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0fa79aa - Browse repository at this point
Copy the full SHA 0fa79aaView commit details
Commits on Jul 25, 2024
-
moved bias correction to
init_chunk
instead of performing on full d……ata volume prior to node kick off.
Configuration menu - View commit details
-
Copy full SHA for 51802a1 - Browse repository at this point
Copy the full SHA 51802a1View commit details
Commits on Jul 27, 2024
-
changed samplers to sample batches using adjacent time slices which a…
…re then reshaped into n_obs. This is more efficient than building batches from indendent samples. This adds batch_size are an argument to sampler objects. This also allows us to remove lots of the previous batch building methods, like those using tf.data.Dataset
Configuration menu - View commit details
-
Copy full SHA for 68358c8 - Browse repository at this point
Copy the full SHA 68358c8View commit details -
Configuration menu - View commit details
-
Copy full SHA for 54f1828 - Browse repository at this point
Copy the full SHA 54f1828View commit details -
reducing loading mem by casting elevation to dask array. moved duplic…
…ate collect test code to conftest
Configuration menu - View commit details
-
Copy full SHA for 6df02bf - Browse repository at this point
Copy the full SHA 6df02bfView commit details -
Configuration menu - View commit details
-
Copy full SHA for a499420 - Browse repository at this point
Copy the full SHA a499420View commit details
Commits on Jul 28, 2024
-
moved loader name maps and Dimension class to names.py. accounted for…
… level rename in cdsapi
Configuration menu - View commit details
-
Copy full SHA for 3256c64 - Browse repository at this point
Copy the full SHA 3256c64View commit details -
more efficient era downloader writing. incremental stats - will load …
…all available from dict and add if needed. cache loading for data handlers.
Configuration menu - View commit details
-
Copy full SHA for 0dc8928 - Browse repository at this point
Copy the full SHA 0dc8928View commit details
Commits on Jul 29, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 6120a31 - Browse repository at this point
Copy the full SHA 6120a31View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6fcd406 - Browse repository at this point
Copy the full SHA 6fcd406View commit details -
Configuration menu - View commit details
-
Copy full SHA for f552ddb - Browse repository at this point
Copy the full SHA f552ddbView commit details -
Configuration menu - View commit details
-
Copy full SHA for 0d0dda2 - Browse repository at this point
Copy the full SHA 0d0dda2View commit details -
Configuration menu - View commit details
-
Copy full SHA for e1b8f87 - Browse repository at this point
Copy the full SHA e1b8f87View commit details -
Merge pull request #228 from NREL/pp/rex_regridder
Use `rex Regridder` port
Configuration menu - View commit details
-
Copy full SHA for c72c817 - Browse repository at this point
Copy the full SHA c72c817View commit details
Commits on Jul 30, 2024
-
np.asarray replacement for _compute_if_dask in most places. added fwp…
… test with cache data loading. DualSamplerCC test fix.
Configuration menu - View commit details
-
Copy full SHA for 43e6242 - Browse repository at this point
Copy the full SHA 43e6242View commit details -
Configuration menu - View commit details
-
Copy full SHA for d51d887 - Browse repository at this point
Copy the full SHA d51d887View commit details
Commits on Jul 31, 2024
-
-rename: extracter -> rasterizer
-T_Dataset type removed. -Exo datahandler stuff moved to data_handlers/exo -typeagnostic rasterizer, loader, datahandler favored as base objects intead of type specific ones. -more explicit with args / kwargs in composite objects. -signature tests added for composite objects: data handler / batch handlers and https://github.com/NREL/gaps used to correctly resolve composite signatures and composite doc strings. thanks @ppinchuk! - docs branch built and checked. -cleaned up some sphinx syntax. -added some examples and explanation to Sup3rDatasets
Configuration menu - View commit details
-
Copy full SHA for 80dbb5c - Browse repository at this point
Copy the full SHA 80dbb5cView commit details -
Configuration menu - View commit details
-
Copy full SHA for de031fe - Browse repository at this point
Copy the full SHA de031feView commit details
Commits on Aug 1, 2024
-
vindex method for fancy indexing added signature check in batch factory and gaps derived docs / sigs in derived classes.
Configuration menu - View commit details
-
Copy full SHA for 20b4fa2 - Browse repository at this point
Copy the full SHA 20b4fa2View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1b18ed4 - Browse repository at this point
Copy the full SHA 1b18ed4View commit details -
simplified auto gen of composite signatures and docs. moved some logi…
…c to Sup3rMeta meta class which all containers inherit.
Configuration menu - View commit details
-
Copy full SHA for 53f6968 - Browse repository at this point
Copy the full SHA 53f6968View commit details -
Configuration menu - View commit details
-
Copy full SHA for 725c880 - Browse repository at this point
Copy the full SHA 725c880View commit details -
Configuration menu - View commit details
-
Copy full SHA for bb2c0c1 - Browse repository at this point
Copy the full SHA bb2c0c1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 27f1eae - Browse repository at this point
Copy the full SHA 27f1eaeView commit details -
nc for cc shouldnt actually have base loader arg. fixed order of comp…
…arison in stats test
Configuration menu - View commit details
-
Copy full SHA for 749633b - Browse repository at this point
Copy the full SHA 749633bView commit details
Commits on Aug 3, 2024
-
test on units persisting through load and temp change to celsius. rem…
…oved dim ordering logic in Sup3rX initialization. Only enforce dim order when returned from a numpy style indexing request
Configuration menu - View commit details
-
Copy full SHA for 250a0fe - Browse repository at this point
Copy the full SHA 250a0feView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8bd542d - Browse repository at this point
Copy the full SHA 8bd542dView commit details
Commits on Aug 4, 2024
-
general exo rasterizers for nc and h5 and any feature, with Sup3rX me…
…mbers. Prep for replacing model step iteration with coarsening of highest res for each step. graceful batch handler thread exit.
Configuration menu - View commit details
-
Copy full SHA for c045b81 - Browse repository at this point
Copy the full SHA c045b81View commit details
Commits on Aug 5, 2024
-
added recursive derivation. simplified exo handling: get highest res …
…and then use xr.Dataset().coarsen for each model step. moved that simplified code from exo dir contents back into exo.py
Configuration menu - View commit details
-
Copy full SHA for a27110e - Browse repository at this point
Copy the full SHA a27110eView commit details
Commits on Aug 6, 2024
-
self reference in feature registry leads to infinite recursion - adde…
…d check. fixed sphinx doc render - needed to define __name__ appropriately.
Configuration menu - View commit details
-
Copy full SHA for fbde72e - Browse repository at this point
Copy the full SHA fbde72eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 3c9c72c - Browse repository at this point
Copy the full SHA 3c9c72cView commit details -
Configuration menu - View commit details
-
Copy full SHA for a707019 - Browse repository at this point
Copy the full SHA a707019View commit details -
Configuration menu - View commit details
-
Copy full SHA for 33cc102 - Browse repository at this point
Copy the full SHA 33cc102View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9b1f29b - Browse repository at this point
Copy the full SHA 9b1f29bView commit details -
Configuration menu - View commit details
-
Copy full SHA for a6acb90 - Browse repository at this point
Copy the full SHA a6acb90View commit details
Commits on Aug 7, 2024
-
cleaned up
__getitem__
and added.values
for @grantbuster :) also…… addressed other pr comments.
Configuration menu - View commit details
-
Copy full SHA for 40e5021 - Browse repository at this point
Copy the full SHA 40e5021View commit details -
Configuration menu - View commit details
-
Copy full SHA for 211976f - Browse repository at this point
Copy the full SHA 211976fView commit details -
Configuration menu - View commit details
-
Copy full SHA for fe47f3e - Browse repository at this point
Copy the full SHA fe47f3eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 71073d2 - Browse repository at this point
Copy the full SHA 71073d2View commit details -
Configuration menu - View commit details
-
Copy full SHA for d04e6e7 - Browse repository at this point
Copy the full SHA d04e6e7View commit details -
Configuration menu - View commit details
-
Copy full SHA for 3d4114e - Browse repository at this point
Copy the full SHA 3d4114eView commit details -
Configuration menu - View commit details
-
Copy full SHA for 47d1fe7 - Browse repository at this point
Copy the full SHA 47d1fe7View commit details
Commits on Aug 8, 2024
-
simplified args for
Sup3rDataset
. Single check for tuples in `Conta……iner` data setter. sphinx_book_theme.
Configuration menu - View commit details
-
Copy full SHA for d8e0fe2 - Browse repository at this point
Copy the full SHA d8e0fe2View commit details -
Configuration menu - View commit details
-
Copy full SHA for acea804 - Browse repository at this point
Copy the full SHA acea804View commit details
Commits on Aug 9, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0e32ff5 - Browse repository at this point
Copy the full SHA 0e32ff5View commit details
Commits on Aug 11, 2024
-
sza derived feature added. wrapped some function from rex class with …
…map_blocks so this could be done with efficient mem use.
Configuration menu - View commit details
-
Copy full SHA for ca52250 - Browse repository at this point
Copy the full SHA ca52250View commit details -
Configuration menu - View commit details
-
Copy full SHA for a708443 - Browse repository at this point
Copy the full SHA a708443View commit details -
Configuration menu - View commit details
-
Copy full SHA for b3f8260 - Browse repository at this point
Copy the full SHA b3f8260View commit details -
Configuration menu - View commit details
-
Copy full SHA for 90ecb90 - Browse repository at this point
Copy the full SHA 90ecb90View commit details -
Configuration menu - View commit details
-
Copy full SHA for 05166f9 - Browse repository at this point
Copy the full SHA 05166f9View commit details
Commits on Aug 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0b26b69 - Browse repository at this point
Copy the full SHA 0b26b69View commit details -
with netcd4f4 installed engine='h5netcdf' needs to be explicit. befor…
…e it was default without netcdf4 installed.
Configuration menu - View commit details
-
Copy full SHA for c5f0dec - Browse repository at this point
Copy the full SHA c5f0decView commit details -
Configuration menu - View commit details
-
Copy full SHA for 5805bd4 - Browse repository at this point
Copy the full SHA 5805bd4View commit details -
test fixes, netcd4 version req cap, and xr open mfdataset wrapper wit…
…h default engine + format
Configuration menu - View commit details
-
Copy full SHA for bde79ed - Browse repository at this point
Copy the full SHA bde79edView commit details -
Configuration menu - View commit details
-
Copy full SHA for 009edd5 - Browse repository at this point
Copy the full SHA 009edd5View commit details -
delayed dask and schedulers used to replace threadpoolexecutor logic.…
… can also be used to replace process pools just with scheduler='processes'
Configuration menu - View commit details
-
Copy full SHA for 2ae0cbc - Browse repository at this point
Copy the full SHA 2ae0cbcView commit details
Commits on Aug 15, 2024
-
added initial meta / time_index building from only unique spatial / t…
…emporal chunks for collection.
Configuration menu - View commit details
-
Copy full SHA for 77c36ca - Browse repository at this point
Copy the full SHA 77c36caView commit details
Commits on Aug 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e6ed04a - Browse repository at this point
Copy the full SHA e6ed04aView commit details -
Configuration menu - View commit details
-
Copy full SHA for a8a7e28 - Browse repository at this point
Copy the full SHA a8a7e28View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6bbdf98 - Browse repository at this point
Copy the full SHA 6bbdf98View commit details
Commits on Aug 18, 2024
-
not caching exo data with time if time independent. this can be a hug…
…e cache if using hr topo in a temporal model.
Configuration menu - View commit details
-
Copy full SHA for 9957800 - Browse repository at this point
Copy the full SHA 9957800View commit details -
Configuration menu - View commit details
-
Copy full SHA for 0f34e35 - Browse repository at this point
Copy the full SHA 0f34e35View commit details -
added method to automatically determine exogenous data steps from lr_…
…features and hr_exo_features
Configuration menu - View commit details
-
Copy full SHA for 3117212 - Browse repository at this point
Copy the full SHA 3117212View commit details -
Configuration menu - View commit details
-
Copy full SHA for 78e69ce - Browse repository at this point
Copy the full SHA 78e69ceView commit details
Commits on Aug 19, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a00fdaf - Browse repository at this point
Copy the full SHA a00fdafView commit details
Commits on Aug 20, 2024
-
changed masking logic in level interpolation to enable delayed comput…
…e. much faster for large forward passes.
Configuration menu - View commit details
-
Copy full SHA for ca3b03e - Browse repository at this point
Copy the full SHA ca3b03eView commit details
Commits on Aug 21, 2024
-
Configuration menu - View commit details
-
Copy full SHA for f619328 - Browse repository at this point
Copy the full SHA f619328View commit details -
Configuration menu - View commit details
-
Copy full SHA for d719c59 - Browse repository at this point
Copy the full SHA d719c59View commit details
Commits on Aug 22, 2024
-
Configuration menu - View commit details
-
Copy full SHA for dacd1d5 - Browse repository at this point
Copy the full SHA dacd1d5View commit details -
limit on padding removed since data is loaded as ndarray before paddi…
…ng now. added s_enhancements and t_enhancements to abstract models and now use this to determine exo shapes. removed temporal pad from SolarMultiStepGan, since this can be determined from the t_enhance arg and low res shape
Configuration menu - View commit details
-
Copy full SHA for 9453b25 - Browse repository at this point
Copy the full SHA 9453b25View commit details -
Configuration menu - View commit details
-
Copy full SHA for 9058109 - Browse repository at this point
Copy the full SHA 9058109View commit details -
Configuration menu - View commit details
-
Copy full SHA for bafcb8d - Browse repository at this point
Copy the full SHA bafcb8dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9e71ed6 - Browse repository at this point
Copy the full SHA 9e71ed6View commit details -
Configuration menu - View commit details
-
Copy full SHA for fccea44 - Browse repository at this point
Copy the full SHA fccea44View commit details
Commits on Aug 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 7bac634 - Browse repository at this point
Copy the full SHA 7bac634View commit details -
h5_attrs -> output_attrs. used in enforce_limits in both netcdf and h…
…5 output_handlers
Configuration menu - View commit details
-
Copy full SHA for 79a4602 - Browse repository at this point
Copy the full SHA 79a4602View commit details -
Configuration menu - View commit details
-
Copy full SHA for 41f82dc - Browse repository at this point
Copy the full SHA 41f82dcView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9430b02 - Browse repository at this point
Copy the full SHA 9430b02View commit details -
moved presrat transform into separate method for modular call directl…
…y from parameters not file
Configuration menu - View commit details
-
Copy full SHA for 0c5f9b9 - Browse repository at this point
Copy the full SHA 0c5f9b9View commit details -
Configuration menu - View commit details
-
Copy full SHA for d56f70f - Browse repository at this point
Copy the full SHA d56f70fView commit details -
more explicit enforcement of a zero threshold value and passing to QD…
…M to prevent large delta values
Configuration menu - View commit details
-
Copy full SHA for 3edbcef - Browse repository at this point
Copy the full SHA 3edbcefView commit details -
Configuration menu - View commit details
-
Copy full SHA for 8ee6b2b - Browse repository at this point
Copy the full SHA 8ee6b2bView commit details -
moved ntimesteps and window size to kwargs so easier to modify. Found…
… issues with small window size so increased default to 120 (seasonal correction)
Configuration menu - View commit details
-
Copy full SHA for e413982 - Browse repository at this point
Copy the full SHA e413982View commit details -
Configuration menu - View commit details
-
Copy full SHA for 5657774 - Browse repository at this point
Copy the full SHA 5657774View commit details -
Configuration menu - View commit details
-
Copy full SHA for 6596038 - Browse repository at this point
Copy the full SHA 6596038View commit details -
Configuration menu - View commit details
-
Copy full SHA for ca862eb - Browse repository at this point
Copy the full SHA ca862ebView commit details -
delta denom min should fix the low precip value issues and no need to…
… round data to zero anymore
Configuration menu - View commit details
-
Copy full SHA for 4314053 - Browse repository at this point
Copy the full SHA 4314053View commit details -
Configuration menu - View commit details
-
Copy full SHA for 8d8474c - Browse repository at this point
Copy the full SHA 8d8474cView commit details
Commits on Aug 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 1c1056d - Browse repository at this point
Copy the full SHA 1c1056dView commit details -
Configuration menu - View commit details
-
Copy full SHA for 1fdf415 - Browse repository at this point
Copy the full SHA 1fdf415View commit details -
modfication to SolarCC model to enable running as stand alone forward…
… pass with correct output shape
Configuration menu - View commit details
-
Copy full SHA for a7c4d1d - Browse repository at this point
Copy the full SHA a7c4d1dView commit details
Commits on Aug 30, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 0d198b6 - Browse repository at this point
Copy the full SHA 0d198b6View commit details -
Configuration menu - View commit details
-
Copy full SHA for 661e650 - Browse repository at this point
Copy the full SHA 661e650View commit details -
Configuration menu - View commit details
-
Copy full SHA for 83d6475 - Browse repository at this point
Copy the full SHA 83d6475View commit details
Commits on Aug 31, 2024
-
split up attribute collection for meta and time index. significantly …
…reduced mem use since number of spatial chunks tends to be much lower than number of time chunks.
Configuration menu - View commit details
-
Copy full SHA for ce76db8 - Browse repository at this point
Copy the full SHA ce76db8View commit details -
Configuration menu - View commit details
-
Copy full SHA for af2336b - Browse repository at this point
Copy the full SHA af2336bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7e90cb0 - Browse repository at this point
Copy the full SHA 7e90cb0View commit details
Commits on Sep 4, 2024
-
added time_shift argument to deriver and data handler so that daily d…
…ata time index can be shifted to start at the beginning of the day instead of at noon. GCM data frequently stamps daily data at noon instead of the beginning of the day. This caused an issue with the solar module thinking that given gan data had 48 time steps, since the time index had two unique day values, even though there were only 24 time steps from noon to noon on each day.
Configuration menu - View commit details
-
Copy full SHA for c21ed3c - Browse repository at this point
Copy the full SHA c21ed3cView commit details
Commits on Sep 12, 2024
-
Configuration menu - View commit details
-
Copy full SHA for a5f42b8 - Browse repository at this point
Copy the full SHA a5f42b8View commit details -
Configuration menu - View commit details
-
Copy full SHA for ae2324b - Browse repository at this point
Copy the full SHA ae2324bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 84d3be5 - Browse repository at this point
Copy the full SHA 84d3be5View commit details -
Merge pull request #230 from NREL/gb/presrat_updates_2
Gb/presrat updates 2
Configuration menu - View commit details
-
Copy full SHA for c692000 - Browse repository at this point
Copy the full SHA c692000View commit details
Commits on Sep 13, 2024
-
regex edit for correctly getting chunk indices from solar module outp…
…ut files, with irradiance suffixes
Configuration menu - View commit details
-
Copy full SHA for 7232eb1 - Browse repository at this point
Copy the full SHA 7232eb1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1920fcd - Browse repository at this point
Copy the full SHA 1920fcdView commit details
Commits on Sep 15, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 3808db1 - Browse repository at this point
Copy the full SHA 3808db1View commit details -
time shift added to solar module, so that daily gcm data can be shift…
…ed to start at the zeroth hour, if it has not been shifted already.
Configuration menu - View commit details
-
Copy full SHA for e4f009f - Browse repository at this point
Copy the full SHA e4f009fView commit details
Commits on Sep 16, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 9042364 - Browse repository at this point
Copy the full SHA 9042364View commit details -
Configuration menu - View commit details
-
Copy full SHA for 2aa353b - Browse repository at this point
Copy the full SHA 2aa353bView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7c8fe53 - Browse repository at this point
Copy the full SHA 7c8fe53View commit details
Commits on Sep 17, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 711c471 - Browse repository at this point
Copy the full SHA 711c471View commit details -
Configuration menu - View commit details
-
Copy full SHA for dd6250a - Browse repository at this point
Copy the full SHA dd6250aView commit details -
dont need time shift in the solar module. can just shift this in a se…
…parate script if this is an issue.
Configuration menu - View commit details
-
Copy full SHA for 8ae857d - Browse repository at this point
Copy the full SHA 8ae857dView commit details
Commits on Sep 20, 2024
-
Configuration menu - View commit details
-
Copy full SHA for e4428fd - Browse repository at this point
Copy the full SHA e4428fdView commit details -
Configuration menu - View commit details
-
Copy full SHA for 7ec885a - Browse repository at this point
Copy the full SHA 7ec885aView commit details
Commits on Sep 21, 2024
-
removed expanded time dimension in exo rasterizer for time independen…
…t features. now just repeat over time dimension in the forward pass padding method. this is much more performant for time independent features. this doesnt solve slow down issues with time dependent exo features like sza though.
Configuration menu - View commit details
-
Copy full SHA for 69e8344 - Browse repository at this point
Copy the full SHA 69e8344View commit details -
Configuration menu - View commit details
-
Copy full SHA for cf5e466 - Browse repository at this point
Copy the full SHA cf5e466View commit details -
Configuration menu - View commit details
-
Copy full SHA for e9b42e9 - Browse repository at this point
Copy the full SHA e9b42e9View commit details
Commits on Sep 24, 2024
-
need to check coords also for pressure derivation. fixed this in base…
… deriver. typo in solar module.
Configuration menu - View commit details
-
Copy full SHA for 2ea6206 - Browse repository at this point
Copy the full SHA 2ea6206View commit details -
Configuration menu - View commit details
-
Copy full SHA for e7e44b1 - Browse repository at this point
Copy the full SHA e7e44b1View commit details -
Configuration menu - View commit details
-
Copy full SHA for 92ee0f7 - Browse repository at this point
Copy the full SHA 92ee0f7View commit details
Commits on Sep 26, 2024
-
added height interpolation for the case of just single level data. e.…
…g. u_30m from u_10m and u_100m, with u pressure level array
Configuration menu - View commit details
-
Copy full SHA for c3a3309 - Browse repository at this point
Copy the full SHA c3a3309View commit details
Commits on Sep 27, 2024
-
Configuration menu - View commit details
-
Copy full SHA for b900d0d - Browse repository at this point
Copy the full SHA b900d0dView commit details