docker: new jupyter for ravenpy and other new additions #89
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
See #88 (comment) Adding these do not bloat the image too much. ``` The following packages will be downloaded: package | build ---------------------------|----------------- firefox-91.0.2 | h9c3ff4c_0 72.5 MB conda-forge geckodriver-0.29.1 | h3146498_0 3.0 MB conda-forge openssl-1.1.1k | h7f98852_1 2.1 MB conda-forge selenium-3.141.0 |py37h5e8e339_1002 870 KB conda-forge ------------------------------------------------------------ Total: 78.4 MB ```
Previously it was indirectly pulled by RavenPy. Now RavenPy do not depend on it anymore.
…or bokeh png export The `firefox` install by `conda` was missing all the X-libraries so did not work: ``` ! firefox --version XPCOMGlueLoad error for file /opt/conda/envs/birdy/bin/FirefoxApp/libmozgtk.so: libgtk-3.so.0: cannot open shared object file: No such file or directory Couldn't load XPCOM. ``` See #88 (comment)
Error when only `firefox-esr` is installed by `apt-get`: ``` ! firefox --version XPCOMGlueLoad error for file /opt/conda/envs/birdy/bin/FirefoxApp/libxul.so: libXt.so.6: cannot open shared object file: No such file or directory Couldn't load XPCOM. ``` See #88 (comment)
tlvu
added a commit
to bird-house/birdhouse-deploy
that referenced
this pull request
Sep 9, 2021
Bokeh png export now also works. Other noticeable changes: ```diff < - ravenpy=0.7.0=pyh1bb2064_0 > - ravenpy=0.7.4=pyh7f9bfb9_0 < - xclim=0.28.0=pyhd8ed1ab_0 > - xclim=0.28.1=pyhd8ed1ab_0 > - geckodriver=0.29.1=h3146498_0 > - selenium=3.141.0=py37h5e8e339_1002 > - nested_dict=1.61=pyhd3deb0d_0 > - paramiko=2.7.2=pyh9f0ad1d_0 > - scp=0.14.0=pyhd8ed1ab_0 > - s3fs=2021.8.1=pyhd8ed1ab_0 < - pandas=1.3.1=py37h219a48f_0 > - pandas=1.2.5=py37h219a48f_0 < - owslib=0.24.1=pyhd8ed1ab_0 > - owslib=0.25.0=pyhd8ed1ab_0 < - cf_xarray=0.6.0=pyh6c4a22f_0 > - cf_xarray=0.6.1=pyh6c4a22f_0 < - rioxarray=0.5.0=pyhd8ed1ab_0 > - rioxarray=0.7.0=pyhd8ed1ab_0 < - climpred=2.1.4=pyhd8ed1ab_0 > - climpred=2.1.5.post1=pyhd8ed1ab_0 < - dask=2021.7.1=pyhd8ed1ab_0 > - dask=2021.9.0=pyhd8ed1ab_0 ``` See PR Ouranosinc/PAVICS-e2e-workflow-tests#89 for more info.
Zeitsperre
approved these changes
Sep 9, 2021
huard
approved these changes
Sep 9, 2021
tlvu
deleted the
new-jupyter-for-ravenpy-and-other-and-latest-of-everything-else
branch
tlvu
added a commit
to bird-house/birdhouse-deploy
that referenced
this pull request
Sep 10, 2021
jupyter: update for new RavenPy and other new packages Bokeh png export now also works. Other noticeable changes: ```diff < - ravenpy=0.7.0=pyh1bb2064_0 > - ravenpy=0.7.4=pyh7f9bfb9_0 < - xclim=0.28.0=pyhd8ed1ab_0 > - xclim=0.28.1=pyhd8ed1ab_0 > - geckodriver=0.29.1=h3146498_0 > - selenium=3.141.0=py37h5e8e339_1002 > - nested_dict=1.61=pyhd3deb0d_0 > - paramiko=2.7.2=pyh9f0ad1d_0 > - scp=0.14.0=pyhd8ed1ab_0 > - s3fs=2021.8.1=pyhd8ed1ab_0 < - pandas=1.3.1=py37h219a48f_0 > - pandas=1.2.5=py37h219a48f_0 < - owslib=0.24.1=pyhd8ed1ab_0 > - owslib=0.25.0=pyhd8ed1ab_0 < - cf_xarray=0.6.0=pyh6c4a22f_0 > - cf_xarray=0.6.1=pyh6c4a22f_0 < - rioxarray=0.5.0=pyhd8ed1ab_0 > - rioxarray=0.7.0=pyhd8ed1ab_0 < - climpred=2.1.4=pyhd8ed1ab_0 > - climpred=2.1.5.post1=pyhd8ed1ab_0 < - dask=2021.7.1=pyhd8ed1ab_0 > - dask=2021.9.0=pyhd8ed1ab_0 ``` See PR Ouranosinc/PAVICS-e2e-workflow-tests#89 for more info.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Biggest feature is support for bokeh png export by installing a full blown firefox and all needed X-libraries into the docker image. The image size went from 7.44GB to 7.97GB.
Deployed to https://medus.ouranos.ca/jupyter for testing.
Other noticeable changes:
Fixes #88 Fixes Ouranosinc/raven#402
Matching PR to deploy to PAVICS: bird-house/birdhouse-deploy#194
Jenkins build, only known error: http://jenkins.ouranos.ca/job/PAVICS-e2e-workflow-tests/job/new-jupyter-for-ravenpy-and-other-and-latest-of-everything-else/3/console
Jenkins all passed for Raven notebooks: http://jenkins.ouranos.ca/job/PAVICS-e2e-workflow-tests/job/new-jupyter-for-ravenpy-and-other-and-latest-of-everything-else/4/console
Full diff of
conda env export:210728-210908-conda-env-export.diff.txt
Full new
conda env export:210908-conda-env-export.yml.txt