Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add multiple conda environments #1392

Merged
merged 20 commits into from
Jan 6, 2021
Merged

Conversation

dmentipl
Copy link
Contributor

@dmentipl dmentipl commented Dec 15, 2020

Addresses #1381

Add multiple conda environments in a new directory "envs" and test each in CI.

The existing conda environment file (environment.yml) is renamed environment_py3.6_iris2.2.yml and there is an additional Python 3.7 and Iris 2.4 environment. Both environments are tested via GitHub Actions.

Two tests for wind components required reduced precision to pass unit tests. The Python 3.7 environment required pinning pySTEPS to 1.3.2.

Testing:

  • Ran tests and they passed OK

Note: this pull request contains the changes implemented in #1385. So this can be considered a draft until that is merged.

@dmentipl
Copy link
Contributor Author

The issue with pySTEPS may be resolved in #1389.

@codecov
Copy link

codecov bot commented Dec 15, 2020

Codecov Report

Merging #1392 (1e3bfcd) into master (49cb2b4) will not change coverage.
The diff coverage is n/a.

Impacted file tree graph

@@           Coverage Diff           @@
##           master    #1392   +/-   ##
=======================================
  Coverage   96.36%   96.36%           
=======================================
  Files          89       89           
  Lines        7614     7614           
=======================================
  Hits         7337     7337           
  Misses        277      277           

Continue to review full report at Codecov.

Legend - Click here to learn more
Δ = absolute <relative> (impact), ø = not affected, ? = missing data
Powered by Codecov. Last update 49cb2b4...1e3bfcd. Read the comment docs.

@dmentipl dmentipl marked this pull request as draft December 16, 2020 04:49
@tjtg tjtg mentioned this pull request Dec 16, 2020
2 tasks
The previous environment.yml file is now environment_py3.6_iris2.2.yml
and there is an additional Python 3.7 and Iris 2.4 env. Both envs are
tested via GitHub Actions. Two tests for wind components required
reduced precision to pass unit tests.
@dmentipl dmentipl marked this pull request as ready for review December 17, 2020 03:31
Copy link
Contributor

@tjtg tjtg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks good overall. I've added comments about a few inconsistencies which are worth cleaning up before this gets merged.

.github/workflows/tests.yml Outdated Show resolved Hide resolved
.github/workflows/tests.yml Outdated Show resolved Hide resolved
envs/environment_py3.6_iris2.2.yml Outdated Show resolved Hide resolved
tjtg
tjtg previously approved these changes Jan 4, 2021
Copy link
Contributor

@tjtg tjtg left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'm happy with the updated branch here - looks like it's addressed all the items I mentioned previously and the tests are passing on github actions with both environments.
I've run the acceptance test suite with both 3.6/2.2 and 3.7/2.4 environments and the test failures match those already identified in issue #1397 and PR #1398.

Copy link
Contributor

@btrotta-bom btrotta-bom left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This looks fine to me, I just had one question/comment about whether we should allow security checks to return failure.

.github/workflows/tests.yml Show resolved Hide resolved
@dmentipl dmentipl merged commit 281e351 into metoppv:master Jan 6, 2021
MoseleyS pushed a commit to MoseleyS/improver that referenced this pull request Aug 22, 2024
* Add multiple conda environments

The previous environment.yml file is now environment_py3.6_iris2.2.yml
and there is an additional Python 3.7 and Iris 2.4 env. Both envs are
tested via GitHub Actions. Two tests for wind components required
reduced precision to pass unit tests.

* Fix bug in workflows introduced in prev commit

* Fix hashFiles bug in workflow

* Update instructions to create environments

* Remove previous environment.yml file

* Pin pySTEPS version to pass unit tests

* Hash specific environment file in tests

This was causing the wrong environment to be used.

* Fix GitHub Actions syntax

* Re-add safety and bandit to environment files

* Reset cache in GitHub Actions

* Fix use of hashFiles in tests.yml

* Remove dots from env file names and tidy tests.yml

* Give environments different names

* Source conda environment per step in tests.yml

* Fix path for caches in tests.yml

* Add fail-fast is false to tests.yml

* Reset cache

* Only run Codestyle-and-Pylint in Python 3.7 env

* Pin scipy

See metoppv#1398.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants