Publish gt-contrib artifacts automatically to SonaType via CircleCI #236
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
|
@geotrellis/operations this is ready for an initial look. All the core work is done AFAIK. |
CloudNiner
force-pushed
the
feature/awf/ci
branch
from
8dcf15d to
3a8b908
Compare
rbreslow
approved these changes
Sep 26, 2019
Using the same general strategy as geotrellis/geotrellis-server and geotrellis/maml Update sbt runner to commit 5fd24eb dwijnand/sbt-extras@5fd24eb Switch tests to use a docker-compose setup for ease of use and consistency with other projects. Tests should now be run from ./scripts/test Add circleci config running scripts/cibuild We use the latest available machine image so we can run our existing docker-compose setup. A writeup considering various options: #222 (comment) Update to azavea-hosted openjdk-gdal image Publish build artifacts to OSS SonaType Nexus Remove old Travis CI configuration Run benchmarks with scripts/benchmark and cleanup the order of operations in the Dockerfile - Move all package installation to beginning and run in one step for better layer caching - Move all external dependency additions before sbt and other ops to improve layer caching - Reorder ops so we don't have to modify WORKDIR a bunch
CloudNiner
force-pushed
the
feature/awf/ci
branch
from
e66122e to
1f3ed5c
Compare
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Overview
Switch from manual Bintray publishing to automated CI-driven publishing to SonaType, using the same general workflow currently in use on https://github.com/geotrellis/geotrellis-server and https://github.com/geotrellis/maml
TODO:
benchmarksubproject in order to cleanup running benchmarksBump to Scala 2.12.10?Demo
Notes
See discussion on original issue regarding the choice of the
machineexecutor that just runs the new local docker-compose setup: #222 (comment)As part of this effort, I updated this repo to default to
developand protected both thedevelopandmasterbranch.I removed the TravisCI webhooks for this repo from the repo settings in GitHub. I also turned off all toggles that I could get to from the TravisCI dashboard. I believe TravisCI is purged from this repo, but it would be worth double-checking.
Kudos to @rbreslow for constructing a straightforward, reusable workflow to follow for this effort.
The first publish task I attempted ran into a 503 Service Temporarily Unavailable error for sonatype. Not sure how transient those are... https://circleci.com/gh/geotrellis/geotrellis-contrib/17
Testing Instructions
./scripts/testshould complete, running vlm, gdal and slick tests inside Docker via docker-compose../scripts/benchmarkshould build and begin running. Once its running, feel free to kill, as on a typical laptop processor it will take a very long time (> 1hr) to complete.The build for this branch should be green: https://circleci.com/gh/geotrellis/geotrellis-contrib/tree/feature%2Fawf%2Fci
Closes #222, Closes #122