Skip to content
This repository has been archived by the owner on Mar 28, 2023. It is now read-only.

(#1892) QA Runner improvements for use in CI #1910

Merged
merged 8 commits into from
Dec 17, 2019
Merged

Conversation

hoffmabc
Copy link
Member

@hoffmabc hoffmabc commented Dec 9, 2019

Fixes #1892

Now pulls in code that is triggering the QA test suite and also now exits out of the sub-scripts if there is a unit test failure.

@hoffmabc hoffmabc closed this Dec 9, 2019
@hoffmabc hoffmabc reopened this Dec 9, 2019
@coveralls
Copy link

coveralls commented Dec 9, 2019

Coverage Status

Coverage remained the same at 38.466% when pulling ec7f549 on brian.qarunner into 3a6184d on master.

@hoffmabc hoffmabc closed this Dec 9, 2019
@hoffmabc hoffmabc reopened this Dec 9, 2019
@hoffmabc hoffmabc closed this Dec 9, 2019
@hoffmabc hoffmabc reopened this Dec 9, 2019
Copy link
Member

@szollo szollo left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

Add qa build script

Update scripts
Exit bash script if failure
@hoffmabc hoffmabc changed the title QA Runner (#1892) QA Runner Dec 9, 2019
@hoffmabc hoffmabc self-assigned this Dec 9, 2019
@placer14 placer14 self-requested a review December 13, 2019 14:55
@hoffmabc hoffmabc added needs confirmation 🔍 readyForReview Issue or PR ready for code review prior to closing. labels Dec 13, 2019
Optimized so less volatile changes are done first (to take advantage
of docker's image caching when possible) and changed the default command
to use the Makefile targets for QA test suite.
OPENBAZAARD_NAME ?= openbazaard-$(GIT_TAG)-$(GIT_SHA)
BITCOIND_PATH ?= .

.PHONY: openbazaard
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This isn't a phony make target.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

agreed

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was concerned that the build output makes an openbazaard-<GITTAG>-<GITSHA> file... not openbazaard. Does that matter? (Not a makefile expert.)

Dockerfile.dev Outdated
mv ./include/* /usr/local/include/ && \
mv ./bin/protoc /usr/local/bin/ && \
rm -rf ./include ./bin
FROM docker.dev.ob1.io/openbazaar-qa:0.10
Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍 very nice
image

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wonder if anyone not authenticated against our registry will be able to pull this image.

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Not sure. @tyler-smith ?

Copy link
Member

@placer14 placer14 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I refactored the Dockerfiles together and moved the qa_test.sh into the Makefile. The new Dockerfile defs seem to properly allow the container entrypoint to be executed as expected. I do see some cases where the make qa task ends without running the tests as follows:

make: Nothing to be done for 'qa'.
Setting status of 4f0a6b6a32df7c4959a83f89626bc3f3303589e4 to SUCCESS with url https://jenkins/job/openbazaar-qa/98/ and message: 'Build finished. '
Finished: SUCCESS

It seems the .PHONY call is not working in our jenkins environment? Might need to either enforce that make is built with support for .PHONY or not use Makefile. Ideas on this or maybe a misdiagnosis? @szollo @tyler-smith

@placer14
Copy link
Member

Discussion with @szollo suggests that we change the docker repo that holds openbazaar-qa and openbazaar-dev to be on the public Docker Hub repo instead of our internal repo. Will apply that change and get another review on this.

@placer14
Copy link
Member

Closing and opening to trigger jenkins build...

@placer14 placer14 closed this Dec 17, 2019
@placer14 placer14 reopened this Dec 17, 2019
@placer14
Copy link
Member

Trigger another build...

@placer14 placer14 closed this Dec 17, 2019
@placer14 placer14 reopened this Dec 17, 2019
It always includes the most recent tag regardless if the SHA derives
from that tag or not and is not representative of what the binary was
built from.
@placer14 placer14 merged commit f18dc00 into master Dec 17, 2019
@placer14 placer14 deleted the brian.qarunner branch December 17, 2019 14:54
@placer14 placer14 changed the title (#1892) QA Runner (#1892) QA Runner improves for use in CI Feb 13, 2020
@placer14 placer14 changed the title (#1892) QA Runner improves for use in CI (#1892) QA Runner improvements for use in CI Feb 13, 2020
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
needs confirmation 🔍 readyForReview Issue or PR ready for code review prior to closing.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Ensure QA Test Suite is Executing on Jenkins Correctly
5 participants