Skip to content
This repository has been archived by the owner on Aug 2, 2022. It is now read-only.

Add Support for eosio-test-stability Pipeline #7883

Merged
merged 18 commits into from
Sep 12, 2019
Merged

Conversation

kj4ezj
Copy link
Contributor

@kj4ezj kj4ezj commented Sep 10, 2019

Change Description

There has been a lot of speculation surrounding our integration and long-running tests. Some engineers think they are flakey, others believe they are stable. Automation only cares about one thing: numbers. This pull request enables us to run the same tests on the same commit hash any number of times, given by the ROUNDS environment variable. To save resources, the build stops after the first failing round of tests.

In conjunction with these changes, I have introduced the eosio-test-stability pipeline in this pull request which has ROUNDS='1000' set by default.

Example

Consensus Changes

  • Consensus Changes
    None.

API Changes

  • API Changes
    None.

Documentation Additions

  • Documentation Additions
    None.

@kj4ezj kj4ezj marked this pull request as ready for review September 12, 2019 18:32
@kj4ezj kj4ezj changed the title Enable Test Stability Testing Add Support for eosio-test-stability Pipeline Sep 12, 2019
Copy link
Contributor

@scottarnette scottarnette left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🐕

@kj4ezj kj4ezj merged commit 17286b2 into develop Sep 12, 2019
@kj4ezj kj4ezj deleted the zach-test-stability branch September 12, 2019 23:52
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants