Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

test: run slow tests without race detector in CI #338

Merged
merged 6 commits into from
Nov 23, 2020

Conversation

erikgrinaker
Copy link
Contributor

@erikgrinaker erikgrinaker commented Nov 23, 2020

No description provided.

@erikgrinaker
Copy link
Contributor Author

Well, that didn't really help much. Locally I'm seeing 70-90% reductions in test time, but then I also have an 8-core machine. GitHub actions uses 2 cores, I think.

Will try using default parallelism (2) in case the additional jobs just cause more overhead.

t.Run(fmt.Sprintf("Seed %v", seed), func(t *testing.T) {
if testing.Short() && i >= 2 {
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

😄

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Hm?

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Just a smile for going with shortening the amount of test cases.

@erikgrinaker
Copy link
Contributor Author

Got it down to <4 minutes by reducing the number of large tests with the race detector enabled, and instead run larger data sets without race detector. E.g. we run two TestRandomOperations with race detector enabled, and 10 with it disabled. WDYT @marbar3778?

Copy link
Member

@tac0turtle tac0turtle left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

looks good to me. Thank you for taking the time to make this go faster.

@erikgrinaker erikgrinaker changed the title test: run randomized tests in parallel test: run slow tests without race detector in CI Nov 23, 2020
@erikgrinaker
Copy link
Contributor Author

Superseded by #338.

@erikgrinaker erikgrinaker reopened this Nov 23, 2020
@erikgrinaker erikgrinaker merged commit 775339b into master Nov 23, 2020
@erikgrinaker erikgrinaker deleted the erik/test-random-parallel branch November 23, 2020 20:18
KamiD added a commit to okblockchainlab/iavl that referenced this pull request Apr 10, 2021
* fix: constant overflow when compiling for 32bit machines (cosmos#318)

on Go 1.x(x) all constants are ints by default which causing
build for 32bit machines to fail due to overflow
golang/go#23086

Signed-off-by: Artur Troian <troian.ap@gmail.com>

* changelog: release 0.14.2

* lint: update golangci-lint to 1.29 (cosmos#297)

* ci: freeze golangci action version (cosmos#303)

* github: bump golangci-lint and fix linter issues (cosmos#325)

* test: check stray database entries in TestRandomOperations (cosmos#326)

Checks that we don't leave behind any junk in the database, as reported in cosmos#324.

* revert Protobuf methods accidentally cherry-picked in a41e36b

* go.mod: bump tm-db to 0.5.2

* fix DeleteVersions stray orphans, and add DeleteVersionsRange (cosmos#324)

* test: add TestRandomOperations case for DeleteVersions

* test: run slow tests without race detector in CI (cosmos#338)

* changelog: release 0.14.3 (cosmos#333)

Co-authored-by: Artur Troian <troian@users.noreply.github.com>
Co-authored-by: Erik Grinaker <erik@interchain.berlin>
Co-authored-by: Marko <marbar3778@yahoo.com>
Co-authored-by: Klimov Sergey <klim0v-sergey@yandex.ru>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants