Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Change to build tools module with all the versions by default #4230

Merged
merged 11 commits into from
Nov 29, 2021

Conversation

tgravescs
Copy link
Collaborator

Build the tools module all the time when building single version to make sure something doesn't get broken. Previously it only build with the Spark 3.1.1 version. Updated the build scripts to skip building it with the nightly when we build all the versions.

The buildlall script actually already skips it for most of the versions because it uses the -pl aggregator. The tools module gets built on the final mvn package command at the end.

I tested the nightly script with a test jenkins build and it only built tools jar once and it pushed it successfully.

@tgravescs tgravescs added the build Related to CI / CD or cleanly building label Nov 29, 2021
@tgravescs tgravescs self-assigned this Nov 29, 2021
@tgravescs
Copy link
Collaborator Author

build

@tgravescs
Copy link
Collaborator Author

tgravescs commented Nov 29, 2021

tests failed, unrelated, looks like no space on device:

12:09:39 - Exchange reuse *** FAILED ***
12:09:39 org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 92.0 failed 1 times, most recent failure: Lost task 0.0 in stage 92.0 (TID 994) : java.io.IOException: No space left on device

@tgravescs
Copy link
Collaborator Author

build

2 similar comments
@tgravescs
Copy link
Collaborator Author

build

@tgravescs
Copy link
Collaborator Author

build

@tgravescs tgravescs merged commit 11d924d into NVIDIA:branch-22.02 Nov 29, 2021
@tgravescs tgravescs deleted the toolbuild branch November 29, 2021 22:59
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
build Related to CI / CD or cleanly building
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants