Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CI: Running on TiDB Operator Nodes. #1653

Merged
merged 5 commits into from
Feb 9, 2020

Conversation

cofyc
Copy link
Contributor

@cofyc cofyc commented Feb 7, 2020

Signed-off-by: Yecheng Fu fuyecheng@pingcap.com

What problem does this PR solve?

On these nodes, we configured 'cgroup.memory=nokmem' to avoid issues in
CentOS 7.6.

#1603 (comment)

it also fixes #1539

What is changed and how does it work?

Check List

Tests

  • Unit test
  • E2E test
  • Stability test
  • Manual test (add detailed scripts or steps below)
  • No code

Code changes

  • Has Go code change
  • Has CI related scripts change
  • Has Terraform scripts change

Side effects

  • Breaking backward compatibility

Related changes

  • Need to cherry-pick to the release branch
  • Need to update the documentation

Does this PR introduce a user-facing change?:

NONE

@cofyc cofyc changed the title Running on TiDB Operator Nodes. CI: Running on TiDB Operator Nodes. Feb 7, 2020
@cofyc cofyc force-pushed the running-on-tidb-operator-nodes branch from aa06abe to 80b9699 Compare February 7, 2020 08:29
@cofyc
Copy link
Contributor Author

cofyc commented Feb 7, 2020

/run-e2e-tests

1 similar comment
@cofyc
Copy link
Contributor Author

cofyc commented Feb 7, 2020

/run-e2e-tests

@@ -161,6 +173,8 @@ def call(BUILD_BRANCH, CREDENTIALS_ID, CODECOV_CREDENTIALS_ID) {
container("golang") {
def WORKSPACE = pwd()
dir("${PROJECT_DIR}") {
deleteDir()
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

because we reuse build_go1130_memvolume nodes to build, previous files of other jobs must be deleted first

failure logs on this PR: https://internal.pingcap.net/idc-jenkins/blue/organizations/jenkins/operator_ghpr_e2e_test_kind/detail/operator_ghpr_e2e_test_kind/2667/pipeline/39

2020-02-07T08:38:48.004Z] go vet check

[2020-02-07T08:38:49.901Z] # github.com/pingcap/tidb-operator/pkg/client/listers/pingcap/v1alpha1

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:28:41: undefined: v1alpha1.TidbClusterAutoScaler

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:31:2: undefined: TidbClusterAutoScalerListerExpansion

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:45:78: undefined: v1alpha1.TidbClusterAutoScaler

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:60:41: undefined: v1alpha1.TidbClusterAutoScaler

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:62:21: undefined: v1alpha1.TidbClusterAutoScaler

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:63:2: undefined: TidbClusterAutoScalerNamespaceListerExpansion

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:74:86: undefined: v1alpha1.TidbClusterAutoScaler

[2020-02-07T08:38:49.901Z] pkg/client/listers/pingcap/v1alpha1/tidbclusterautoscaler.go:82:66: undefined: v1alpha1.TidbClusterAutoScaler

@cofyc
Copy link
Contributor Author

cofyc commented Feb 7, 2020

/run-e2e-tests

@cofyc cofyc force-pushed the running-on-tidb-operator-nodes branch from da937db to 9eab3d9 Compare February 7, 2020 11:17
cofyc added 4 commits February 7, 2020 19:24
On these nodes, we configured 'cgroup.memory=nokmem' to avoid issues in
CentOS 7.6.

pingcap#1603 (comment)

Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>
Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>
Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>
Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>
@cofyc
Copy link
Contributor Author

cofyc commented Feb 7, 2020

/run-e2e-tests

1 similar comment
@cofyc
Copy link
Contributor Author

cofyc commented Feb 7, 2020

/run-e2e-tests

Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>
if errors.IsNotFound(err) {
// ignore not found error (pod is deleted and recreated again in restarting)
return false, nil
}
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fixes #1539

@cofyc cofyc requested review from Yisaer and weekface February 8, 2020 02:12
@@ -22,7 +22,7 @@ source $ROOT/hack/lib.sh

hack::ensure_terraform

terraform_modules=$(find ${ROOT}/deploy -not -path '*/\.*' -type f -name variables.tf | xargs -I{} -n1 dirname {})
terraform_modules=$(find ${ROOT}/deploy -mindepth 1 -maxdepth 1 -type d -a -not -name 'modules')
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

modules in deploy/modules are referenced by aliyun/gcp/aws, no need to check

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@cofyc cofyc requested review from aylei and tennix February 8, 2020 02:32
Copy link
Contributor

@aylei aylei left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@aylei aylei merged commit 4bd3012 into pingcap:master Feb 9, 2020
@sre-bot
Copy link
Contributor

sre-bot commented Feb 9, 2020

cherry pick to release-1.1 in PR #1660

Yisaer pushed a commit that referenced this pull request Feb 9, 2020
* Running on TiDB Operator Nodes.

On these nodes, we configured 'cgroup.memory=nokmem' to avoid issues in
CentOS 7.6.

#1603 (comment)

Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>

* clear previous files

Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>

* check gcp/aliyun/aws modules only

Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>

* use operator: Exists

Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>

* ignore not found error

Signed-off-by: Yecheng Fu <fuyecheng@pingcap.com>

Co-authored-by: Yecheng Fu <cofyc.jackson@gmail.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

e2e: "TiDBCluster Restarter: Testing restarting by annotations" is flaky
4 participants