Add e2e test for HA cluster to make sure coordinators are changed

[johscheuer]

Description

Add e2e test for HA cluster to make sure coordinators are changed

Type of change

Please select one of the options below.

• Other

Discussion

e2e test case to verify: https://forums.foundationdb.org/t/multi-dc-coordinators/4503/4

Testing

Ran manually:

------------------------------
[AfterSuite]
/Users/jscheuermann/go/src/github.com/FoundationDB/fdb-kubernetes-operator/e2e/test_operator_ha/operator_ha_test.go:79
[AfterSuite] PASSED [0.000 seconds]
------------------------------
[ReportAfterSuite] Autogenerated ReportAfterSuite for --junit-report
autogenerated by Ginkgo
[ReportAfterSuite] PASSED [0.003 seconds]
------------------------------

Ran 1 of 2 Specs in 892.127 seconds
SUCCESS! -- 1 Passed | 0 Failed | 0 Pending | 1 Skipped
PASS | FOCUSED
FAIL    github.com/FoundationDB/fdb-kubernetes-operator/e2e/test_operator_ha    892.566s
FAIL

Documentation

Follow-up

[nicmorales9]

LGTM!
could be worth adding a comment noting that the new connection string also implies that the correct number of coordinators have been recruited (I had to check personally, and people from the forum link might want that explanation, though I suppose this approval-comment probably does the job so maybe forget it....)

[foundationdb-ci]

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

• Commit ID: b5e97b9
• Duration 2:35:34
• Result: ❌ FAILED
• Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

• Commit ID: f18e648
• Duration 2:45:48
• Result: ❌ FAILED
• Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)

[foundationdb-ci]

Result of fdb-kubernetes-operator-pr on Linux CentOS 7

• Commit ID: 75cbcbc
• Duration 2:47:04
• Result: ❌ FAILED
• Error: Error while executing command: if $fail_test; then exit 1; fi. Reason: exit status 1
• Build Log terminal output (available for 30 days)
• Build Workspace zip file of the working directory (available for 30 days)