Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

The TestCheckDefaultKubeletConfig end-to-end test fails on OpenShift 4.12 #164

Open
rhmdnd opened this issue Oct 19, 2022 · 0 comments
Open

Comments

@rhmdnd
Copy link

rhmdnd commented Oct 19, 2022

We've noticed failures in CI after upgrading to 4.12 clusters for testing, see openshift/release#33214:

TestE2E/Parallel_tests/TestCheckDefaultKubeletConfig
helpers.go:298: expecting COMPLIANT got NOT-APPLICABLE 

Test output:

    --- FAIL: TestE2E/Parallel_tests (0.00s)
        --- PASS: TestE2E/Parallel_tests/TestGenericRemediationFailsWithUnkownType (5.12s)
        --- PASS: TestE2E/Parallel_tests/TestSuiteWithInvalidScheduleShowsError (10.23s)
        --- PASS: TestE2E/Parallel_tests/TestApplyGenericRemediation (15.20s)
        --- PASS: TestE2E/Parallel_tests/TestPatchGenericRemediation (15.34s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithEmptyTailoringCMNameFails (30.16s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithInvalidScanTypeFails (30.19s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithInvalidContentFails (55.20s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithNodeSelectorNoMatches (25.16s)
        --- PASS: TestE2E/Parallel_tests/TestMalformedTailoredScanFails (75.36s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithInvalidProfileFails (80.31s)
        --- PASS: TestE2E/Parallel_tests/TestScanStorageOutOfLimitRangeFails (10.50s)
        --- PASS: TestE2E/Parallel_tests/TestScanSettingBindingWatchesTailoredProfile (15.39s)
        --- PASS: TestE2E/Parallel_tests/TestManualRulesTailoredProfile (120.63s)
        --- PASS: TestE2E/Parallel_tests/TestSingleTailoredPlatformScanSucceeds (75.22s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuiteInvalidPriorityClass (135.28s)
        --- PASS: TestE2E/Parallel_tests/TestRulesAreClassifiedAppropriately (0.24s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithUnexistentResourceFails (55.27s)
        --- FAIL: TestE2E/Parallel_tests/TestCheckDefaultKubeletConfig (125.40s)
        --- PASS: TestE2E/Parallel_tests/TestProfileModification (137.91s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuitePriorityClass (145.34s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithMissingTailoringCMFailsAndRecovers (145.48s)
        --- PASS: TestE2E/Parallel_tests/TestInvalidBundleWithNoTag (5.12s)
        --- PASS: TestE2E/Parallel_tests/TestSingleScanWithStorageSucceeds (135.27s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuiteUpdate (150.58s)
        --- PASS: TestE2E/Parallel_tests/TestInvalidBundleWithUnexistentRef (15.11s)
        --- PASS: TestE2E/Parallel_tests/TestScanWithNodeSelectorFiltersCorrectly (110.56s)
        --- PASS: TestE2E/Parallel_tests/TestMissingPodInRunningState (165.41s)
        --- PASS: TestE2E/Parallel_tests/TestSingleTailoredScanSucceeds (110.24s)
        --- PASS: TestE2E/Parallel_tests/TestSuiteWithContentThatDoesNotMatch (175.25s)
        --- PASS: TestE2E/Parallel_tests/TestScanSettingBinding (105.71s)
        --- PASS: TestE2E/Parallel_tests/TestParsingErrorRestartsParserInitContainer (95.46s)
        --- PASS: TestE2E/Parallel_tests/TestScanProducesRemediations (90.44s)
        --- PASS: TestE2E/Parallel_tests/TestSingleScanSucceeds (100.48s)
        --- PASS: TestE2E/Parallel_tests/TestProfileISTagUpdate (141.24s)
        --- PASS: TestE2E/Parallel_tests/TestProfileISTagOtherNs (146.09s)
        --- PASS: TestE2E/Parallel_tests/TestScheduledSuite (435.66s)
    --- PASS: TestE2E/Serial_tests (2438.69s)
        --- PASS: TestE2E/Serial_tests/TestScanStorageOutOfQuotaRangeFails (5.27s)
        --- PASS: TestE2E/Serial_tests/TestSuiteScan (126.45s)
        --- PASS: TestE2E/Serial_tests/TestTolerations (80.58s)
        --- PASS: TestE2E/Serial_tests/TestAutoRemediate (441.90s)
        --- PASS: TestE2E/Serial_tests/TestUnapplyRemediation (422.08s)
        --- PASS: TestE2E/Serial_tests/TestInconsistentResult (75.81s)
        --- PASS: TestE2E/Serial_tests/TestPlatformAndNodeSuiteScan (196.29s)
        --- PASS: TestE2E/Serial_tests/TestUpdateRemediation (437.41s)
        --- PASS: TestE2E/Serial_tests/TestProfileBundleDefaultIsKept (165.53s)
        --- PASS: TestE2E/Serial_tests/TestVariableTemplate (140.93s)
        --- PASS: TestE2E/Serial_tests/TestKubeletConfigRemediation (346.45s)
FAIL
FAIL    github.com/ComplianceAsCode/compliance-operator/tests/e2e       3194.980s
FAIL
make: *** [Makefile:563: e2e] Error 1

We can also recreate this locally by building the operator, deploying it into a 4.12 cluster, and running the e2e tests. At the moment, our CI is broken until we fix this issue.

I reproduced using:

$ export IMAGE_REPO=quay.io/lbragsta/
$ export TAG=`uuidgen`
$ make image && make push
$ make e2e
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant