Skip to content

Releases: redhat-best-practices-for-k8s/certsuite

v5.3.0

19 Aug 19:58
547c00d
Compare
Choose a tag to compare

v5.3.0

We have completed an organization rename:

  • test-network-function --> redhat-best-practices-for-k8s

This has affected changes across all of our repositories to change all of our go modules, etc. We have also changed all of our image repositories on quay as well:

https://quay.io/organization/redhat-best-practices-for-k8s

Improvements

Dependency Updates

Full Changelog: v5.2.3...v5.3.0

v5.2.3

31 Jul 13:56
df47974
Compare
Choose a tag to compare

v5.2.3

The v5.2.3 release of the test suite has a couple of notable changes such as a fix for the PDB test case and marking the read-only filesystem operator test as an 'Optional' test case.

This is also the first release that is using the new k8s-best-practices-debug image for the debug pod that spawns as part of the test suite.

Test Case Changes

  • Mark read-only filesystem test as Optional by @sebrandon1 in #2245
  • tests/observability: fix observability-pod-disruption-budged test case by @jmontesi in #2285

Improvements

Documentation Updates

Dependency Updates

  • Bump github.com/test-network-function/oct from 0.0.14 to 0.0.15 by @dependabot in #2246
  • Bump github/codeql-action from 3.25.11 to 3.25.12 by @dependabot in #2248
  • Bump github.com/test-network-function/privileged-daemonset from 1.0.27 to 1.0.28 by @dependabot in #2247
  • Bump docker/build-push-action from 6.3.0 to 6.4.0 by @dependabot in #2255
  • Bump github.com/test-network-function/test-network-function-claim from 1.0.41 to 1.0.42 by @dependabot in #2256
  • Update preflight to v1.10.0 by @sebrandon1 in #2260
  • Missed version update for golangci by @sebrandon1 in #2261
  • Bump docker/build-push-action from 6.4.0 to 6.4.1 by @dependabot in #2262
  • Bump k8s.io/client-go from 0.30.2 to 0.30.3 by @dependabot in #2267
  • Bump k8s.io/apiextensions-apiserver from 0.30.2 to 0.30.3 by @dependabot in #2268
  • Bump k8s.io/kubectl from 0.30.2 to 0.30.3 by @dependabot in #2266
  • Bump github/codeql-action from 3.25.12 to 3.25.13 by @dependabot in #2270
  • Bump docker/setup-buildx-action from 3.4.0 to 3.5.0 by @dependabot in #2271
  • Bump docker/login-action from 3.2.0 to 3.3.0 by @dependabot in #2273
  • Bump docker/setup-qemu-action from 3.1.0 to 3.2.0 by @dependabot in #2272
  • Bump docker/build-push-action from 6.4.1 to 6.5.0 by @dependabot in #2274
  • Bump github.com/test-network-function/oct from 0.0.15 to 0.0.16 by @dependabot in #2275
  • Bump ubi9/ubi from 9.4-1123.1719560047 to 9.4-1181 by @dependabot in #2288
  • Bump ubi9/ubi-minimal from 9.4-1134 to 9.4-1194 by @dependabot in #2287
  • Bump ubi9/python-39 from 1-186.1720018722 to 1-192 in /.github/actions/documentation by @dependabot in #2286
  • Bump docker/setup-buildx-action from 3.5.0 to 3.6.1 by @dependabot in #2297
  • Bump github.com/test-network-function/privileged-daemonset from 1.0.28 to 1.0.29 by @dependabot in #2298
  • Bump github.com/docker/docker from 25.0.5+incompatible to 26.1.4+incompatible by @dependabot in #2300
  • Bump golangci/golangci-lint-action from 6.0.1 to 6.1.0 by @dependabot in #2301
  • Bump github/codeql-action from 3.25.14 to 3.25.15 by @dependabot in #2293
  • Bump ossf/scorecard-action from 2.3.3 to 2.4.0 by @dependabot in #2292
  • Bump github.com/test-network-function/test-network-function-claim from 1.0.42 to 1.0.43 by @dependabot in #2294
  • Bump github/codeql-action from 3.25.13 to 3.25.14 by @dependabot in #2290

New Contributors

Full Changelog: v5.2.2...v5.2.3

v5.2.2

11 Jul 19:57
bd69f63
Compare
Choose a tag to compare

v5.2.2

This was a quick turnaround release where we did some notable changes:

  • Changed the access-control-namespace test from Mandatory to Optional for all scenarios.
  • Released a new version of the parser with v0.4.7. Found here.

Note: There were no changes in the -partner repository, so the partner version.json did not need an update at this point.

Improvements

Dependency Updates

Full Changelog: v5.2.1...v5.2.2

v5.2.1

09 Jul 19:53
5c2738d
Compare
Choose a tag to compare

v5.2.1

This version of the certsuite introduces 4 new operator suite tests:

  • testOperatorPodsRunAsUserID(): This test verifies that no pods managed by operators run with the root user ID (UID) of 0, which could introduce security vulnerabilities.
  • testOperatorPodsRunAsNonRoot(): This test ensures that pods managed by operators adhere to security best practices by running as non-root users.
  • testOperatorPodsAutomountTokens(): This test evaluates the configuration of automount service tokens in pods managed by operators.
  • testOperatorContainersReadOnlyFilesystem(): This test verifies whether containers within pods managed by operators have a read-only root filesystem, enhancing security by preventing unauthorized modifications.

New Operator Tests

Improvements

Dependency Updates

  • Bump github/codeql-action from 3.25.10 to 3.25.11 by @dependabot in #2211
  • Bump ubi9/python-39 from 1-186 to 1-186.1719562233 in /.github/actions/documentation by @dependabot in #2217
  • Bump ubi9/ubi from 9.4-1123 to 9.4-1123.1719560047 by @dependabot in #2218
  • Bump docker/setup-qemu-action from 3.0.0 to 3.1.0 by @dependabot in #2221
  • Bump docker/build-push-action from 6.2.0 to 6.3.0 by @dependabot in #2220
  • Bump docker/setup-buildx-action from 3.3.0 to 3.4.0 by @dependabot in #2222
  • Bump actions/download-artifact from 4.1.7 to 4.1.8 by @dependabot in #2225
  • Bump actions/upload-artifact from 4.3.3 to 4.3.4 by @dependabot in #2226
  • Bump golang.org/x/term from 0.21.0 to 0.22.0 by @dependabot in #2224
  • Bump certifi from 2024.2.2 to 2024.7.4 in /.github/actions/documentation by @dependabot in #2227
  • Update Go to v1.22.5 by @sebrandon1 in #2229
  • Bump github.com/test-network-function/oct from 0.0.12 to 0.0.14 by @dependabot in #2232
  • Bump zipp from 3.18.1 to 3.19.1 in /.github/actions/documentation by @dependabot in #2234
  • Bump github.com/test-network-function/test-network-function-claim from 1.0.39 to 1.0.41 by @dependabot in #2233
  • Bump ubi9/python-39 from 1-186.1719562233 to 1-186.1720018722 in /.github/actions/documentation by @dependabot in #2230
  • Update GolangCI-lint to v1.59.1 by @sebrandon1 in #2216

Full Changelog: v5.2.0...v5.2.1

v5.2.0

28 Jun 16:35
f67a1c1
Compare
Choose a tag to compare

v5.2.0

With the v5.2.0 release of the test suite, we have done some underlying changes to the way the test suite is ran. Mainly, we have removed the bash scripts that were previously needed to kick things off. Now all you need to run the test suite is our new certsuite binary. We will also be publishing the binaries on release built for different architectures.

The documentation and the README have been updated with this new information as well.

Script Removal

CI Updates

  • workflows: add new workflow to upload release assets by @jmontesi in #2208
  • workflows: several fixes to upload release assets by @jmontesi in #2209

Dependency Updates

  • Bump github.com/test-network-function/privileged-daemonset from 1.0.26 to 1.0.27 by @dependabot in #2206

Full Changelog: v5.1.3...v5.2.0

v5.1.3

26 Jun 18:46
d6690e9
Compare
Choose a tag to compare

v5.1.3

Brings in a fix for the IsRedHatRelease test to allow for images that somehow show they are "Beta".

Improvements

Documentation Updates

  • docs: update to show how to run the test suite with the "certsuite" cmd by @jmontesi in #2174
  • docs: move and rename docs on how to run the Test Suite inside a cluster pod by @jmontesi in #2192

CI Updates

Dependency Updates

Github Actions Updates

  • Bump peter-evans/create-pull-request from 6.0.5 to 6.1.0 by @dependabot in #2177
  • Bump docker/build-push-action from 6.0.0 to 6.0.1 by @dependabot in #2178
  • Bump docker/build-push-action from 6.0.1 to 6.0.2 by @dependabot in #2182
  • Bump ludeeus/action-shellcheck from cd81f4475ab741e097ec0fe73b692f3e49d66b8c to 00b27aa7cb85167568cb48a3838b75f4265f2bca by @dependabot in #2183
  • Bump docker/build-push-action from 6.0.2 to 6.1.0 by @dependabot in #2188
  • Bump docker/build-push-action from 6.1.0 to 6.2.0 by @dependabot in #2201

Full Changelog: v5.1.2...v5.1.3

v5.1.2

18 Jun 15:42
4044829
Compare
Choose a tag to compare

v5.1.2

The most notable change to the certsuite functionality comes from #2145 where we changed the way we determine which operators to test in the operator suite. We changed it to only test operators that are listed in the TargetCrdFilters configuration variable instead of testing all operators on the cluster regardless if they were targeted for test or not.

Improvements

CI Updates

Doc Updates

  • Added Test Case Implementation subsection to docs site. by @greyerof in #2140

Operator Testing Script Updates

  • Use the certsuite command in "run-basic-batch-operators-test.sh" by @jmontesi in #2147

Dependency Updates

Go Mod Updates

Dockerfile Updates

  • Bump ubi9/ubi from 9.4-947.1716476138 to 9.4-947.1717074712 by @dependabot in #2137
  • Bump ubi9/ubi-minimal from 9.4-949.1716471857 to 9.4-949.1717074713 by @dependabot in #2138
  • Bump ubi9/python-39 from 1-182.1716478612 to 1-182.1717085980 in /.github/actions/documentation by @dependabot in #2136
  • Bump ubi9/python-39 from 1-182.1717085980 to 1-186 in /.github/actions/documentation by @dependabot in #2162
  • Bump ubi9/ubi-minimal from 9.4-949.1717074713 to 9.4-1134 by @dependabot in #2159
  • Bump ubi9/ubi from 9.4-947.1717074712 to 9.4-1123 by @dependabot in #2158

Github Action Updates

Full Changelog: v5.1.1...v5.1.2

v5.1.1

30 May 17:01
0e89077
Compare
Choose a tag to compare

v5.1.1

This release includes a number of improvements surrounding our CLI and how the test suite is ran.

There was a bug found in the RHCOS version compatibility test that was fixed in #2109 for OCP beta versions greater than 4.14.

Bug Fixes and Improvements

  • feat : Add a link back to the test case that mentioned security categories by @bnshr in #2075
  • Operators script: label pods under test after waiting for all pods to come up by @edcdavid in #2096
  • Bug fix: adjust OCP beta slice by @sebrandon1 in #2109
  • Batch operators test catalog source automation by @shirmoran in #2107
  • log: rename global log file by @jmontesi in #2116

CLI Improvements

CI Updates

Dependency Updates

  • build(deps): bump k8s.io/apiextensions-apiserver from 0.30.0 to 0.30.1 by @dependabot in #2072
  • build(deps): bump helm.sh/helm/v3 from 3.14.4 to 3.15.0 by @dependabot in #2077
  • build(deps): bump k8s.io/kubectl from 0.29.4 to 0.30.1 by @dependabot in #2071
  • Update operator-sdk to v1.34.2 by @sebrandon1 in #2083
  • Update preflight to v1.9.5 by @sebrandon1 in #2081
  • build(deps): bump actions/checkout from 4.1.5 to 4.1.6 by @dependabot in #2082
  • build(deps): bump ubi9/python-39 from 1-182.1714671018 to 1-182.1715774360 in /.github/actions/documentation by @dependabot in #2090
  • build(deps): bump github/codeql-action from 3.25.5 to 3.25.6 by @dependabot in #2089
  • build(deps): bump requests from 2.31.0 to 2.32.0 in /.github/actions/documentation by @dependabot in #2091
  • build(deps): bump github.com/go-logr/logr from 1.4.1 to 1.4.2 by @dependabot in #2093
  • Bump helm.sh/helm/v3 from 3.15.0 to 3.15.1 by @dependabot in #2099
  • Bump github.com/operator-framework/api from 0.24.0 to 0.25.0 by @dependabot in #2100
  • Bump github.com/hashicorp/go-version from 1.6.0 to 1.7.0 by @dependabot in #2102
  • Bump docker/login-action from 3.1.0 to 3.2.0 by @dependabot in #2110
  • Bump ubi9/python-39 from 1-182.1715774360 to 1-182.1716478612 in /.github/actions/documentation by @dependabot in #2108
  • Bump ubi9/ubi-minimal from 9.4-949.1714662671 to 9.4-949.1716471857 by @dependabot in #2113
  • Bump ubi9/ubi from 9.4-947.1714667021 to 9.4-947.1716476138 by @dependabot in #2114

Full Changelog: v5.1.0...v5.1.1

v5.1.0

15 May 16:30
995d946
Compare
Choose a tag to compare

v5.1.0

We have renamed the test suite from cnf-certification-test to Red Hat Best Practices Test Suite for Kubernetes.

Future Changes on the Roadmap:

  • Further releases in v5.1.x will include more tests in the operator test suite.
  • Modifications to how the test suite is ran/kicked off by removing the scripts and environment variables to provide a seamless way to run the binaries.
  • Since v5.0.8 we are now building arm64 images (see #1943), we have been experimenting with how to better test our new arm64 images on a fully arm enabled CI. This is an ongoing initiative that probably will not be completed until Github Actions allows for fully arm64 runners.

Test Suite Renaming

OSSF Additions

Various Updates

  • Group badges by @rdavid in #2029
  • Add README badges for QE OCP nightlies by @sebrandon1 in #2022
  • flags: add a new flag to provide a rhcos_version_map file by @jmontesi in #2047
  • Bug fix: avoid runtime panic (SIGSEGV) when using the list flag by @jmontesi in #2066
  • operatingsystem: embed rhcos_version_map file into the test suite binary by @jmontesi in #2052
  • scripts: use the test suite binary directly in "run-tnf-container.sh" by @jmontesi in #2033
  • style : Modify catalog generation to add 4 security contexts categories by @bnshr in #2044
  • main: simplify and move some functions to the certsuite and log packages by @jmontesi in #2060

CI Improvements

Dependency Updates

  • build(deps): bump actions/upload-artifact from 3.pre.node20 to 4.3.3 by @dependabot in #2016
  • build(deps): bump github/codeql-action from 3.24.9 to 3.25.3 by @dependabot in #2015
  • build(deps): bump actions/checkout from 4.1.1 to 4.1.4 by @dependabot in #2014
  • build(deps): bump ubi9/python-39 from 1-161 to 1-172.1712567222 in /.github/actions/documentation by @dependabot in #2013
  • build(deps): bump golangci/golangci-lint-action from 4 to 5 by @dependabot in #2008
  • Fix for missing frozen dependency by @edcdavid in #2020
  • build(deps): bump golangci/golangci-lint-action from 5.0.0 to 5.1.0 by @dependabot in #2021
  • build(deps): bump ubi9/python-39 from 1-172.1712567222 to 1-182 in /.github/actions/documentation by @dependabot in #2025
  • build(deps): bump ubi9/ubi from 9.3-1610 to 9.4-947 by @dependabot in #2026
  • Update machine-config-operator; update preflight to v1.9.2 by @sebrandon1 in #2024
  • build(deps): bump ubi9/ubi-minimal from 9.3-1612 to 9.4-949 by @dependabot in #2027
  • build(deps): bump actions/setup-go from 5.0.0 to 5.0.1 by @dependabot in #2030
  • build(deps): bump jinja2 from 3.1.3 to 3.1.4 in /.github/actions/documentation by @dependabot in #2041
  • build(deps): bump golangci/golangci-lint-action from 5.1.0 to 5.3.0 by @dependabot in #2038
  • build(deps): bump jinja2 from 3.1.3 to 3.1.4 in /.github/workflows by @dependabot in #2040
  • build(deps): bump ubi9/python-39 from 1-182 to 1-182.1714671018 in /.github/actions/documentation by @dependabot in #2037
  • build(deps): bump ubi9/ubi-minimal from 9.4-949 to 9.4-949.1714662671 by @dependabot in #2036
  • build(deps): bump ubi9/ubi from 9.4-947 to 9.4-947.1714667021 by @dependabot in #2035
  • build(deps): bump actions/checkout from 4.1.4 to 4.1.5 by @dependabot in #2046
  • build(deps): bump golangci/golangci-lint-action from 5.3.0 to 6.0.0 by @dependabot in #2045
  • build(deps): bump github/codeql-action from 3.25.3 to 3.25.4 by @dependabot in #2049
  • build(deps): bump golangci/golangci-lint-action from 6.0.0 to 6.0.1 by @dependabot in #2048
  • Update Go to v1.22.3 by @sebrandon1 in #2053
  • build(deps): bump github/codeql-action from 3.25.4 to 3.25.5 by @dependabot in #2061
  • build(deps): bump github.com/fatih/color from 1.16.0 to 1.17.0 by @dependabot in #2062
  • build(deps): bump ossf/scorecard-action from 2.3.1 to 2.3.3 by @dependabot in #2058
  • build(deps): bump golang.org/x/term from 0.19.0 to 0.20.0 by @dependabot in #2056
  • Update GolangCI-lint to v1.58.1 by @sebrandon1 in #2054
  • build(deps): bump github.com/operator-framework/api from 0.23.0 to 0.24.0 by @dependabot in #2057
  • Update preflight to v1.9.4 by @sebrandon1 in #2055

New Contributors

Full Changelog: v5.0.8...v5.1.0

v5.0.8

24 Apr 19:39
71b33d2
Compare
Choose a tag to compare

This release is a quick fix to update our affiliated-certification online/offline database of certified images.

Documentation Updates

Dependency Updates

CI Updates

Full Changelog: v5.0.7...v5.0.8