Add workflow test hack

[jotak]

Hey,
There's been a bunch of regressions lately because of changes in the makefile and/or workflow, so I've written some "tests" around that. They don't yet cover everything I want (e.g. they should also cover everything that is documented in RELEASE.md and DEVELOPMENT.md)

[msherif1234]

@jotak do u have a logs of sample run of this new github action ?

[jotak]

@msherif1234 it's not a github action - at least not yet - at the moment it's something to run manually on demand - e.g. when modifying the makefiles and wanting to make sure we don't break things. Most of the time, it's not useful to run it.

Here's an output example:

$ make test-workflow 
hack/test-workflow.sh
🥁🥁🥁 TESTING push_image_pr.yml 🥁🥁🥁
↘️  Running step 'build images' (push_image_pr.yml)
IMG=quay.io/netobserv/network-observability-operator:temp make ci-images-build
Successfully tagged quay.io/netobserv/network-observability-operator:3b2e19fe
↘️  Running step 'build bundle' (push_image_pr.yml)
VERSION=3b2e19fe PLG_VERSION=main FLP_VERSION=main BPF_VERSION=main BUNDLE_VERSION=0.0.0-3b2e19fe make bundle shortlived-bundle-build
Successfully tagged quay.io/netobserv/network-observability-operator-bundle:v0.0.0-3b2e19fe
↘️  Running step 'build catalog' (push_image_pr.yml)
OPM_OPTS=--permissive BUNDLE_VERSION=0.0.0-3b2e19fe make shortlived-catalog-build
Successfully tagged quay.io/netobserv/network-observability-operator-catalog:v0.0.0-3b2e19fe
✅

🥁🥁🥁 TESTING push_image.yml 🥁🥁🥁
↘️  Running step 'build images' (push_image.yml)
IMG=quay.io/netobserv/network-observability-operator:main make ci-images-build
Successfully tagged quay.io/netobserv/network-observability-operator:main
↘️  Running step 'build bundle' (push_image.yml)
VERSION=main PLG_VERSION=main FLP_VERSION=main BPF_VERSION=main BUNDLE_VERSION=0.0.0-main make bundle bundle-build
Successfully tagged quay.io/netobserv/network-observability-operator-bundle:v0.0.0-main
↘️  Running step 'build catalog' (push_image.yml)
OPM_OPTS=--permissive BUNDLE_VERSION=0.0.0-main make catalog-build
✅

🥁🥁🥁 TESTING make update-bundle 🥁🥁🥁
✅

🥁🥁🥁 TESTING release.yml 🥁🥁🥁
↘️  Running step 'build operator' (release.yml)
IMG=quay.io/netobserv/network-observability-operator:1.0.42 make image-build
Successfully tagged quay.io/netobserv/network-observability-operator:1.0.42
↘️  Running step 'build bundle' (release.yml)
BUNDLE_VERSION=1.0.42 IMAGE_TAG_BASE=quay.io/netobserv/network-observability-operator make bundle-build
Successfully tagged quay.io/netobserv/network-observability-operator-bundle:v1.0.42
↘️  Running step 'build catalog' (release.yml)
OPM_OPTS=--permissive BUNDLE_VERSION=1.0.42 IMAGE_TAG_BASE=quay.io/netobserv/network-observability-operator make catalog-build

✅ Looks good to me!

And an example of failure:

$ make test-workflow 
hack/test-workflow.sh
🥁🥁🥁 TESTING push_image_pr.yml 🥁🥁🥁
↘️  Running step 'build images' (push_image_pr.yml)
IMG=quay.io/netobserv/network-observability-operator:temp make ci-images-build
Successfully tagged quay.io/netobserv/network-observability-operator:3b2e19fe
↘️  Running step 'build bundle' (push_image_pr.yml)
VERSIONZ=3b2e19fe PLG_VERSION=main FLP_VERSION=main BPF_VERSION=main BUNDLE_VERSION=0.0.0-3b2e19fe make bundle shortlived-bundle-build
Successfully tagged quay.io/netobserv/network-observability-operator-bundle:v0.0.0-3b2e19fe
❌ Failure: expected 2 occurrences of "quay.io/netobserv/network-observability-operator:3b2e19fe" in bundle/manifests/netobserv-operator.clusterserviceversion.yaml, found 0.

[jpinsonneau]

LGTM, thanks @jotak !

[jotak]

/approve

[openshift-ci]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: jotak

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [jotak]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment