Migrate to v1 APIs for CRD, VWH, MWH

[yiqigao217]

Part of #1371

Migrate apiextensions from v1beta1 to v1:

1. Upgrade controller-tools to generate kubebuilder markers to use v1
   apis;
2. Replace v1beta1 with v1 in yaml files and patches;
3. Fix schema changes from v1beta1 to v1:
   a) SideEffects is required for v1 MWH, VWH;
   b) AdmissionReviewVersions is mandatory for v1;
   c) webhookClientConfig schema change in CRD;
   d) conversionReviewVersions in v1 CRD;
   e) add 1 more level of indention in enum singleton patch;
   f) add spec.scope and schema in testing CRD (they are required in v1);
   g) add v1beta1 to CRD spec.conversion.conversionReviewVersions and
   VWH admissionReviewVersions, since it's required in K8s 1.16 cluster.
4. E2e test in 1.16 and 1.17 K8s cluster and make test(got below issue
   and fixed);
5. Reinstall latest kubebuilder since controller-runtime envtest uses
   etcd and kube-apiserver loaded by default from
   /usr/local/kubebuilder/bin. (TODO will document this in the next PR in
   make test and HNC developer README).

[yiqigao217]

/assign @adrianludwin
/assign @rjbez17

[adrianludwin]

/lgtm
/approve
/hold
/assign @rjbez17

Looks great but I wouldn't mind another set of eyes on this

[k8s-ci-robot]

[APPROVALNOTIFIER] This PR is APPROVED

This pull-request has been approved by: adrianludwin, yiqigao217

The full list of commands accepted by this bot can be found here.

The pull request process is described here

Needs approval from an approver in each of these files:

• OWNERS [adrianludwin]

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[yiqigao217]

/hold

Seems v1beta1 is required in the CRD spec.conversion.conversionReviewVersions and VWH admissionReviewVersions in K8s 1.16 cluster. Testing now.

[yiqigao217]

Seems v1beta1 is required in the CRD spec.conversion.conversionReviewVersions and VWH admissionReviewVersions in K8s 1.16 cluster. Testing now.

Tested on 1.16 cluster after adding v1beta1 to the list and it worked. Also retested it in 1.17 cluster and it worked. Updated the PR message to reflect it.

[rjbez17]

/lgtm

Did you need the hold still for some testing? Sounds like it's all good but I'll leave it just in case.

[adrianludwin]

lgtm as well - @yiqigao217 please cancel the hold when you're comfortable.

[yiqigao217]

/hold cancel