Backport of Consul API Gateway, Add Tolerations support into release/0.49.x

[hc-github-team-consul-ecosystem]

Backport

This PR is auto-generated from #1650 to be assessed for backporting due to the inclusion of the label backport/0.49.x.

WARNING automatic cherry-pick of commits failed. Commits will require human attention.

merge conflict error: POST https://api.github.com/repos/hashicorp/consul-k8s/merges: 409 Merge conflict []

The below text is copied from the body of the original PR.

---

Changes proposed in this PR:

• At request of customer, add support for configuring tolerations to consul api gateway controller and gateway pods

How I've tested this PR:

• Updated Conformance test matrix in Add Support for Tolerations consul-api-gateway#426 to run the branch referenced in this PR

How I expect reviewers to test this PR:

• Tests in Add Support for Tolerations consul-api-gateway#426 pass
• Tests on this PR pass

Checklist:

• Tests added
• [ X ] CHANGELOG entry added

  HashiCorp engineers only, community PRs should not add a changelog entry.
  Entries should use present tense (e.g. Add support for...)

---

Overview of commits

• ed5a90e - ae7c41b - c00f778 - 0768b3f - 1d7de5d - 4abbebd - 71f56d8 - 971845b - 11f36d9 - a784247 - 5215c5c - cba28d5 - d02380f

[david-yu]

cc @sarahalsmiller which needs to resolved to be back ported to 0.49.x

[nathancoleman]

Resolving conflicts here in a moment...

[nathancoleman]

@sarahalsmiller @david-yu I've resolved merge conflicts here. Please review

[david-yu]

Looks good, assuming tests pass, please merge. Thank you.