feat: increase elasticsearch nodes to 3

[aabouzaid]

Which problem does the PR fix?

Task: #2224

What's in this PR?

• Increase elasticsearch nodes to 3.
• Set elasticsearch.master.podAntiAffinityPreset: hard so ES Pods don't run on the same K8s worker.

Checklist

Please make sure to follow our Contributing Guide.

Before opening the PR:

• In the repo's root dir, run make go.update-golden-only.
• There is no other open pull request for the same update/change.
• Tests for charts are added (if needed).
• In-repo documentation are updated (if needed).

After opening the PR:

• Did you sign our CLA (Contributor License Agreement)? It will show once you open the PR.
• Did all checks/tests pass in the PR?