[Heartbeat] Add httpcommon options to ZipURL

[andrewvc]

What does this PR do?

Support httpcommon options for zip_url sources for browser based monitors. This adds custom SSL, proxy, and timeout options.

Fixes #27597

Why is it important?

In large enterprises its common to use custom CAs, proxies, etc.

Checklist

• My code follows the style guidelines of this project
• I have commented my code, particularly in hard-to-understand areas
• I have made corresponding changes to the documentation
• I have made corresponding change to the default configuration files
• I have added tests that prove my fix is effective or that my feature works
• I have added an entry in CHANGELOG.next.asciidoc or CHANGELOG-developer.next.asciidoc.

How to test this PR locally

You'll need to run this in the x-pack/heartbeat directory with the following monitor config that proves the ssl options provided by httpcommon are in effect. The below config intentionally uses an outdated protocol (TLSv1.0) which github will refuse to serve.

heartbeat.monitors:
- name: Todos
  id: todos
  type: browser
  enabled: true
  schedule: "@every 3m"
  tags: todos-app
  params:
    url: "https://elastic.github.io/synthetics-demo/"
  source:
    zip_url: 
      url: "https://github.com/elastic/synthetics-demo/archive/refs/heads/main.zip"
      folder: "todos/synthetics-tests"
      ssl:
        supported_protocols: ["TLSv1.0"]

Should yield the following error event (which I've helpfully JSON formatted here. It can be easier to test this with the output.console: ~ instead of the default output.elasticsearch option.

{
	"@timestamp": "0001-01-01T00:00:00.000Z",
	"@metadata": {
		"beat": "heartbeat",
		"type": "_doc",
		"version": "8.0.0"
	},
	"error": {
		"message": "could not fetch for suite job: could not check if zip source changed for https://github.com/elastic/synthetics-demo/archive/refs/heads/main.zip: Head \"https://github.com/elastic/synthetics-demo/archive/refs/heads/main.zip\": remote error: tls: protocol version not supported",
		"type": "io"
	},
	"tags": ["todos-app"],
	"event": {
		"dataset": "browser"
	},
	"ecs": {
		"version": "1.11.0"
	},
	"agent": {
		"ephemeral_id": "75134b46-d5df-4c86-afd0-f0edeb98b471",
		"id": "676de04f-0e18-4be3-ac13-eaa611089369",
		"name": "LAPTOP-80O11FM2",
		"type": "heartbeat",
		"version": "8.0.0"
	},
	"observer": {
		"ip": ["172.31.124.252", "fe80::215:5dff:feab:a8f0"],
		"mac": ["ce:16:bd:46:2b:a8", "1a:2f:00:7f:96:e6", "00:15:5d:ab:a8:f0"],
		"hostname": "LAPTOP-80O11FM2"
	},
	"monitor": {
		"timespan": {
			"lt": "2021-09-02T01:39:54.310Z",
			"gte": "2021-09-02T01:36:54.310Z"
		},
		"id": "todos",
		"name": "Todos",
		"status": "down",
		"type": "browser"
	}
}

[elasticmachine]

Pinging @elastic/uptime (Team:Uptime)

[elasticmachine]

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

• Start Time: 2021-09-07T23:32:22.524+0000

• Duration: 67 min 2 sec

• Commit: abff168

Test stats 🧪

Test	Results
Failed	0
Passed	3493
Skipped	80
Total	3573

Trends 🧪

💚 Flaky test report

Tests succeeded.

Expand to view the summary

Test stats 🧪

Test	Results
Failed	0
Passed	3493
Skipped	80
Total	3573

[justinkambic]

I'm seeing the desired output, and it goes away when I remove the unsupported protocol from the config. Smoke test is looking good. Unsure if there are any other variables to check.

[vigneshshanmugam]

Code changes LGTM, Would need to cleanup heartbeat.yml before merging in.

[andrewvc]

@Mergifyio backport 7.x

[mergify]

Command backport 7.x: success

Backports have been created

• #27790 [Heartbeat] Add httpcommon options to ZipURL (backport #27699) has been created for branch 7.x