ci: k8s agents in the ci

[v1v]

What does this PR do?

Let's try to run the k8s agents and monitor the status

Issues

Superseedes #2311

[apmmachine]

💚 Build Succeeded

the below badges are clickable and redirect to their specific view in the CI or DOCS

Expand to view the summary

Build stats

• Start Time: 2022-03-07T12:09:10.780+0000

• Duration: 58 min 32 sec

Test stats 🧪

Test	Results
Failed	0
Passed	4176
Skipped	116
Total	4292

💚 Flaky test report

Tests succeeded.

🤖 GitHub comments

To re-run your PR in the CI, just comment with:

• /test : Re-trigger the build.

• run benchmark tests : Run the benchmark tests.

• run jdk compatibility tests : Run the JDK Compatibility tests.

• run integration tests : Run the Agent Integration tests.

• run end-to-end tests : Run the APM-ITs.

• run windows tests : Build & tests on windows.

• run elasticsearch-ci/docs : Re-trigger the docs validation. (use unformatted text in the comment!)

[v1v]

I'll close this PR now, we have now since we have enough builds to compare with

<style type="text/css"></style>

Build	Duration
#101	57 min
#100	30 min
#99	57 min
#98	22 min
#97	55 min
#96	48 min
#95	52 min
#94	38 min
#93	55 min
#92	51 min
#91	36 min
#90	35 min
#89	52 min
#88	53 min
#87	48 min
#86	12 min
#85	48 min
#84	48 min
#83	14 min
#82	50 min
#81	50 min
#80	35 min
#79	50 min
#78	8 min 56 sec
#77	53 min
#76	54 min
#75	51 min
#74	51 min
#73	51 min
#72	56 min
#71	56 min
#70	52 min
#69	53 min
#68	52 min
#67	53 min
#66	51 min
#65	38 min
#64	50 min
#63	53 min
#62	52 min
#61	54 min
#60	51 min
#59	51 min
#58	35 min
#57	54 min
#56	52 min
#55	50 min
#54	49 min
#53	50 min
#52	52 min