Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[libbeat] AWS ELB Monitoring #12401

Merged
merged 78 commits into from
Jul 30, 2019
Merged

[libbeat] AWS ELB Monitoring #12401

merged 78 commits into from
Jul 30, 2019

Conversation

andrewvc
Copy link
Contributor

@andrewvc andrewvc commented Jun 3, 2019

Autodiscovery provider for AWS ELBs.

Not a lot to add besides that, the rest is in the docs provided within this PR.

One open question is the amount of testing to do here. We're still not sure if we want to introduce this as a beta feature, which might change the answer there. Ultimately, the AWS library is very tricky to mock. There is an elasticloadbalancingv2iface package that supposedly makes things easier, but realistically, you have to implement so much the value of that is dubious. Real functional testing with the AWS APIs is probably the only satisfactory answer, but that too is a significant investment.

In heartbeat we have separate notions of jobs and tasks.

This can make following the code and sharing the code among monitors confusing. This patch unifies the two. There is a tiny amount of extra execution overhead.

Tasks only passed a single `common.MapStr`, where we now pass a `*beat.Event`, however, the benefit is that we have a more consistent and simple codebase.
Checkpoint

Checkpoint

Simpler concurrency for ELB autodiscover

More cleanup

Checkpoint

Checkpoint

Improve hash consistency for aws elb autodisco

Moar

moar

Tighten up for initial review

Revert changes to autodiscover.go

Add preliminary docs

Improved docs

Improved

Improved

Moar

AWS MULTI START
@andrewvc andrewvc added enhancement Heartbeat Team:obs-ds-hosted-services Label for the Observability Hosted Services team labels Jun 3, 2019
@andrewvc andrewvc requested review from a team as code owners June 3, 2019 18:16
@andrewvc andrewvc self-assigned this Jun 3, 2019
@elasticmachine
Copy link
Collaborator

Pinging @elastic/uptime

heartbeat/monitors/active/http/task.go Outdated Show resolved Hide resolved
heartbeat/monitors/active/aws/elbv2/elbv2.go Outdated Show resolved Hide resolved
heartbeat/monitors/active/aws/elbv2/config.go Outdated Show resolved Hide resolved
@exekias
Copy link
Contributor

exekias commented Jun 3, 2019

🙈 😄 interesting, we are currently talking about adding EC2 autodiscover provider! cc @kaiyan-sheng

Copy link
Member

@jsoriano jsoriano left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for addressing all the comments! I have added some additional minor comments, I think this is good to go so we can start experimenting with it.

@andrewvc
Copy link
Contributor Author

@jsoriano I made some material improvements in andrewvc/beats@282cec2...a5340f1 would you mind giving me one final approval? I found some bugs in manual testing that are now fixed.

@andrewvc
Copy link
Contributor Author

Failure is unrelated

@andrewvc andrewvc merged commit 2c85c97 into elastic:master Jul 30, 2019
@andrewvc andrewvc deleted the auto-elb branch July 30, 2019 02:42
andrewvc added a commit to andrewvc/beats that referenced this pull request Jul 30, 2019
Experimental autodiscovery provider for AWS ELBs.

(cherry picked from commit 2c85c97)
andrewvc added a commit that referenced this pull request Jul 30, 2019
Experimental autodiscovery provider for AWS ELBs.

(cherry picked from commit 2c85c97)
urso pushed a commit to urso/beats that referenced this pull request Aug 2, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

Successfully merging this pull request may close these issues.