Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(aws): add auth.region option when assuming role #13838

Merged
merged 5 commits into from
Aug 4, 2022

Conversation

akutta
Copy link
Contributor

@akutta akutta commented Aug 3, 2022

Issue: #13829

Allow a user to optionally specify the auth.region without changing the underlying sink behavior. If a user does not specify auth.region then there should be no change to functionality.

If a user does specify auth.region only the credential providers will reference that region.

Very open to comments/changes etc.

@bits-bot
Copy link

bits-bot commented Aug 3, 2022

CLA assistant check
All committers have signed the CLA.

@github-actions github-actions bot added the domain: external docs Anything related to Vector's external, public documentation label Aug 3, 2022
@netlify
Copy link

netlify bot commented Aug 3, 2022

Deploy Preview for vector-project ready!

Name Link
🔨 Latest commit 3026372
🔍 Latest deploy log https://app.netlify.com/sites/vector-project/deploys/62ebef3dc34e9a0009ea9d0e
😎 Deploy Preview https://deploy-preview-13838--vector-project.netlify.app/reports/lighthouse
📱 Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site settings.

Copy link
Contributor

@tobz tobz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Overall, this is pretty straightforward and makes sense to me.

I left two changes to tighten up the documentation. I know you posted an issue about needing this due to how you're mediating access through VPC Endpoints... I assume this change fixes your issue? :)

src/aws/auth.rs Outdated Show resolved Hide resolved
website/cue/reference/components/aws.cue Outdated Show resolved Hide resolved
@tobz tobz added the ci-condition: integration tests enable Run integration tests on this PR label Aug 4, 2022
Copy link
Contributor

@tobz tobz left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actually, I needed to make a commit to trigger the CI, so I just committed my suggested changes directly... which gets this to approved. 😂

src/aws/auth.rs Outdated Show resolved Hide resolved
@akutta
Copy link
Contributor Author

akutta commented Aug 4, 2022

Overall, this is pretty straightforward and makes sense to me.

I left two changes to tighten up the documentation. I know you posted an issue about needing this due to how you're mediating access through VPC Endpoints... I assume this change fixes your issue? :)

Yep!

The issue came about that if I allowed the STS auth flow to work by changing the resource region, the tokens wouldn't be signed for the target resource despite changing the endpoint to point at the right us-west-2 VPCe (AWS restriction that the request is signed with target region). However, if I had the resource region configured properly, I'd get constant timeouts from STS and never be able to send the request to S3.

Appreciate the updates to the docs. They are clearer.

@github-actions
Copy link

github-actions bot commented Aug 4, 2022

Soak Test Results

Baseline: 4b3fe0a
Comparison: 5a355a9
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_text_to_http_json 2.79MiB 7.44 100.00% 37.52MiB 1.03MiB 21.48KiB 0 0.0273817 40.32MiB 1.02MiB 21.26KiB 0 0.0252244 False False
syslog_loki 796.63KiB 5.42 100.00% 14.35MiB 386.54KiB 7.91KiB 0 0.0262913 15.13MiB 762.09KiB 15.49KiB 0 0.0491697 False False
socket_to_socket_blackhole 1.11MiB 4.87 100.00% 22.84MiB 173.0KiB 3.53KiB 0 0.00739588 23.95MiB 188.39KiB 3.85KiB 0 0.00767962 False False
splunk_hec_route_s3 314.19KiB 1.66 100.00% 18.45MiB 2.26MiB 47.09KiB 0 0.122611 18.75MiB 2.21MiB 46.31KiB 0 0.117992 False False
http_pipelines_blackhole_acks 9.92KiB 0.83 99.97% 1.16MiB 110.26KiB 2.24KiB 0 0.0926119 1.17MiB 76.73KiB 1.56KiB 0 0.0639155 False False
datadog_agent_remap_blackhole_acks 237.32KiB 0.38 94.66% 61.03MiB 4.71MiB 97.99KiB 0 0.077101 61.26MiB 3.55MiB 74.1KiB 0 0.057876 False False
datadog_agent_remap_datadog_logs 164.96KiB 0.26 79.33% 60.97MiB 3.25MiB 68.26KiB 0 0.0533465 61.13MiB 5.35MiB 111.37KiB 0 0.0874859 False False
datadog_agent_remap_datadog_logs_acks 152.4KiB 0.24 75.66% 61.21MiB 3.85MiB 80.4KiB 0 0.0628222 61.36MiB 4.95MiB 102.94KiB 0 0.0805752 False False
splunk_hec_to_splunk_hec_logs_noack 16.44KiB 0.07 83.88% 23.82MiB 467.09KiB 9.53KiB 0 0.0191445 23.84MiB 335.42KiB 6.85KiB 0 0.0137383 False False
splunk_hec_to_splunk_hec_logs_acks 4.28KiB 0.02 13.79% 23.75MiB 861.81KiB 17.53KiB 0 0.0354301 23.75MiB 849.46KiB 17.28KiB 0 0.0349159 False False
splunk_hec_indexer_ack_blackhole 3.48KiB 0.01 11.23% 23.75MiB 853.25KiB 17.36KiB 0 0.0350751 23.75MiB 860.26KiB 17.5KiB 0 0.0353582 False False
enterprise_http_to_http -1.36KiB -0.01 14.87% 23.85MiB 248.54KiB 5.07KiB 0 0.010176 23.85MiB 252.56KiB 5.17KiB 0 0.0103414 False False
datadog_agent_remap_blackhole -12.95KiB -0.02 9.76% 63.04MiB 4.0MiB 83.41KiB 0 0.0634752 63.03MiB 3.1MiB 64.74KiB 0 0.0491812 False False
file_to_blackhole -81.21KiB -0.08 49.59% 95.33MiB 4.08MiB 84.68KiB 0 0.0428419 95.25MiB 4.2MiB 87.2KiB 0 0.0440622 False False
http_pipelines_blackhole -1.49KiB -0.09 46.35% 1.64MiB 10.97KiB 229.77B 0 0.00652112 1.64MiB 117.44KiB 2.39KiB 0 0.069875 False False
http_to_http_json -40.19KiB -0.16 99.73% 23.84MiB 353.15KiB 7.21KiB 0 0.0144611 23.8MiB 552.55KiB 11.27KiB 0 0.0226637 False False
fluent_elasticsearch -168.42KiB -0.21 100.00% 79.47MiB 52.51KiB 1.06KiB 0 0.000645051 79.31MiB 1.53MiB 31.42KiB 0 0.0192486 False False
http_to_http_noack -77.04KiB -0.32 99.85% 23.83MiB 517.47KiB 10.58KiB 0 0.0212031 23.75MiB 1.05MiB 21.86KiB 0 0.0441254 False False
syslog_splunk_hec_logs -60.13KiB -0.34 99.63% 17.13MiB 717.49KiB 14.62KiB 0 0.0408843 17.08MiB 719.58KiB 14.65KiB 0 0.0411443 False False
syslog_humio_logs -78.24KiB -0.44 100.00% 17.27MiB 140.21KiB 2.86KiB 0 0.00792787 17.19MiB 124.98KiB 2.56KiB 0 0.00709812 False False
syslog_log2metric_splunk_hec_metrics -130.7KiB -0.71 100.00% 17.91MiB 830.68KiB 16.93KiB 0 0.0452793 17.78MiB 985.05KiB 20.04KiB 0 0.0540787 False False
syslog_log2metric_humio_metrics -97.71KiB -0.76 100.00% 12.51MiB 421.7KiB 8.61KiB 0 0.0329175 12.41MiB 566.85KiB 11.53KiB 0 0.0445886 False False
syslog_regex_logs2metric_ddmetrics -101.54KiB -0.8 100.00% 12.35MiB 545.95KiB 11.13KiB 0 0.0431572 12.25MiB 501.28KiB 10.22KiB 0 0.0399465 False False
http_pipelines_no_grok_blackhole -119.46KiB -1.03 100.00% 11.33MiB 272.26KiB 5.56KiB 0 0.0234692 11.21MiB 1.08MiB 22.58KiB 0 0.0966955 False False
http_to_http_acks -227.63KiB -1.23 66.31% 18.13MiB 8.37MiB 174.98KiB 0 0.461341 17.91MiB 7.65MiB 159.84KiB 0 0.427349 True True

@github-actions
Copy link

github-actions bot commented Aug 4, 2022

Soak Test Results

Baseline: 4b3fe0a
Comparison: d236ebe
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_text_to_http_json 2.63MiB 6.91 100.00% 38.02MiB 847.41KiB 17.3KiB 0 0.0217602 40.65MiB 781.39KiB 15.95KiB 0 0.0187675 False False
syslog_loki 772.96KiB 5.29 100.00% 14.26MiB 321.79KiB 6.59KiB 0 0.0220291 15.02MiB 772.91KiB 15.71KiB 0 0.0502524 False False
socket_to_socket_blackhole 1018.01KiB 4.6 100.00% 21.61MiB 263.54KiB 5.38KiB 0 0.0119074 22.6MiB 271.32KiB 5.54KiB 0 0.0117196 False False
splunk_hec_route_s3 300.38KiB 1.67 100.00% 17.53MiB 2.31MiB 48.11KiB 0 0.131836 17.82MiB 2.26MiB 47.32KiB 0 0.127024 False False
datadog_agent_remap_blackhole 551.55KiB 0.88 100.00% 61.25MiB 4.65MiB 96.83KiB 0 0.0758694 61.79MiB 3.62MiB 75.59KiB 0 0.0586111 False False
http_pipelines_blackhole_acks 9.3KiB 0.8 99.98% 1.13MiB 104.65KiB 2.13KiB 0 0.0905354 1.14MiB 61.68KiB 1.26KiB 0 0.0529391 False False
datadog_agent_remap_datadog_logs_acks 437.87KiB 0.7 99.92% 61.18MiB 3.94MiB 82.29KiB 0 0.0643847 61.61MiB 4.83MiB 100.55KiB 0 0.0783864 False False
datadog_agent_remap_blackhole_acks 414.0KiB 0.65 99.79% 61.98MiB 5.18MiB 107.91KiB 0 0.08361 62.38MiB 3.86MiB 80.74KiB 0 0.0618184 False False
datadog_agent_remap_datadog_logs 215.1KiB 0.33 98.11% 63.13MiB 517.68KiB 10.6KiB 0 0.00800618 63.34MiB 4.37MiB 90.96KiB 0 0.0689587 False False
splunk_hec_to_splunk_hec_logs_noack 25.42KiB 0.1 95.19% 23.81MiB 537.15KiB 10.96KiB 0 0.0220229 23.84MiB 329.27KiB 6.72KiB 0 0.0134858 False False
splunk_hec_indexer_ack_blackhole 15.04KiB 0.06 43.53% 23.74MiB 931.2KiB 18.93KiB 0 0.0383006 23.75MiB 884.45KiB 17.99KiB 0 0.0363552 False False
splunk_hec_to_splunk_hec_logs_acks 9.38KiB 0.04 30.17% 23.75MiB 865.42KiB 17.6KiB 0 0.035578 23.76MiB 816.06KiB 16.61KiB 0 0.0335359 False False
enterprise_http_to_http -1.56KiB -0.01 17.30% 23.85MiB 244.76KiB 5.0KiB 0 0.0100212 23.85MiB 249.36KiB 5.1KiB 0 0.01021 False False
file_to_blackhole -41.36KiB -0.04 34.46% 95.34MiB 3.03MiB 62.89KiB 0 0.0318128 95.3MiB 3.27MiB 68.08KiB 0 0.0343321 False False
http_to_http_json -33.32KiB -0.14 99.15% 23.85MiB 340.74KiB 6.96KiB 0 0.0139514 23.81MiB 517.33KiB 10.57KiB 0 0.0212107 False False
http_to_http_noack -69.11KiB -0.28 99.65% 23.83MiB 519.3KiB 10.61KiB 0 0.0212785 23.76MiB 1.01MiB 21.1KiB 0 0.0425604 False False
syslog_splunk_hec_logs -53.04KiB -0.32 99.14% 16.33MiB 747.22KiB 15.21KiB 0 0.0446878 16.27MiB 650.88KiB 13.26KiB 0 0.03905 False False
syslog_humio_logs -68.47KiB -0.39 100.00% 17.3MiB 134.61KiB 2.75KiB 0 0.0075962 17.24MiB 131.02KiB 2.68KiB 0 0.00742229 False False
syslog_log2metric_humio_metrics -54.73KiB -0.42 100.00% 12.73MiB 312.91KiB 6.39KiB 0 0.0239982 12.68MiB 504.16KiB 10.27KiB 0 0.038829 False False
fluent_elasticsearch -411.5KiB -0.51 100.00% 79.47MiB 55.12KiB 1.11KiB 0 0.000677118 79.07MiB 4.61MiB 94.66KiB 0 0.0582443 False False
syslog_log2metric_splunk_hec_metrics -99.66KiB -0.52 100.00% 18.73MiB 534.71KiB 10.9KiB 0 0.0278807 18.63MiB 827.66KiB 16.84KiB 0 0.0433812 False False
syslog_regex_logs2metric_ddmetrics -70.48KiB -0.55 99.97% 12.54MiB 719.99KiB 14.66KiB 0 0.0560768 12.47MiB 644.99KiB 13.14KiB 0 0.0505128 False False
http_to_http_acks -107.13KiB -0.58 35.86% 18.19MiB 8.22MiB 171.8KiB 0 0.451711 18.08MiB 7.32MiB 152.96KiB 0 0.404511 True True
http_pipelines_blackhole -18.01KiB -1.13 100.00% 1.56MiB 63.19KiB 1.29KiB 0 0.0394778 1.55MiB 110.17KiB 2.25KiB 0 0.0696135 False False
http_pipelines_no_grok_blackhole -139.64KiB -1.22 100.00% 11.22MiB 152.11KiB 3.11KiB 0 0.0132407 11.08MiB 1.02MiB 21.29KiB 0 0.0922309 False False

@github-actions
Copy link

github-actions bot commented Aug 4, 2022

Soak Test Results

Baseline: 4b3fe0a
Comparison: 7874818
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_text_to_http_json 2.48MiB 6.7 100.00% 37.08MiB 844.7KiB 17.24KiB 0 0.0222393 39.57MiB 855.03KiB 17.46KiB 0 0.0210982 False False
syslog_loki 847.83KiB 6.2 100.00% 13.35MiB 351.1KiB 7.18KiB 0 0.0256766 14.18MiB 695.63KiB 14.14KiB 0 0.0479018 False False
socket_to_socket_blackhole 1.05MiB 4.72 100.00% 22.24MiB 673.87KiB 13.76KiB 0 0.0295809 23.29MiB 771.98KiB 15.76KiB 0 0.0323598 False False
syslog_splunk_hec_logs 579.98KiB 3.48 100.00% 16.27MiB 908.0KiB 18.49KiB 0 0.0544799 16.84MiB 878.98KiB 17.93KiB 0 0.0509646 False False
splunk_hec_route_s3 347.44KiB 1.89 100.00% 17.97MiB 2.34MiB 48.77KiB 0 0.130195 18.31MiB 2.31MiB 48.28KiB 0 0.126029 False False
datadog_agent_remap_blackhole 474.16KiB 0.73 100.00% 63.49MiB 4.41MiB 91.89KiB 0 0.0694839 63.96MiB 3.42MiB 71.31KiB 0 0.0534505 False False
datadog_agent_remap_blackhole_acks 467.57KiB 0.7 100.00% 65.35MiB 4.44MiB 92.49KiB 0 0.0679503 65.81MiB 3.08MiB 64.38KiB 0 0.0467671 False False
datadog_agent_remap_datadog_logs_acks 382.85KiB 0.61 99.79% 61.48MiB 3.69MiB 77.02KiB 0 0.0599403 61.86MiB 4.69MiB 97.71KiB 0 0.0758513 False False
datadog_agent_remap_datadog_logs 362.07KiB 0.56 100.00% 63.5MiB 757.16KiB 15.49KiB 0 0.0116423 63.85MiB 4.11MiB 85.54KiB 0 0.0642911 False False
syslog_humio_logs 44.62KiB 0.26 100.00% 16.85MiB 416.91KiB 8.51KiB 0 0.0241547 16.9MiB 302.26KiB 6.19KiB 0 0.0174669 False False
http_pipelines_blackhole_acks 689.31B 0.06 20.63% 1.17MiB 99.78KiB 2.03KiB 0 0.0835465 1.17MiB 77.46KiB 1.58KiB 0 0.0648239 False False
splunk_hec_indexer_ack_blackhole 12.91KiB 0.05 36.45% 23.74MiB 973.35KiB 19.79KiB 0 0.0400389 23.75MiB 919.62KiB 18.71KiB 0 0.0378089 False False
splunk_hec_to_splunk_hec_logs_noack 9.23KiB 0.04 60.30% 23.83MiB 415.58KiB 8.48KiB 0 0.0170287 23.84MiB 334.57KiB 6.83KiB 0 0.0137038 False False
splunk_hec_to_splunk_hec_logs_acks 4.61KiB 0.02 15.07% 23.75MiB 851.34KiB 17.32KiB 0 0.0349982 23.75MiB 835.34KiB 16.99KiB 0 0.0343338 False False
enterprise_http_to_http -1.17KiB -0 12.90% 23.85MiB 248.57KiB 5.07KiB 0 0.0101773 23.85MiB 250.21KiB 5.11KiB 0 0.0102448 False False
file_to_blackhole -69.73KiB -0.07 55.55% 95.34MiB 2.97MiB 61.6KiB 0 0.0311591 95.27MiB 3.24MiB 67.25KiB 0 0.0339567 False False
http_to_http_json -22.54KiB -0.09 94.69% 23.85MiB 339.25KiB 6.93KiB 0 0.0138899 23.82MiB 457.86KiB 9.37KiB 0 0.0187634 False False
http_pipelines_blackhole -1.98KiB -0.12 66.03% 1.6MiB 18.78KiB 393.01B 0 0.0114366 1.6MiB 100.12KiB 2.04KiB 0 0.0610478 False False
syslog_log2metric_humio_metrics -38.82KiB -0.3 98.44% 12.55MiB 478.88KiB 9.78KiB 0 0.0372656 12.51MiB 624.93KiB 12.73KiB 0 0.0487786 False False
http_to_http_noack -95.35KiB -0.39 100.00% 23.85MiB 250.9KiB 5.13KiB 0 0.0102735 23.75MiB 1.06MiB 22.19KiB 0 0.0447812 False False
fluent_elasticsearch -356.19KiB -0.44 100.00% 79.47MiB 52.97KiB 1.07KiB 0 0.000650715 79.13MiB 4.17MiB 85.82KiB 0 0.0527245 False False
syslog_log2metric_splunk_hec_metrics -121.38KiB -0.64 100.00% 18.53MiB 477.56KiB 9.74KiB 0 0.0251661 18.41MiB 733.25KiB 14.93KiB 0 0.0388897 False False
syslog_regex_logs2metric_ddmetrics -99.81KiB -0.76 100.00% 12.79MiB 666.58KiB 13.58KiB 0 0.0508797 12.69MiB 686.04KiB 13.97KiB 0 0.0527677 False False
http_to_http_acks -157.68KiB -0.84 47.95% 18.26MiB 8.4MiB 175.56KiB 0 0.459824 18.1MiB 8.22MiB 171.44KiB 0 0.453976 True True
http_pipelines_no_grok_blackhole -143.03KiB -1.26 100.00% 11.09MiB 264.19KiB 5.39KiB 0 0.0232655 10.95MiB 1.06MiB 22.09KiB 0 0.0968563 False False

@github-actions
Copy link

github-actions bot commented Aug 4, 2022

Soak Test Results

Baseline: 4b3fe0a
Comparison: 2a38d75
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_text_to_http_json 2.49MiB 6.6 100.00% 37.78MiB 911.31KiB 18.6KiB 0 0.0235535 40.27MiB 823.98KiB 16.82KiB 0 0.0199772 False False
syslog_loki 822.74KiB 5.57 100.00% 14.42MiB 349.41KiB 7.15KiB 0 0.0236543 15.23MiB 759.19KiB 15.43KiB 0 0.0486835 False False
socket_to_socket_blackhole 1.03MiB 4.61 100.00% 22.34MiB 461.58KiB 9.42KiB 0 0.0201762 23.37MiB 523.84KiB 10.69KiB 0 0.0218884 False False
datadog_agent_remap_blackhole_acks 1.18MiB 1.95 100.00% 60.55MiB 5.15MiB 107.29KiB 0 0.0850362 61.73MiB 4.66MiB 97.51KiB 0 0.0755209 False False
splunk_hec_route_s3 343.84KiB 1.84 100.00% 18.21MiB 2.4MiB 50.05KiB 0 0.131931 18.55MiB 2.31MiB 48.23KiB 0 0.124351 False False
datadog_agent_remap_datadog_logs 1.07MiB 1.71 100.00% 62.51MiB 2.11MiB 44.24KiB 0 0.0337377 63.58MiB 4.57MiB 95.16KiB 0 0.0718619 False False
http_pipelines_blackhole 18.52KiB 1.22 100.00% 1.49MiB 80.65KiB 1.65KiB 0 0.053016 1.5MiB 136.91KiB 2.79KiB 0 0.0889178 False False
http_pipelines_blackhole_acks 13.61KiB 1.14 100.00% 1.17MiB 106.43KiB 2.17KiB 0 0.088896 1.18MiB 66.09KiB 1.35KiB 0 0.0545797 False False
datadog_agent_remap_blackhole 657.09KiB 1.04 100.00% 61.64MiB 5.01MiB 104.38KiB 0 0.0813237 62.28MiB 3.74MiB 78.1KiB 0 0.0600683 False False
datadog_agent_remap_datadog_logs_acks 299.6KiB 0.49 97.84% 59.57MiB 3.62MiB 75.83KiB 0 0.060762 59.86MiB 5.09MiB 106.05KiB 0 0.0850882 False False
splunk_hec_to_splunk_hec_logs_noack 25.26KiB 0.1 95.06% 23.81MiB 535.91KiB 10.93KiB 0 0.0219736 23.84MiB 330.8KiB 6.75KiB 0 0.0135494 False False
splunk_hec_indexer_ack_blackhole 12.89KiB 0.05 41.32% 23.75MiB 850.04KiB 17.29KiB 0 0.0349458 23.76MiB 797.84KiB 16.24KiB 0 0.0327826 False False
enterprise_http_to_http -2.85KiB -0.01 29.40% 23.85MiB 266.74KiB 5.44KiB 0 0.0109208 23.84MiB 256.71KiB 5.25KiB 0 0.0105116 False False
splunk_hec_to_splunk_hec_logs_acks -5.42KiB -0.02 18.95% 23.77MiB 776.34KiB 15.8KiB 0 0.0318888 23.76MiB 793.04KiB 16.14KiB 0 0.0325819 False False
file_to_blackhole -43.83KiB -0.04 30.88% 95.34MiB 3.53MiB 73.15KiB 0 0.0370035 95.29MiB 3.97MiB 82.59KiB 0 0.0416448 False False
syslog_humio_logs -11.08KiB -0.06 61.51% 16.8MiB 426.25KiB 8.7KiB 0 0.0247709 16.79MiB 455.22KiB 9.33KiB 0 0.0264714 False False
syslog_log2metric_splunk_hec_metrics -12.68KiB -0.07 30.95% 17.9MiB 1.05MiB 21.89KiB 0 0.0585849 17.89MiB 1.11MiB 23.12KiB 0 0.0620114 False False
http_to_http_json -33.63KiB -0.14 98.99% 23.84MiB 357.02KiB 7.29KiB 0 0.0146199 23.81MiB 531.5KiB 10.85KiB 0 0.0217949 False False
fluent_elasticsearch -144.66KiB -0.18 100.00% 79.47MiB 51.94KiB 1.05KiB 0 0.000638068 79.33MiB 1.32MiB 27.17KiB 0 0.0166376 False False
http_to_http_noack -76.06KiB -0.31 99.94% 23.84MiB 395.09KiB 8.08KiB 0 0.0161829 23.76MiB 1019.44KiB 20.77KiB 0 0.0418869 False False
syslog_splunk_hec_logs -96.88KiB -0.58 100.00% 16.39MiB 755.74KiB 15.38KiB 0 0.0450219 16.29MiB 694.71KiB 14.15KiB 0 0.0416264 False False
syslog_log2metric_humio_metrics -82.7KiB -0.63 100.00% 12.89MiB 278.63KiB 5.68KiB 0 0.0211061 12.81MiB 535.37KiB 10.9KiB 0 0.0408092 False False
syslog_regex_logs2metric_ddmetrics -105.55KiB -0.81 100.00% 12.68MiB 679.15KiB 13.84KiB 0 0.0523135 12.57MiB 618.44KiB 12.61KiB 0 0.0480275 False False
http_pipelines_no_grok_blackhole -129.38KiB -1.11 100.00% 11.33MiB 53.61KiB 1.09KiB 0 0.00461944 11.21MiB 1014.27KiB 20.64KiB 0 0.0883749 False False
http_to_http_acks -258.23KiB -1.38 72.10% 18.22MiB 7.94MiB 166.04KiB 0 0.435757 17.97MiB 8.2MiB 171.21KiB 0 0.456569 True True

@github-actions
Copy link

github-actions bot commented Aug 4, 2022

Soak Test Results

Baseline: 2c768b0
Comparison: 3026372
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_text_to_http_json 2.59MiB 7.05 100.00% 36.78MiB 1.19MiB 24.98KiB 0 0.0324819 39.37MiB 1.29MiB 27.02KiB 0 0.0328203 False False
syslog_loki 817.58KiB 5.52 100.00% 14.46MiB 130.49KiB 2.67KiB 0 0.00880955 15.26MiB 753.1KiB 15.31KiB 0 0.048182 False False
socket_to_socket_blackhole 1.18MiB 5.17 100.00% 22.88MiB 193.33KiB 3.95KiB 0 0.00824966 24.06MiB 171.39KiB 3.5KiB 0 0.00695369 False False
datadog_agent_remap_blackhole_acks 1.76MiB 3 100.00% 58.57MiB 5.62MiB 117.11KiB 0 0.0959923 60.33MiB 5.06MiB 105.81KiB 0 0.0838859 False False
splunk_hec_route_s3 303.47KiB 1.56 100.00% 18.94MiB 2.2MiB 45.87KiB 0 0.116349 19.23MiB 2.14MiB 44.81KiB 0 0.111301 False False
http_pipelines_blackhole 16.42KiB 1.05 100.00% 1.53MiB 111.79KiB 2.28KiB 0 0.0711583 1.55MiB 137.66KiB 2.81KiB 0 0.0867149 False False
datadog_agent_remap_datadog_logs_acks 609.44KiB 0.99 100.00% 59.85MiB 3.9MiB 81.57KiB 0 0.0651163 60.44MiB 5.04MiB 104.85KiB 0 0.0833244 False False
http_pipelines_blackhole_acks 8.65KiB 0.74 99.87% 1.15MiB 112.64KiB 2.29KiB 0 0.0957125 1.16MiB 68.27KiB 1.39KiB 0 0.0575868 False False
datadog_agent_remap_datadog_logs 348.39KiB 0.56 99.78% 60.87MiB 2.56MiB 53.62KiB 0 0.0420196 61.21MiB 4.81MiB 100.14KiB 0 0.078552 False False
syslog_splunk_hec_logs 56.0KiB 0.33 97.34% 16.58MiB 933.03KiB 18.97KiB 0 0.0549501 16.63MiB 817.37KiB 16.66KiB 0 0.04798 False False
splunk_hec_to_splunk_hec_logs_noack 13.46KiB 0.06 75.65% 23.82MiB 456.45KiB 9.32KiB 0 0.0187067 23.84MiB 333.67KiB 6.82KiB 0 0.0136672 False False
splunk_hec_to_splunk_hec_logs_acks 6.17KiB 0.03 20.24% 23.75MiB 848.61KiB 17.26KiB 0 0.034884 23.76MiB 824.65KiB 16.78KiB 0 0.0338903 False False
enterprise_http_to_http -2.18KiB -0.01 23.41% 23.85MiB 253.41KiB 5.17KiB 0 0.0103753 23.84MiB 252.44KiB 5.17KiB 0 0.0103367 False False
file_to_blackhole -33.64KiB -0.03 28.00% 95.34MiB 2.93MiB 60.78KiB 0 0.0307466 95.31MiB 3.44MiB 71.51KiB 0 0.0360601 False False
splunk_hec_indexer_ack_blackhole -15.83KiB -0.07 43.79% 23.75MiB 923.12KiB 18.78KiB 0 0.0379549 23.73MiB 975.92KiB 19.84KiB 0 0.0401521 False False
syslog_humio_logs -11.26KiB -0.07 64.51% 16.79MiB 430.44KiB 8.79KiB 0 0.0250252 16.78MiB 411.04KiB 8.42KiB 0 0.0239128 False False
http_to_http_json -37.66KiB -0.15 99.62% 23.85MiB 339.44KiB 6.93KiB 0 0.013898 23.81MiB 537.9KiB 10.98KiB 0 0.0220575 False False
syslog_log2metric_splunk_hec_metrics -32.97KiB -0.18 72.35% 18.04MiB 969.29KiB 19.77KiB 0 0.0524722 18.0MiB 1.1MiB 22.95KiB 0 0.0611473 False False
datadog_agent_remap_blackhole -132.7KiB -0.22 59.35% 58.44MiB 5.97MiB 124.35KiB 0 0.102203 58.31MiB 4.82MiB 100.44KiB 0 0.0825637 False False
fluent_elasticsearch -350.64KiB -0.43 100.00% 79.47MiB 53.61KiB 1.08KiB 0 0.000658574 79.13MiB 3.47MiB 71.28KiB 0 0.0438165 False False
http_to_http_noack -112.34KiB -0.46 100.00% 23.84MiB 248.51KiB 5.09KiB 0 0.0101756 23.74MiB 1.15MiB 23.94KiB 0 0.0483815 False False
syslog_log2metric_humio_metrics -80.49KiB -0.61 100.00% 12.82MiB 311.94KiB 6.36KiB 0 0.0237476 12.75MiB 460.22KiB 9.37KiB 0 0.0352524 False False
syslog_regex_logs2metric_ddmetrics -114.09KiB -0.87 100.00% 12.85MiB 656.66KiB 13.37KiB 0 0.0499125 12.73MiB 617.62KiB 12.59KiB 0 0.0473562 False False
http_pipelines_no_grok_blackhole -104.8KiB -0.95 100.00% 10.8MiB 403.78KiB 8.25KiB 0 0.0365152 10.69MiB 1.15MiB 23.94KiB 0 0.107538 False False
http_to_http_acks -272.54KiB -1.46 72.09% 18.18MiB 8.59MiB 179.62KiB 0 0.472661 17.91MiB 8.45MiB 176.43KiB 0 0.471935 True True

@spencergilbert spencergilbert merged commit bbe6eb8 into vectordotdev:master Aug 4, 2022
@akutta akutta deleted the dkutta/aws-auth-region branch August 4, 2022 20:30
jdrouet pushed a commit that referenced this pull request Aug 22, 2022
* add auth.region option when assuming role

* Update src/aws/auth.rs

* Update website/cue/reference/components/aws.cue

* Update src/aws/auth.rs

* cue fmt

Co-authored-by: Toby Lawrence <tobz@users.noreply.github.com>
@akutta
Copy link
Contributor Author

akutta commented Aug 23, 2022

@tobz Will this be included in the 0.24 release?

@tobz
Copy link
Contributor

tobz commented Aug 23, 2022

@akutta Yes, it will be.

We're targeting the end of this week, potentially early next week, to cut the 0.24 release. If you need something sooner, you can experiment with the latest nightly release.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-condition: integration tests enable Run integration tests on this PR domain: external docs Anything related to Vector's external, public documentation
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants