Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(vdev): Rewrite package-msi.sh to vdev #16748

Draft
wants to merge 7 commits into
base: master
Choose a base branch
from

Conversation

jonathanpv
Copy link
Contributor

@jonathanpv jonathanpv commented Mar 9, 2023

Problem

We would like to rewrite the package-msi.sh script to native Rust in vdev

Solution

  • Rewrote package-msi.sh and commented each script line I translated to Rust
  • Refactored package subcommand for vdev in a folder structure
  • Created package/mod.rs and package/msi.rs

Testing

cargo vdev package msi

Related Issues

Checklist

  • Add the ci-condition integration tests enable
  • Delete any rewritten scripts
  • Modify makefile to point to the new cargo vdev
  • Modify workflow if need be
  • Compare the output of the local script to the newly created cargo vdev Rust version
  • All CI integration tests passing
  • Test newly created cargo vdev commands

@jonathanpv jonathanpv added platform: windows Anything `windows` platform related ci-condition: integration tests enable Run integration tests on this PR domain: vdev Anything related to the vdev tooling labels Mar 9, 2023
@jonathanpv jonathanpv self-assigned this Mar 9, 2023
@netlify
Copy link

netlify bot commented Mar 9, 2023

Deploy Preview for vrl-playground canceled.

Name Link
🔨 Latest commit d5e87fa
🔍 Latest deploy log https://app.netlify.com/sites/vrl-playground/deploys/64132e2c66384b0007bbd11a

@netlify
Copy link

netlify bot commented Mar 9, 2023

Deploy Preview for vector-project canceled.

Name Link
🔨 Latest commit d5e87fa
🔍 Latest deploy log https://app.netlify.com/sites/vector-project/deploys/64132e2c41cffc00076e311e

@jonathanpv jonathanpv changed the title chore(vdev): rewrite package-msi.sh chore(vdev): rewrite package-msi.sh to vdev Mar 9, 2023
@github-actions github-actions bot added domain: ci Anything related to Vector's CI environment domain: releasing Anything related to releasing Vector labels Mar 9, 2023
@jonathanpv
Copy link
Contributor Author

In publish.yml we have the following code snippet:

- name: Build Vector
        shell: bash
        run: |
          export FEATURES="default-msvc"
          export ARCHIVE_TYPE="zip"
          export KEEP_SYMBOLS="true"
          export RUST_LTO=""
          export TARGET="x86_64-pc-windows-msvc"
          export NATIVE_BUILD="true"
          make package
      - name: Build MSI package
        shell: bash
        run: |
          export PATH="/c/wix:$PATH"
          ./scripts/package-msi.sh

We would like to utilize cargo vdev publish msi given that ./scripts/package.msi has been replaced by it. I don't see cargo being used in windows workflow but that could just be because I haven't searched deep enough. Is it possible to replace

run: |
          export PATH="/c/wix:$PATH"
          ./scripts/package-msi.sh

with

run: |
          export PATH="/c/wix:$PATH"
          cargo vdev package msi

@github-actions
Copy link

github-actions bot commented Mar 9, 2023

Regression Detector Results

Run ID: 272ecc38-bb0a-4560-8a3c-57934e424daa
Baseline: 3e79d63
Comparison: 832528a
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine quickly if vector performance is changed and to what degree by a pull request.

The table below, if present, lists those experiments that have experienced a statistically significant change in mean optimization goal performance between baseline and comparison SHAs with 90.00% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5.00% change in their mean optimization goal are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting change is observed.

No interesting changes in experiment optimization goals with confidence ≥ 90.00% and |Δ mean %| ≥ 5.00%.

Fine details of change detection per experiment.
experiment goal Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
syslog_log2metric_humio_metrics ingress throughput 206.54KiB/CPU-s 3.37 100.00% 5.98MiB/CPU-s 388.15KiB/CPU-s 4.78KiB/CPU-s 0.0 0.063365 6.18MiB/CPU-s 177.6KiB/CPU-s 2.19KiB/CPU-s 0.0 0.028047 False False
datadog_agent_remap_blackhole_acks ingress throughput 429.52KiB/CPU-s 1.38 100.00% 30.44MiB/CPU-s 1.58MiB/CPU-s 19.96KiB/CPU-s 0.0 0.052019 30.86MiB/CPU-s 1.26MiB/CPU-s 15.86KiB/CPU-s 0.0 0.040761 False False
datadog_agent_remap_blackhole ingress throughput 397.02KiB/CPU-s 1.25 100.00% 31.05MiB/CPU-s 1.16MiB/CPU-s 14.66KiB/CPU-s 0.0 0.037473 31.44MiB/CPU-s 940.3KiB/CPU-s 11.57KiB/CPU-s 0.0 0.029204 False False
syslog_splunk_hec_logs ingress throughput 38.15KiB/CPU-s 0.43 100.00% 8.76MiB/CPU-s 214.45KiB/CPU-s 2.64KiB/CPU-s 0.0 0.023917 8.79MiB/CPU-s 174.21KiB/CPU-s 2.14KiB/CPU-s 0.0 0.019348 False False
syslog_log2metric_splunk_hec_metrics ingress throughput 24.91KiB/CPU-s 0.27 100.00% 9.03MiB/CPU-s 360.16KiB/CPU-s 4.43KiB/CPU-s 0.0 0.038953 9.05MiB/CPU-s 247.09KiB/CPU-s 3.04KiB/CPU-s 0.0 0.026652 False False
http_to_http_acks ingress throughput 12.06KiB/CPU-s 0.22 19.42% 5.27MiB/CPU-s 2.76MiB/CPU-s 34.79KiB/CPU-s 0.0 0.524237 5.28MiB/CPU-s 2.74MiB/CPU-s 34.58KiB/CPU-s 0.0 0.519827 True False
http_text_to_http_json ingress throughput 49.5KiB/CPU-s 0.20 100.00% 24.06MiB/CPU-s 596.69KiB/CPU-s 7.34KiB/CPU-s 0.0 0.024222 24.1MiB/CPU-s 559.76KiB/CPU-s 6.89KiB/CPU-s 0.0 0.022677 False False
otlp_grpc_to_blackhole ingress throughput 2.1KiB/CPU-s 0.20 99.17% 1.04MiB/CPU-s 49.0KiB/CPU-s 617.35B/CPU-s 0.0 0.046172 1.04MiB/CPU-s 42.06KiB/CPU-s 530.01B/CPU-s 0.0 0.039553 False False
enterprise_http_to_http ingress throughput 5.65KiB/CPU-s 0.04 88.18% 13.62MiB/CPU-s 250.91KiB/CPU-s 3.09KiB/CPU-s 0.0 0.017991 13.62MiB/CPU-s 152.4KiB/CPU-s 1.88KiB/CPU-s 0.0 0.010923 False False
http_to_http_noack ingress throughput 4.01KiB/CPU-s 0.03 48.23% 13.61MiB/CPU-s 377.82KiB/CPU-s 4.65KiB/CPU-s 0.0 0.027113 13.61MiB/CPU-s 333.28KiB/CPU-s 4.1KiB/CPU-s 0.0 0.02391 False False
fluent_elasticsearch ingress throughput -1.43KiB/CPU-s -0.00 84.96% 45.41MiB/CPU-s 31.8KiB/CPU-s 396.5B/CPU-s 0.0 0.000684 45.41MiB/CPU-s 75.48KiB/CPU-s 940.59B/CPU-s 0.0 0.001623 False False
splunk_hec_to_splunk_hec_logs_acks ingress throughput 586.27B/CPU-s 0.00 7.36% 13.61MiB/CPU-s 364.21KiB/CPU-s 4.48KiB/CPU-s 0.0 0.026124 13.61MiB/CPU-s 348.36KiB/CPU-s 4.28KiB/CPU-s 0.0 0.024986 False False
socket_to_socket_blackhole ingress throughput -563.84B/CPU-s -0.00 9.25% 13.24MiB/CPU-s 203.31KiB/CPU-s 2.5KiB/CPU-s 0.0 0.014996 13.24MiB/CPU-s 326.77KiB/CPU-s 4.02KiB/CPU-s 0.0 0.024103 False False
splunk_hec_indexer_ack_blackhole ingress throughput -1.18KiB/CPU-s -0.01 20.04% 13.61MiB/CPU-s 263.29KiB/CPU-s 3.24KiB/CPU-s 0.0 0.018884 13.61MiB/CPU-s 268.96KiB/CPU-s 3.31KiB/CPU-s 0.0 0.019292 False False
otlp_http_to_blackhole ingress throughput -173.8B/CPU-s -0.01 7.11% 1.56MiB/CPU-s 111.49KiB/CPU-s 1.37KiB/CPU-s 0.0 0.069782 1.56MiB/CPU-s 107.07KiB/CPU-s 1.32KiB/CPU-s 0.0 0.067024 False False
splunk_hec_to_splunk_hec_logs_noack ingress throughput -1.19KiB/CPU-s -0.01 19.83% 13.61MiB/CPU-s 268.12KiB/CPU-s 3.3KiB/CPU-s 0.0 0.01923 13.61MiB/CPU-s 277.2KiB/CPU-s 3.41KiB/CPU-s 0.0 0.019883 False False
http_to_http_json ingress throughput -22.25KiB/CPU-s -0.16 100.00% 13.62MiB/CPU-s 223.65KiB/CPU-s 2.75KiB/CPU-s 0.0 0.016036 13.6MiB/CPU-s 261.03KiB/CPU-s 3.21KiB/CPU-s 0.0 0.018746 False False
syslog_humio_logs ingress throughput -27.5KiB/CPU-s -0.30 100.00% 8.96MiB/CPU-s 192.54KiB/CPU-s 2.37KiB/CPU-s 0.0 0.020981 8.93MiB/CPU-s 248.89KiB/CPU-s 3.06KiB/CPU-s 0.0 0.027203 False False
splunk_hec_route_s3 ingress throughput -64.63KiB/CPU-s -0.54 100.00% 11.59MiB/CPU-s 589.58KiB/CPU-s 7.25KiB/CPU-s 0.0 0.049661 11.53MiB/CPU-s 596.1KiB/CPU-s 7.34KiB/CPU-s 0.0 0.050485 False False
datadog_agent_remap_datadog_logs ingress throughput -323.38KiB/CPU-s -0.96 100.00% 33.04MiB/CPU-s 1.18MiB/CPU-s 14.82KiB/CPU-s 0.0 0.035615 32.72MiB/CPU-s 1.03MiB/CPU-s 12.93KiB/CPU-s 0.0 0.031362 False False
datadog_agent_remap_datadog_logs_acks ingress throughput -426.95KiB/CPU-s -1.27 100.00% 32.89MiB/CPU-s 908.09KiB/CPU-s 11.17KiB/CPU-s 0.0 0.026958 32.48MiB/CPU-s 1.0MiB/CPU-s 12.64KiB/CPU-s 0.0 0.030894 False False
syslog_loki ingress throughput -113.37KiB/CPU-s -1.28 100.00% 8.62MiB/CPU-s 216.31KiB/CPU-s 2.66KiB/CPU-s 0.0 0.024512 8.51MiB/CPU-s 310.15KiB/CPU-s 3.82KiB/CPU-s 0.0 0.035603 False False
syslog_regex_logs2metric_ddmetrics ingress throughput -103.43KiB/CPU-s -2.91 100.00% 3.48MiB/CPU-s 449.28KiB/CPU-s 5.53KiB/CPU-s 0.0 0.126185 3.38MiB/CPU-s 464.57KiB/CPU-s 5.72KiB/CPU-s 0.0 0.134382 True True
file_to_blackhole egress throughput -1009.6KiB/CPU-s -13.55 100.00% 7.27MiB/CPU-s 3.75MiB/CPU-s 125.75KiB/CPU-s 0.0 0.515365 6.29MiB/CPU-s 4.34MiB/CPU-s 121.25KiB/CPU-s 0.0 0.689805 True True

@neuronull
Copy link
Contributor

We would like to utilize cargo vdev publish msi given that ./scripts/package.msi has been replaced by it. I don't see cargo being used in windows workflow but that could just be because I haven't searched deep enough. Is it possible to replace

I believe that should work yes. The package-msi.sh script is/was internally calling cargo vdev ... so naively I would think this should execute.

vdev/src/commands/package/msi.rs Show resolved Hide resolved
vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
@jonathanpv
Copy link
Contributor Author

We would like to utilize cargo vdev publish msi given that ./scripts/package.msi has been replaced by it. I don't see cargo being used in windows workflow but that could just be because I haven't searched deep enough. Is it possible to replace

I believe that should work yes. The package-msi.sh script is/was internally calling cargo vdev ... so naively I would think this should execute.

I see yeah it does look like we used cargo vdev version inside of the script. So this should work. I pushed the commit implementing this.

@github-actions
Copy link

github-actions bot commented Mar 9, 2023

Regression Detector Results

Run ID: f5aa7242-4d1d-4aea-bfa0-a2bcd8150994
Baseline: 0eb721f
Comparison: b1bc93b
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine quickly if vector performance is changed and to what degree by a pull request.

The table below, if present, lists those experiments that have experienced a statistically significant change in mean optimization goal performance between baseline and comparison SHAs with 90.00% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5.00% change in their mean optimization goal are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting change is observed.

No interesting changes in experiment optimization goals with confidence ≥ 90.00% and |Δ mean %| ≥ 5.00%.

Fine details of change detection per experiment.
experiment goal Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
file_to_blackhole egress throughput 569.16KiB/CPU-s 8.75 99.91% 6.35MiB/CPU-s 4.16MiB/CPU-s 118.44KiB/CPU-s 1.549187 0.65376 6.91MiB/CPU-s 3.84MiB/CPU-s 124.15KiB/CPU-s 0.0 0.555367 True True
syslog_log2metric_splunk_hec_metrics ingress throughput 328.09KiB/CPU-s 3.67 100.00% 8.73MiB/CPU-s 478.21KiB/CPU-s 5.88KiB/CPU-s 0.0 0.053491 9.05MiB/CPU-s 328.6KiB/CPU-s 4.04KiB/CPU-s 0.0 0.035456 False False
syslog_regex_logs2metric_ddmetrics ingress throughput 71.83KiB/CPU-s 2.04 100.00% 3.44MiB/CPU-s 519.47KiB/CPU-s 6.39KiB/CPU-s 0.0 0.147269 3.51MiB/CPU-s 490.43KiB/CPU-s 6.04KiB/CPU-s 0.0 0.136261 True True
http_text_to_http_json ingress throughput 361.73KiB/CPU-s 1.48 100.00% 23.81MiB/CPU-s 795.17KiB/CPU-s 9.78KiB/CPU-s 0.0 0.032606 24.17MiB/CPU-s 685.05KiB/CPU-s 8.43KiB/CPU-s 0.0 0.027679 False False
syslog_humio_logs ingress throughput 89.81KiB/CPU-s 1.00 100.00% 8.78MiB/CPU-s 251.3KiB/CPU-s 3.09KiB/CPU-s 0.0 0.027963 8.86MiB/CPU-s 215.97KiB/CPU-s 2.66KiB/CPU-s 0.0 0.023793 False False
syslog_log2metric_humio_metrics ingress throughput 47.36KiB/CPU-s 0.79 100.00% 5.87MiB/CPU-s 294.59KiB/CPU-s 3.63KiB/CPU-s 0.0 0.049027 5.91MiB/CPU-s 413.42KiB/CPU-s 5.09KiB/CPU-s 0.0 0.068265 False False
otlp_http_to_blackhole ingress throughput 9.2KiB/CPU-s 0.59 100.00% 1.53MiB/CPU-s 122.2KiB/CPU-s 1.5KiB/CPU-s 0.0 0.078008 1.54MiB/CPU-s 107.5KiB/CPU-s 1.32KiB/CPU-s 0.0 0.068223 False False
http_to_http_json ingress throughput 25.67KiB/CPU-s 0.18 100.00% 13.59MiB/CPU-s 257.96KiB/CPU-s 3.17KiB/CPU-s 0.0 0.01853 13.62MiB/CPU-s 237.91KiB/CPU-s 2.93KiB/CPU-s 0.0 0.017059 False False
socket_to_socket_blackhole ingress throughput 6.61KiB/CPU-s 0.05 73.08% 13.08MiB/CPU-s 369.68KiB/CPU-s 4.55KiB/CPU-s 0.0 0.027589 13.09MiB/CPU-s 315.42KiB/CPU-s 3.88KiB/CPU-s 0.0 0.023529 False False
syslog_splunk_hec_logs ingress throughput 4.66KiB/CPU-s 0.05 79.84% 8.71MiB/CPU-s 206.32KiB/CPU-s 2.54KiB/CPU-s 0.0 0.023126 8.72MiB/CPU-s 212.83KiB/CPU-s 2.62KiB/CPU-s 0.0 0.023842 False False
enterprise_http_to_http ingress throughput 5.65KiB/CPU-s 0.04 88.62% 13.62MiB/CPU-s 247.06KiB/CPU-s 3.04KiB/CPU-s 0.0 0.017715 13.62MiB/CPU-s 152.74KiB/CPU-s 1.88KiB/CPU-s 0.0 0.010948 False False
http_to_http_noack ingress throughput 2.11KiB/CPU-s 0.02 29.14% 13.61MiB/CPU-s 333.6KiB/CPU-s 4.1KiB/CPU-s 0.0 0.023933 13.61MiB/CPU-s 313.77KiB/CPU-s 3.86KiB/CPU-s 0.0 0.022507 False False
fluent_elasticsearch ingress throughput -1.37KiB/CPU-s -0.00 85.18% 45.41MiB/CPU-s 30.21KiB/CPU-s 376.47B/CPU-s 0.0 0.00065 45.41MiB/CPU-s 71.71KiB/CPU-s 893.68B/CPU-s 0.0 0.001542 False False
splunk_hec_indexer_ack_blackhole ingress throughput 688.85B/CPU-s 0.00 11.98% 13.62MiB/CPU-s 258.8KiB/CPU-s 3.18KiB/CPU-s 0.0 0.018561 13.62MiB/CPU-s 254.33KiB/CPU-s 3.13KiB/CPU-s 0.0 0.01824 False False
splunk_hec_to_splunk_hec_logs_acks ingress throughput 9.44B/CPU-s 0.00 0.11% 13.61MiB/CPU-s 377.2KiB/CPU-s 4.64KiB/CPU-s 0.0 0.027056 13.61MiB/CPU-s 360.36KiB/CPU-s 4.43KiB/CPU-s 0.0 0.025848 False False
splunk_hec_to_splunk_hec_logs_noack ingress throughput -1.22KiB/CPU-s -0.01 20.34% 13.61MiB/CPU-s 266.94KiB/CPU-s 3.28KiB/CPU-s 0.0 0.019146 13.61MiB/CPU-s 277.77KiB/CPU-s 3.42KiB/CPU-s 0.0 0.019924 False False
datadog_agent_remap_datadog_logs ingress throughput -43.9KiB/CPU-s -0.13 96.63% 32.7MiB/CPU-s 1.19MiB/CPU-s 14.98KiB/CPU-s 0.0 0.03636 32.65MiB/CPU-s 1.13MiB/CPU-s 14.24KiB/CPU-s 0.0 0.034618 False False
otlp_grpc_to_blackhole ingress throughput -2.19KiB/CPU-s -0.21 99.27% 1.03MiB/CPU-s 47.82KiB/CPU-s 602.6B/CPU-s 0.0 0.045535 1.02MiB/CPU-s 46.14KiB/CPU-s 581.36B/CPU-s 0.0 0.044023 False False
http_to_http_acks ingress throughput -12.03KiB/CPU-s -0.22 19.52% 5.29MiB/CPU-s 2.75MiB/CPU-s 34.78KiB/CPU-s 0.0 0.520477 5.28MiB/CPU-s 2.7MiB/CPU-s 34.08KiB/CPU-s 0.0 0.512385 True False
datadog_agent_remap_blackhole_acks ingress throughput -76.36KiB/CPU-s -0.24 99.25% 30.49MiB/CPU-s 1.23MiB/CPU-s 15.52KiB/CPU-s 0.0 0.040401 30.42MiB/CPU-s 1.9MiB/CPU-s 23.96KiB/CPU-s 0.0 0.062511 False False
splunk_hec_route_s3 ingress throughput -34.27KiB/CPU-s -0.29 99.95% 11.54MiB/CPU-s 556.0KiB/CPU-s 6.84KiB/CPU-s 0.0 0.047042 11.51MiB/CPU-s 569.15KiB/CPU-s 7.0KiB/CPU-s 0.0 0.048295 False False
datadog_agent_remap_datadog_logs_acks ingress throughput -181.1KiB/CPU-s -0.54 100.00% 32.84MiB/CPU-s 733.81KiB/CPU-s 9.03KiB/CPU-s 0.0 0.021821 32.66MiB/CPU-s 1.18MiB/CPU-s 14.8KiB/CPU-s 0.0 0.035976 False False
syslog_loki ingress throughput -104.33KiB/CPU-s -1.21 100.00% 8.42MiB/CPU-s 242.81KiB/CPU-s 2.99KiB/CPU-s 0.0 0.028156 8.32MiB/CPU-s 352.8KiB/CPU-s 4.34KiB/CPU-s 0.0 0.041411 False False
datadog_agent_remap_blackhole ingress throughput -1010.08KiB/CPU-s -3.17 100.00% 31.11MiB/CPU-s 1005.57KiB/CPU-s 12.37KiB/CPU-s 0.0 0.031561 30.13MiB/CPU-s 1.81MiB/CPU-s 22.83KiB/CPU-s 0.0 0.060141 False False

@jonathanpv jonathanpv requested a review from bruceg March 9, 2023 23:19
@github-actions
Copy link

github-actions bot commented Mar 9, 2023

Regression Detector Results

Run ID: 83c3d200-f055-4a8a-8b1c-c68ccd10b2a1
Baseline: 0eb721f
Comparison: 18263a6
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine quickly if vector performance is changed and to what degree by a pull request.

The table below, if present, lists those experiments that have experienced a statistically significant change in mean optimization goal performance between baseline and comparison SHAs with 90.00% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5.00% change in their mean optimization goal are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting change is observed.

No interesting changes in experiment optimization goals with confidence ≥ 90.00% and |Δ mean %| ≥ 5.00%.

Fine details of change detection per experiment.
experiment goal Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
file_to_blackhole egress throughput 715.19KiB/CPU-s 11.56 100.00% 6.04MiB/CPU-s 4.22MiB/CPU-s 117.5KiB/CPU-s 0.0 0.697731 6.74MiB/CPU-s 4.06MiB/CPU-s 122.29KiB/CPU-s 0.25974 0.60203 True True
datadog_agent_remap_datadog_logs_acks ingress throughput 758.7KiB/CPU-s 2.35 100.00% 31.47MiB/CPU-s 1.57MiB/CPU-s 19.76KiB/CPU-s 0.0 0.049832 32.21MiB/CPU-s 1.39MiB/CPU-s 17.5KiB/CPU-s 0.0 0.043107 False False
http_to_http_acks ingress throughput 108.72KiB/CPU-s 2.05 97.18% 5.18MiB/CPU-s 2.79MiB/CPU-s 35.14KiB/CPU-s 0.0 0.538074 5.29MiB/CPU-s 2.77MiB/CPU-s 34.91KiB/CPU-s 0.0 0.523915 True False
splunk_hec_route_s3 ingress throughput 165.82KiB/CPU-s 1.42 100.00% 11.39MiB/CPU-s 634.87KiB/CPU-s 7.81KiB/CPU-s 0.0 0.054449 11.55MiB/CPU-s 548.74KiB/CPU-s 6.75KiB/CPU-s 0.0 0.046402 False False
datadog_agent_remap_blackhole ingress throughput 369.56KiB/CPU-s 1.18 100.00% 30.71MiB/CPU-s 1.49MiB/CPU-s 18.75KiB/CPU-s 0.0 0.048479 31.07MiB/CPU-s 1.09MiB/CPU-s 13.69KiB/CPU-s 0.0 0.034979 False False
syslog_log2metric_splunk_hec_metrics ingress throughput 90.59KiB/CPU-s 0.99 100.00% 8.93MiB/CPU-s 305.57KiB/CPU-s 3.76KiB/CPU-s 0.0 0.03341 9.02MiB/CPU-s 339.26KiB/CPU-s 4.17KiB/CPU-s 0.0 0.03673 False False
otlp_grpc_to_blackhole ingress throughput 8.79KiB/CPU-s 0.84 100.00% 1.02MiB/CPU-s 51.68KiB/CPU-s 651.15B/CPU-s 0.0 0.04953 1.03MiB/CPU-s 43.65KiB/CPU-s 550.14B/CPU-s 0.0 0.041488 False False
syslog_humio_logs ingress throughput 69.6KiB/CPU-s 0.77 100.00% 8.8MiB/CPU-s 305.86KiB/CPU-s 3.76KiB/CPU-s 0.0 0.033929 8.87MiB/CPU-s 243.73KiB/CPU-s 3.0KiB/CPU-s 0.0 0.026829 False False
otlp_http_to_blackhole ingress throughput 3.8KiB/CPU-s 0.24 94.64% 1.55MiB/CPU-s 115.99KiB/CPU-s 1.43KiB/CPU-s 0.0 0.073267 1.55MiB/CPU-s 110.08KiB/CPU-s 1.35KiB/CPU-s 0.0 0.069371 False False
syslog_splunk_hec_logs ingress throughput 7.66KiB/CPU-s 0.09 97.47% 8.7MiB/CPU-s 224.38KiB/CPU-s 2.76KiB/CPU-s 0.0 0.025191 8.71MiB/CPU-s 164.44KiB/CPU-s 2.02KiB/CPU-s 0.0 0.018445 False False
http_to_http_noack ingress throughput 3.82KiB/CPU-s 0.03 46.92% 13.61MiB/CPU-s 370.56KiB/CPU-s 4.56KiB/CPU-s 0.0 0.026592 13.61MiB/CPU-s 329.26KiB/CPU-s 4.05KiB/CPU-s 0.0 0.023621 False False
enterprise_http_to_http ingress throughput 3.62KiB/CPU-s 0.03 65.15% 13.62MiB/CPU-s 249.36KiB/CPU-s 3.07KiB/CPU-s 0.0 0.017879 13.62MiB/CPU-s 189.83KiB/CPU-s 2.34KiB/CPU-s 0.0 0.013608 False False
splunk_hec_to_splunk_hec_logs_acks ingress throughput 86.62B/CPU-s 0.00 1.04% 13.61MiB/CPU-s 371.97KiB/CPU-s 4.57KiB/CPU-s 0.0 0.026681 13.61MiB/CPU-s 374.73KiB/CPU-s 4.61KiB/CPU-s 0.0 0.026879 False False
splunk_hec_indexer_ack_blackhole ingress throughput -544.81B/CPU-s -0.00 9.39% 13.62MiB/CPU-s 257.52KiB/CPU-s 3.17KiB/CPU-s 0.0 0.018468 13.62MiB/CPU-s 261.02KiB/CPU-s 3.21KiB/CPU-s 0.0 0.01872 False False
splunk_hec_to_splunk_hec_logs_noack ingress throughput -1.19KiB/CPU-s -0.01 20.30% 13.62MiB/CPU-s 260.64KiB/CPU-s 3.21KiB/CPU-s 0.0 0.018693 13.61MiB/CPU-s 269.49KiB/CPU-s 3.31KiB/CPU-s 0.0 0.019329 False False
fluent_elasticsearch ingress throughput -6.43KiB/CPU-s -0.01 79.73% 45.41MiB/CPU-s 34.35KiB/CPU-s 428.07B/CPU-s 0.0 0.000739 45.41MiB/CPU-s 413.23KiB/CPU-s 5.03KiB/CPU-s 0.0 0.008886 False False
http_text_to_http_json ingress throughput -36.85KiB/CPU-s -0.15 99.88% 24.15MiB/CPU-s 680.7KiB/CPU-s 8.38KiB/CPU-s 0.0 0.027526 24.11MiB/CPU-s 628.59KiB/CPU-s 7.74KiB/CPU-s 0.0 0.025457 False False
http_to_http_json ingress throughput -40.74KiB/CPU-s -0.29 100.00% 13.61MiB/CPU-s 248.82KiB/CPU-s 3.06KiB/CPU-s 0.0 0.017857 13.57MiB/CPU-s 303.36KiB/CPU-s 3.73KiB/CPU-s 0.0 0.021835 False False
syslog_log2metric_humio_metrics ingress throughput -21.03KiB/CPU-s -0.35 100.00% 5.95MiB/CPU-s 203.37KiB/CPU-s 2.5KiB/CPU-s 0.0 0.033366 5.93MiB/CPU-s 336.6KiB/CPU-s 4.14KiB/CPU-s 0.0 0.055414 False False
syslog_loki ingress throughput -66.85KiB/CPU-s -0.78 100.00% 8.38MiB/CPU-s 313.28KiB/CPU-s 3.85KiB/CPU-s 0.0 0.036515 8.31MiB/CPU-s 268.91KiB/CPU-s 3.31KiB/CPU-s 0.0 0.031589 False False
datadog_agent_remap_datadog_logs ingress throughput -364.17KiB/CPU-s -1.07 100.00% 33.16MiB/CPU-s 681.83KiB/CPU-s 8.39KiB/CPU-s 0.0 0.02008 32.8MiB/CPU-s 1.43MiB/CPU-s 18.02KiB/CPU-s 0.0 0.043609 False False
syslog_regex_logs2metric_ddmetrics ingress throughput -44.43KiB/CPU-s -1.20 100.00% 3.61MiB/CPU-s 346.59KiB/CPU-s 4.27KiB/CPU-s 0.0 0.09385 3.56MiB/CPU-s 281.99KiB/CPU-s 3.47KiB/CPU-s 0.0 0.077286 False True
socket_to_socket_blackhole ingress throughput -202.44KiB/CPU-s -1.50 100.00% 13.15MiB/CPU-s 314.99KiB/CPU-s 3.88KiB/CPU-s 0.0 0.023394 12.95MiB/CPU-s 439.47KiB/CPU-s 5.41KiB/CPU-s 0.0 0.033138 False False
datadog_agent_remap_blackhole_acks ingress throughput -984.95KiB/CPU-s -3.05 100.00% 31.56MiB/CPU-s 935.75KiB/CPU-s 11.51KiB/CPU-s 0.0 0.028951 30.6MiB/CPU-s 1.08MiB/CPU-s 13.66KiB/CPU-s 0.0 0.03541 False False

vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
vdev/src/commands/package/msi.rs Fixed Show fixed Hide fixed
let mut license_rtf_file = File::create("LICENSE.rtf")?;
writeln!(
license_rtf_file,
"{{\\rtf1\\ansi\\ansicpg1252\\deff0\\nouicompat{{\\fonttbl{{\\f0\\fnil\\fcharset0 Lucida Console;}}}}\n\\viewkind4\\uc1\n\\pard\\f0\\fs14\\lang1033\\par"

Check failure

Code scanning / check-spelling

Unrecognized Spelling

[nouicompat](#security-tab) is not a recognized word. \(unrecognized-spelling\)
@github-actions
Copy link

Regression Detector Results

Run ID: e52e3b6f-18cb-48dd-91f4-69a2f097331e
Baseline: 64c9f5a
Comparison: 3e7c80b
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine quickly if vector performance is changed and to what degree by a pull request.

The table below, if present, lists those experiments that have experienced a statistically significant change in mean optimization goal performance between baseline and comparison SHAs with 90.00% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5.00% change in their mean optimization goal are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting change is observed.

No interesting changes in experiment optimization goals with confidence ≥ 90.00% and |Δ mean %| ≥ 5.00%.

Fine details of change detection per experiment.
experiment goal Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_to_http_acks ingress throughput 75.23KiB/CPU-s 1.39 87.70% 5.27MiB/CPU-s 2.74MiB/CPU-s 34.47KiB/CPU-s 0.0 0.518798 5.35MiB/CPU-s 2.74MiB/CPU-s 34.52KiB/CPU-s 0.0 0.512381 True False
splunk_hec_route_s3 ingress throughput 162.0KiB/CPU-s 1.37 100.00% 11.52MiB/CPU-s 569.96KiB/CPU-s 7.01KiB/CPU-s 0.0 0.048307 11.68MiB/CPU-s 627.35KiB/CPU-s 7.72KiB/CPU-s 0.0 0.052451 False False
syslog_log2metric_humio_metrics ingress throughput 60.56KiB/CPU-s 0.98 100.00% 6.01MiB/CPU-s 229.3KiB/CPU-s 2.82KiB/CPU-s 0.0 0.037282 6.06MiB/CPU-s 279.36KiB/CPU-s 3.44KiB/CPU-s 0.0 0.044978 False False
syslog_loki ingress throughput 38.95KiB/CPU-s 0.45 100.00% 8.53MiB/CPU-s 247.67KiB/CPU-s 3.05KiB/CPU-s 0.0 0.028358 8.57MiB/CPU-s 197.39KiB/CPU-s 2.43KiB/CPU-s 0.0 0.022501 False False
socket_to_socket_blackhole ingress throughput 16.61KiB/CPU-s 0.12 99.99% 13.46MiB/CPU-s 272.41KiB/CPU-s 3.35KiB/CPU-s 0.0 0.01976 13.48MiB/CPU-s 223.67KiB/CPU-s 2.75KiB/CPU-s 0.0 0.016206 False False
datadog_agent_remap_blackhole ingress throughput 35.07KiB/CPU-s 0.11 93.45% 31.31MiB/CPU-s 1.14MiB/CPU-s 14.34KiB/CPU-s 0.0 0.036353 31.34MiB/CPU-s 1017.55KiB/CPU-s 12.52KiB/CPU-s 0.0 0.031701 False False
syslog_humio_logs ingress throughput 9.52KiB/CPU-s 0.10 98.17% 8.92MiB/CPU-s 203.15KiB/CPU-s 2.5KiB/CPU-s 0.0 0.022232 8.93MiB/CPU-s 257.5KiB/CPU-s 3.17KiB/CPU-s 0.0 0.028151 False False
enterprise_http_to_http ingress throughput 9.31KiB/CPU-s 0.07 97.78% 13.61MiB/CPU-s 293.78KiB/CPU-s 3.61KiB/CPU-s 0.0 0.021071 13.62MiB/CPU-s 152.12KiB/CPU-s 1.87KiB/CPU-s 0.0 0.010903 False False
splunk_hec_to_splunk_hec_logs_acks ingress throughput 900.76B/CPU-s 0.01 11.47% 13.61MiB/CPU-s 354.06KiB/CPU-s 4.35KiB/CPU-s 0.0 0.025396 13.61MiB/CPU-s 346.92KiB/CPU-s 4.27KiB/CPU-s 0.0 0.024883 False False
http_to_http_noack ingress throughput -99.98B/CPU-s -0.00 1.33% 13.61MiB/CPU-s 335.19KiB/CPU-s 4.12KiB/CPU-s 0.0 0.024047 13.61MiB/CPU-s 336.31KiB/CPU-s 4.14KiB/CPU-s 0.0 0.024127 False False
splunk_hec_indexer_ack_blackhole ingress throughput 616.88B/CPU-s 0.00 10.41% 13.61MiB/CPU-s 266.55KiB/CPU-s 3.28KiB/CPU-s 0.0 0.019119 13.61MiB/CPU-s 262.69KiB/CPU-s 3.23KiB/CPU-s 0.0 0.018841 False False
fluent_elasticsearch ingress throughput -381.75B/CPU-s -0.00 52.56% 45.41MiB/CPU-s 30.37KiB/CPU-s 378.52B/CPU-s 0.0 0.000653 45.41MiB/CPU-s 30.18KiB/CPU-s 376.24B/CPU-s 0.0 0.000649 False False
http_to_http_json ingress throughput -770.22B/CPU-s -0.01 15.84% 13.62MiB/CPU-s 214.59KiB/CPU-s 2.64KiB/CPU-s 0.0 0.015384 13.62MiB/CPU-s 217.99KiB/CPU-s 2.68KiB/CPU-s 0.0 0.015628 False False
splunk_hec_to_splunk_hec_logs_noack ingress throughput -2.27KiB/CPU-s -0.02 36.97% 13.62MiB/CPU-s 263.61KiB/CPU-s 3.24KiB/CPU-s 0.0 0.018906 13.61MiB/CPU-s 278.25KiB/CPU-s 3.42KiB/CPU-s 0.0 0.019959 False False
syslog_splunk_hec_logs ingress throughput -5.52KiB/CPU-s -0.06 83.99% 8.86MiB/CPU-s 216.51KiB/CPU-s 2.66KiB/CPU-s 0.0 0.023861 8.86MiB/CPU-s 234.55KiB/CPU-s 2.88KiB/CPU-s 0.0 0.025865 False False
datadog_agent_remap_datadog_logs ingress throughput -55.27KiB/CPU-s -0.16 99.98% 33.09MiB/CPU-s 835.16KiB/CPU-s 10.28KiB/CPU-s 0.0 0.024642 33.04MiB/CPU-s 844.4KiB/CPU-s 10.39KiB/CPU-s 0.0 0.024955 False False
otlp_http_to_blackhole ingress throughput -2.75KiB/CPU-s -0.18 81.23% 1.53MiB/CPU-s 117.7KiB/CPU-s 1.45KiB/CPU-s 0.0 0.075096 1.53MiB/CPU-s 122.4KiB/CPU-s 1.51KiB/CPU-s 0.0 0.078233 False False
otlp_grpc_to_blackhole ingress throughput -2.98KiB/CPU-s -0.28 99.99% 1.04MiB/CPU-s 47.37KiB/CPU-s 596.84B/CPU-s 0.0 0.04454 1.04MiB/CPU-s 39.35KiB/CPU-s 495.93B/CPU-s 0.0 0.037102 False False
http_text_to_http_json ingress throughput -75.01KiB/CPU-s -0.30 100.00% 24.82MiB/CPU-s 533.94KiB/CPU-s 6.57KiB/CPU-s 0.0 0.021007 24.75MiB/CPU-s 718.8KiB/CPU-s 8.85KiB/CPU-s 0.0 0.028364 False False
datadog_agent_remap_blackhole_acks ingress throughput -230.63KiB/CPU-s -0.73 100.00% 31.06MiB/CPU-s 1.11MiB/CPU-s 14.03KiB/CPU-s 0.0 0.035836 30.84MiB/CPU-s 701.6KiB/CPU-s 8.64KiB/CPU-s 0.0 0.022215 False False
datadog_agent_remap_datadog_logs_acks ingress throughput -287.5KiB/CPU-s -0.85 100.00% 33.13MiB/CPU-s 979.2KiB/CPU-s 12.05KiB/CPU-s 0.0 0.02886 32.85MiB/CPU-s 1.19MiB/CPU-s 15.05KiB/CPU-s 0.0 0.036358 False False
syslog_log2metric_splunk_hec_metrics ingress throughput -99.75KiB/CPU-s -1.05 100.00% 9.32MiB/CPU-s 193.46KiB/CPU-s 2.38KiB/CPU-s 0.0 0.020269 9.22MiB/CPU-s 233.59KiB/CPU-s 2.87KiB/CPU-s 0.0 0.024733 False False
syslog_regex_logs2metric_ddmetrics ingress throughput -105.08KiB/CPU-s -2.83 100.00% 3.63MiB/CPU-s 388.7KiB/CPU-s 4.78KiB/CPU-s 0.0 0.104675 3.52MiB/CPU-s 431.63KiB/CPU-s 5.31KiB/CPU-s 0.0 0.119622 True True
file_to_blackhole egress throughput -452.55KiB/CPU-s -6.81 99.24% 6.49MiB/CPU-s 4.18MiB/CPU-s 125.44KiB/CPU-s 5.665236 0.644257 6.05MiB/CPU-s 4.34MiB/CPU-s 114.04KiB/CPU-s 0.0 0.717524 True True

@jszwedko
Copy link
Member

Just a note that this may conflict with https://github.com/vectordotdev/vector/pull/16281/files#diff-1db1d87549a6fdaf4d5c9325481bbc90ef363d92d05c2685d4e7e4777478415d depending on which goes in first.

let powershell_command = format!(
"$progressPreference = 'silentlyContinue'; Expand-Archive {zip_file}"
);
app::exec("powershell", ["-Command", &powershell_command], false)?;

Check failure

Code scanning / check-spelling

Unrecognized Spelling

[ommand](#security-tab) is not a recognized word. \(unrecognized-spelling\)
@jonathanpv jonathanpv requested a review from bruceg March 16, 2023 03:05
@github-actions
Copy link

Regression Detector Results

Run ID: 9733a8a8-9080-4a12-872e-d83f5f483973
Baseline: be9e2c4
Comparison: f07caf6
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine quickly if vector performance is changed and to what degree by a pull request.

The table below, if present, lists those experiments that have experienced a statistically significant change in mean optimization goal performance between baseline and comparison SHAs with 90.00% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5.00% change in their mean optimization goal are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting change is observed.

No interesting changes in experiment optimization goals with confidence ≥ 90.00% and |Δ mean %| ≥ 5.00%.

Fine details of change detection per experiment.
experiment goal Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
syslog_humio_logs ingress throughput 258.38KiB/CPU-s 2.91 100.00% 8.68MiB/CPU-s 292.84KiB/CPU-s 3.6KiB/CPU-s 0.0 0.032946 8.93MiB/CPU-s 237.12KiB/CPU-s 2.92KiB/CPU-s 0.0 0.025924 False False
syslog_splunk_hec_logs ingress throughput 237.01KiB/CPU-s 2.69 100.00% 8.61MiB/CPU-s 231.71KiB/CPU-s 2.85KiB/CPU-s 0.0 0.02627 8.84MiB/CPU-s 223.72KiB/CPU-s 2.75KiB/CPU-s 0.0 0.0247 False False
datadog_agent_remap_blackhole ingress throughput 783.77KiB/CPU-s 2.54 100.00% 30.13MiB/CPU-s 1.89MiB/CPU-s 23.86KiB/CPU-s 0.0 0.062865 30.9MiB/CPU-s 863.85KiB/CPU-s 10.63KiB/CPU-s 0.0 0.027303 False False
socket_to_socket_blackhole ingress throughput 317.23KiB/CPU-s 2.38 100.00% 13.03MiB/CPU-s 358.51KiB/CPU-s 4.41KiB/CPU-s 0.0 0.026858 13.34MiB/CPU-s 364.56KiB/CPU-s 4.49KiB/CPU-s 0.0 0.026678 False False
http_text_to_http_json ingress throughput 546.53KiB/CPU-s 2.21 100.00% 24.15MiB/CPU-s 787.69KiB/CPU-s 9.69KiB/CPU-s 0.0 0.031852 24.68MiB/CPU-s 620.58KiB/CPU-s 7.64KiB/CPU-s 0.0 0.024552 False False
datadog_agent_remap_datadog_logs ingress throughput 648.77KiB/CPU-s 1.95 100.00% 32.48MiB/CPU-s 1.53MiB/CPU-s 19.23KiB/CPU-s 0.0 0.046969 33.12MiB/CPU-s 899.1KiB/CPU-s 11.06KiB/CPU-s 0.0 0.02651 False False
otlp_grpc_to_blackhole ingress throughput 18.04KiB/CPU-s 1.74 100.00% 1.01MiB/CPU-s 49.11KiB/CPU-s 618.83B/CPU-s 0.0 0.047414 1.03MiB/CPU-s 44.56KiB/CPU-s 561.56B/CPU-s 0.0 0.042279 False False
syslog_regex_logs2metric_ddmetrics ingress throughput 51.99KiB/CPU-s 1.47 100.00% 3.46MiB/CPU-s 380.19KiB/CPU-s 4.68KiB/CPU-s 0.0 0.107167 3.51MiB/CPU-s 343.27KiB/CPU-s 4.43KiB/CPU-s 0.0 0.095363 True True
otlp_http_to_blackhole ingress throughput 20.4KiB/CPU-s 1.32 100.00% 1.51MiB/CPU-s 122.03KiB/CPU-s 1.5KiB/CPU-s 0.0 0.079093 1.53MiB/CPU-s 116.05KiB/CPU-s 1.43KiB/CPU-s 0.0 0.074232 False False
syslog_log2metric_humio_metrics ingress throughput 73.36KiB/CPU-s 1.19 100.00% 6.01MiB/CPU-s 172.22KiB/CPU-s 2.12KiB/CPU-s 0.0 0.028003 6.08MiB/CPU-s 187.85KiB/CPU-s 2.31KiB/CPU-s 0.0 0.030185 False False
syslog_log2metric_splunk_hec_metrics ingress throughput 93.42KiB/CPU-s 1.02 100.00% 8.99MiB/CPU-s 306.65KiB/CPU-s 3.77KiB/CPU-s 0.0 0.033321 9.08MiB/CPU-s 259.0KiB/CPU-s 3.19KiB/CPU-s 0.0 0.027861 False False
http_to_http_json ingress throughput 46.79KiB/CPU-s 0.34 100.00% 13.57MiB/CPU-s 292.0KiB/CPU-s 3.59KiB/CPU-s 0.0 0.021005 13.62MiB/CPU-s 218.2KiB/CPU-s 2.68KiB/CPU-s 0.0 0.015644 False False
enterprise_http_to_http ingress throughput 11.13KiB/CPU-s 0.08 98.17% 13.61MiB/CPU-s 332.5KiB/CPU-s 4.09KiB/CPU-s 0.0 0.023854 13.62MiB/CPU-s 190.31KiB/CPU-s 2.34KiB/CPU-s 0.0 0.013642 False False
http_to_http_noack ingress throughput 3.79KiB/CPU-s 0.03 46.25% 13.61MiB/CPU-s 370.82KiB/CPU-s 4.56KiB/CPU-s 0.0 0.02661 13.61MiB/CPU-s 335.28KiB/CPU-s 4.12KiB/CPU-s 0.0 0.024053 False False
splunk_hec_indexer_ack_blackhole ingress throughput 2.74KiB/CPU-s 0.02 45.61% 13.61MiB/CPU-s 267.62KiB/CPU-s 3.29KiB/CPU-s 0.0 0.019195 13.62MiB/CPU-s 250.32KiB/CPU-s 3.08KiB/CPU-s 0.0 0.017951 False False
splunk_hec_to_splunk_hec_logs_acks ingress throughput -47.23B/CPU-s -0.00 0.57% 13.61MiB/CPU-s 375.5KiB/CPU-s 4.62KiB/CPU-s 0.0 0.026934 13.61MiB/CPU-s 367.95KiB/CPU-s 4.53KiB/CPU-s 0.0 0.026392 False False
splunk_hec_to_splunk_hec_logs_noack ingress throughput -825.25B/CPU-s -0.01 13.44% 13.61MiB/CPU-s 271.89KiB/CPU-s 3.34KiB/CPU-s 0.0 0.019501 13.61MiB/CPU-s 275.6KiB/CPU-s 3.39KiB/CPU-s 0.0 0.019768 False False
fluent_elasticsearch ingress throughput -7.7KiB/CPU-s -0.02 81.48% 45.41MiB/CPU-s 30.2KiB/CPU-s 376.33B/CPU-s 0.0 0.000649 45.41MiB/CPU-s 476.96KiB/CPU-s 5.8KiB/CPU-s 0.0 0.010257 False False
datadog_agent_remap_blackhole_acks ingress throughput -64.74KiB/CPU-s -0.20 99.83% 31.4MiB/CPU-s 859.39KiB/CPU-s 10.58KiB/CPU-s 0.0 0.026727 31.34MiB/CPU-s 1.4MiB/CPU-s 17.65KiB/CPU-s 0.0 0.044686 False False
splunk_hec_route_s3 ingress throughput -83.18KiB/CPU-s -0.70 100.00% 11.55MiB/CPU-s 568.5KiB/CPU-s 6.99KiB/CPU-s 0.0 0.048043 11.47MiB/CPU-s 575.78KiB/CPU-s 7.09KiB/CPU-s 0.0 0.049003 False False
datadog_agent_remap_datadog_logs_acks ingress throughput -280.01KiB/CPU-s -0.84 100.00% 32.66MiB/CPU-s 1021.47KiB/CPU-s 12.57KiB/CPU-s 0.0 0.030543 32.38MiB/CPU-s 1.38MiB/CPU-s 17.36KiB/CPU-s 0.0 0.042555 False False
http_to_http_acks ingress throughput -51.06KiB/CPU-s -0.95 70.86% 5.27MiB/CPU-s 2.72MiB/CPU-s 34.3KiB/CPU-s 0.0 0.516874 5.22MiB/CPU-s 2.71MiB/CPU-s 34.14KiB/CPU-s 0.0 0.519291 True False
file_to_blackhole egress throughput -83.15KiB/CPU-s -1.19 36.66% 6.85MiB/CPU-s 4.01MiB/CPU-s 118.36KiB/CPU-s 4.651163 0.585519 6.77MiB/CPU-s 4.04MiB/CPU-s 127.97KiB/CPU-s 0.0 0.597103 True True
syslog_loki ingress throughput -107.84KiB/CPU-s -1.25 100.00% 8.44MiB/CPU-s 208.5KiB/CPU-s 2.56KiB/CPU-s 0.0 0.024135 8.33MiB/CPU-s 382.34KiB/CPU-s 4.7KiB/CPU-s 0.0 0.044817 False False

vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
vdev/src/commands/package/msi.rs Outdated Show resolved Hide resolved
@jonathanpv jonathanpv changed the title chore(vdev): rewrite package-msi.sh to vdev chore(vdev): Rewrite package-msi.sh to vdev Mar 16, 2023
Copy link
Contributor

@spencergilbert spencergilbert left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks like a couple of spelling dings to handle as well before merging

@github-actions
Copy link

Regression Detector Results

Run ID: 0bd334a2-5d8d-4765-bdf7-1f59972f61da
Baseline: cc1e0ef
Comparison: d5e87fa
Total vector CPUs: 7

Explanation

A regression test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine quickly if vector performance is changed and to what degree by a pull request.

The table below, if present, lists those experiments that have experienced a statistically significant change in mean optimization goal performance between baseline and comparison SHAs with 90.00% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±5.00% change in their mean optimization goal are discarded. An experiment is erratic if its coefficient of variation is greater than 0.1. The abbreviated table will be omitted if no interesting change is observed.

No interesting changes in experiment optimization goals with confidence ≥ 90.00% and |Δ mean %| ≥ 5.00%.

Fine details of change detection per experiment.
experiment goal Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
datadog_agent_remap_blackhole ingress throughput 1.38MiB/CPU-s 4.70 100.00% 29.32MiB/CPU-s 2.03MiB/CPU-s 25.61KiB/CPU-s 0.0 0.069353 30.69MiB/CPU-s 1.31MiB/CPU-s 16.48KiB/CPU-s 0.0 0.042602 False False
syslog_loki ingress throughput 384.82KiB/CPU-s 4.59 100.00% 8.18MiB/CPU-s 378.28KiB/CPU-s 4.65KiB/CPU-s 0.0 0.045136 8.56MiB/CPU-s 248.18KiB/CPU-s 3.05KiB/CPU-s 0.0 0.028312 False False
datadog_agent_remap_blackhole_acks ingress throughput 1.19MiB/CPU-s 3.91 100.00% 30.53MiB/CPU-s 1.55MiB/CPU-s 19.55KiB/CPU-s 0.0 0.050818 31.72MiB/CPU-s 874.14KiB/CPU-s 10.76KiB/CPU-s 0.0 0.026909 False False
syslog_humio_logs ingress throughput 284.66KiB/CPU-s 3.28 100.00% 8.48MiB/CPU-s 381.48KiB/CPU-s 4.69KiB/CPU-s 0.0 0.043931 8.76MiB/CPU-s 324.79KiB/CPU-s 3.99KiB/CPU-s 0.0 0.036216 False False
splunk_hec_route_s3 ingress throughput 241.8KiB/CPU-s 2.07 100.00% 11.38MiB/CPU-s 703.51KiB/CPU-s 8.66KiB/CPU-s 0.0 0.060357 11.62MiB/CPU-s 615.68KiB/CPU-s 7.57KiB/CPU-s 0.0 0.051749 False False
syslog_splunk_hec_logs ingress throughput 164.02KiB/CPU-s 1.87 100.00% 8.59MiB/CPU-s 267.48KiB/CPU-s 3.29KiB/CPU-s 0.0 0.030415 8.75MiB/CPU-s 271.06KiB/CPU-s 3.33KiB/CPU-s 0.0 0.030257 False False
syslog_log2metric_splunk_hec_metrics ingress throughput 80.36KiB/CPU-s 0.88 100.00% 8.95MiB/CPU-s 317.65KiB/CPU-s 3.91KiB/CPU-s 0.0 0.034671 9.03MiB/CPU-s 278.86KiB/CPU-s 3.43KiB/CPU-s 0.0 0.030172 False False
http_text_to_http_json ingress throughput 149.26KiB/CPU-s 0.59 100.00% 24.69MiB/CPU-s 678.21KiB/CPU-s 8.34KiB/CPU-s 0.0 0.026828 24.83MiB/CPU-s 734.19KiB/CPU-s 9.04KiB/CPU-s 0.0 0.028872 False False
enterprise_http_to_http ingress throughput 3.54KiB/CPU-s 0.03 71.16% 13.62MiB/CPU-s 222.67KiB/CPU-s 2.74KiB/CPU-s 0.0 0.015963 13.62MiB/CPU-s 154.79KiB/CPU-s 1.91KiB/CPU-s 0.0 0.011095 False False
splunk_hec_to_splunk_hec_logs_acks ingress throughput -584.48B/CPU-s -0.00 7.01% 13.61MiB/CPU-s 387.51KiB/CPU-s 4.77KiB/CPU-s 0.0 0.027795 13.61MiB/CPU-s 357.83KiB/CPU-s 4.4KiB/CPU-s 0.0 0.025668 False False
http_to_http_noack ingress throughput 14.87B/CPU-s 0.00 0.19% 13.61MiB/CPU-s 352.72KiB/CPU-s 4.34KiB/CPU-s 0.0 0.025307 13.61MiB/CPU-s 351.43KiB/CPU-s 4.32KiB/CPU-s 0.0 0.025215 False False
splunk_hec_indexer_ack_blackhole ingress throughput 556.49B/CPU-s 0.00 9.48% 13.61MiB/CPU-s 263.45KiB/CPU-s 3.24KiB/CPU-s 0.0 0.018896 13.61MiB/CPU-s 261.34KiB/CPU-s 3.21KiB/CPU-s 0.0 0.018744 False False
http_to_http_json ingress throughput 16.22B/CPU-s 0.00 0.33% 13.62MiB/CPU-s 223.46KiB/CPU-s 2.75KiB/CPU-s 0.0 0.016022 13.62MiB/CPU-s 222.84KiB/CPU-s 2.74KiB/CPU-s 0.0 0.015977 False False
fluent_elasticsearch ingress throughput 314.45B/CPU-s 0.00 45.10% 45.41MiB/CPU-s 29.66KiB/CPU-s 369.44B/CPU-s 0.0 0.000638 45.41MiB/CPU-s 29.92KiB/CPU-s 372.69B/CPU-s 0.0 0.000643 False False
splunk_hec_to_splunk_hec_logs_noack ingress throughput -944.09B/CPU-s -0.01 15.35% 13.61MiB/CPU-s 271.5KiB/CPU-s 3.34KiB/CPU-s 0.0 0.019473 13.61MiB/CPU-s 276.22KiB/CPU-s 3.4KiB/CPU-s 0.0 0.019813 False False
socket_to_socket_blackhole ingress throughput -11.41KiB/CPU-s -0.08 97.12% 13.55MiB/CPU-s 271.5KiB/CPU-s 3.34KiB/CPU-s 0.0 0.019563 13.54MiB/CPU-s 326.01KiB/CPU-s 4.01KiB/CPU-s 0.0 0.02351 False False
syslog_regex_logs2metric_ddmetrics ingress throughput -3.52KiB/CPU-s -0.10 34.36% 3.6MiB/CPU-s 405.43KiB/CPU-s 4.99KiB/CPU-s 0.0 0.11009 3.59MiB/CPU-s 498.9KiB/CPU-s 6.14KiB/CPU-s 0.0 0.135601 True True
datadog_agent_remap_datadog_logs ingress throughput -52.39KiB/CPU-s -0.16 97.84% 32.82MiB/CPU-s 1.24MiB/CPU-s 15.58KiB/CPU-s 0.0 0.037684 32.77MiB/CPU-s 1.32MiB/CPU-s 16.63KiB/CPU-s 0.0 0.040284 False False
otlp_grpc_to_blackhole ingress throughput -1.78KiB/CPU-s -0.17 96.30% 1.03MiB/CPU-s 52.44KiB/CPU-s 660.68B/CPU-s 0.0 0.049606 1.03MiB/CPU-s 45.44KiB/CPU-s 572.66B/CPU-s 0.0 0.04306 False False
http_to_http_acks ingress throughput -16.54KiB/CPU-s -0.30 26.28% 5.3MiB/CPU-s 2.82MiB/CPU-s 35.52KiB/CPU-s 0.0 0.531979 5.28MiB/CPU-s 2.71MiB/CPU-s 34.16KiB/CPU-s 0.0 0.513134 True False
syslog_log2metric_humio_metrics ingress throughput -38.25KiB/CPU-s -0.63 100.00% 5.97MiB/CPU-s 258.82KiB/CPU-s 3.19KiB/CPU-s 0.0 0.042323 5.93MiB/CPU-s 318.18KiB/CPU-s 3.91KiB/CPU-s 0.0 0.052357 False False
datadog_agent_remap_datadog_logs_acks ingress throughput -362.99KiB/CPU-s -1.06 100.00% 33.31MiB/CPU-s 985.03KiB/CPU-s 12.12KiB/CPU-s 0.0 0.028876 32.96MiB/CPU-s 1.17MiB/CPU-s 14.72KiB/CPU-s 0.0 0.035442 False False
otlp_http_to_blackhole ingress throughput -25.13KiB/CPU-s -1.56 100.00% 1.57MiB/CPU-s 101.6KiB/CPU-s 1.25KiB/CPU-s 0.0 0.063004 1.55MiB/CPU-s 105.14KiB/CPU-s 1.29KiB/CPU-s 0.0 0.066229 False False
file_to_blackhole egress throughput -139.19KiB/CPU-s -2.04 56.08% 6.65MiB/CPU-s 4.22MiB/CPU-s 132.06KiB/CPU-s 2.052239 0.634213 6.52MiB/CPU-s 4.36MiB/CPU-s 122.18KiB/CPU-s 6.726457 0.6693 True True

vdev/src/commands/package/msi.rs Show resolved Hide resolved
Comment on lines +76 to +78
println!("Running Build with args: {archive_version}");
println!("Copying ZIP archive...");

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I know these status messages were copied from the original script, but I don't think they inform anything.

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I removed this in my local branch and will push shortly

vdev/src/commands/package/msi.rs Show resolved Hide resolved
"-var var.VectorDir",
"-out components.wxs"
];
Command::new("heat").args(args).capture_output()?;
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since we don't use the output, and any messages from this command (and below) would end up being thrown away by this, I think you want check_run here:

Suggested change
Command::new("heat").args(args).capture_output()?;
Command::new("heat").args(args).check_run()?;

Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Implemented locally and will push

vdev/src/commands/package/msi.rs Show resolved Hide resolved
@jszwedko jszwedko marked this pull request as draft June 30, 2023 23:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-condition: integration tests enable Run integration tests on this PR domain: ci Anything related to Vector's CI environment domain: releasing Anything related to releasing Vector domain: vdev Anything related to the vdev tooling platform: windows Anything `windows` platform related
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants