Skip to content

chore(deps): Upgrade Rust to 1.61.0 #12812

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 12 commits into from
Jun 14, 2022
Merged

chore(deps): Upgrade Rust to 1.61.0 #12812

merged 12 commits into from
Jun 14, 2022

Conversation

lukesteensen
Copy link
Member

No description provided.

New image includes more recent GCC which should support `-static-pie`

Signed-off-by: Luke Steensen <[email protected]>
@netlify
Copy link

netlify bot commented May 20, 2022

Deploy Preview for vector-project canceled.

Name Link
🔨 Latest commit 80f5b85
🔍 Latest deploy log https://app.netlify.com/sites/vector-project/deploys/62a7d405b585540008641317

@github-actions github-actions bot added domain: ci Anything related to Vector's CI environment domain: codecs Anything related to Vector's codecs (encoding/decoding) domain: core Anything related to core crates i.e. vector-core, core-common, etc domain: sinks Anything related to the Vector's sinks domain: sources Anything related to the Vector's sources labels May 20, 2022
(Value::Null, Value::Null) => true,
(Self::Null, Self::Null) => true,
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This seems.... odd. Does it only complain about this specific one? If that's the case, I'd rather disable this Clippy lint. I'm fine using Self consistently, but it's just confusing to mix the two styles.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Any other opinions here? I can see both sides of the argument.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I am confused too. Which clippy rule is flagged here? We should either use Self everywhere here, or Value.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

error: unnecessary structure name repetition
   --> lib/value/src/value.rs:103:14
    |
103 |             (Value::Null, Value::Null) => true,
    |              ^^^^^ help: use the applicable keyword: `Self`
    |
note: the lint level is defined here
   --> lib/value/src/lib.rs:7:5
    |
7   |     clippy::nursery,
    |     ^^^^^^^^^^^^^^^
    = note: `#[deny(clippy::use_self)]` implied by `#[deny(clippy::nursery)]`
    = help: for further information visit https://rust-lang.github.io/rust-clippy/master/index.html#use_self

error: unnecessary structure name repetition
   --> lib/value/src/value.rs:103:27
    |
103 |             (Value::Null, Value::Null) => true,
    |                           ^^^^^ help: use the applicable keyword: `Self`
    |
    = help: for further information visit https://rust-lang.github.io/rust-clippy/master/index.html#use_self

Copy link
Member

@bruceg bruceg Jun 13, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's weird that it only triggers on this variant. IMO they all should reference Self, so I would prefer keeping the lint. I completely agree it's confusing to mix the two styles, though.

The false negative is a known bug apparently fixed in Rust 1.61 (oops, apparently the fix is not released yet).

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I'd be 👍 on using Self everywhere here.

Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Updated that and checking to see if it's angry about that at all

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yeah, I believe it was only catching the non-tuple, non-struct variant here but probably intends to cover all of them. I'd agree with updating to Self everywhere.

@spencergilbert
Copy link
Contributor

How's progress on this?

@lukesteensen
Copy link
Member Author

@spencergilbert I would say progress is stalled at the moment. We still have similar issues with cross compilation that we had with the failed 1.59 upgrade, and I wasn't able to work out any obvious solutions.

@spencergilbert
Copy link
Contributor

@spencergilbert I would say progress is stalled at the moment. We still have similar issues with cross compilation that we had with the failed 1.59 upgrade, and I wasn't able to work out any obvious solutions.

👍 kube-rs upgrades are blocked by the current version, so I wanted to check in.

@github-actions
Copy link

Soak Test Results

Baseline: fd17b26
Comparison: f93a10f
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_to_http_acks 66.55KiB 0.36 22.34% 17.85MiB 7.89MiB 164.88KiB 0 0.441832 17.92MiB 7.98MiB 166.82KiB 0 0.445402 True True
http_to_http_noack 79.71KiB 0.33 99.99% 23.77MiB 980.7KiB 19.98KiB 0 0.0402839 23.85MiB 233.45KiB 4.77KiB 0 0.00955788 False False
splunk_hec_to_splunk_hec_logs_acks 25.59KiB 0.11 71.21% 23.75MiB 824.27KiB 16.76KiB 0 0.0338797 23.78MiB 849.51KiB 17.29KiB 0 0.0348805 False False
fluent_elasticsearch 4.7KiB 0.01 80.09% 79.47MiB 173.18KiB 3.49KiB 0 0.00212774 79.47MiB 53.84KiB 1.09KiB 0 0.000661492 False False
splunk_hec_indexer_ack_blackhole 440.14B 0 1.63% 23.77MiB 732.59KiB 14.91KiB 0 0.0300887 23.77MiB 731.58KiB 14.89KiB 0 0.0300467 False False
splunk_hec_to_splunk_hec_logs_noack 956.77B 0 7.95% 23.84MiB 322.5KiB 6.61KiB 0 0.0132107 23.84MiB 323.72KiB 6.63KiB 0 0.0132601 False False
http_to_http_json 236.27B 0 1.88% 23.84MiB 339.16KiB 6.93KiB 0 0.0138887 23.84MiB 338.92KiB 6.92KiB 0 0.0138789 False False
file_to_blackhole -221.86KiB -0.23 97.11% 95.36MiB 3.28MiB 68.21KiB 0 0.0343826 95.15MiB 3.64MiB 75.21KiB 0 0.038279 False False
datadog_agent_remap_blackhole_acks -370.52KiB -0.53 100.00% 68.53MiB 3.0MiB 62.53KiB 0 0.0437016 68.17MiB 908.1KiB 18.54KiB 0 0.0130058 False False
datadog_agent_remap_blackhole -525.33KiB -0.79 100.00% 65.14MiB 881.23KiB 18.05KiB 0 0.0132076 64.63MiB 860.44KiB 17.61KiB 0 0.0129984 False False
syslog_regex_logs2metric_ddmetrics -172.67KiB -1.38 100.00% 12.2MiB 855.62KiB 17.42KiB 0 0.0684748 12.03MiB 991.57KiB 20.17KiB 0 0.0804668 False False
http_pipelines_blackhole_acks -62.93KiB -1.4 99.98% 4.38MiB 579.25KiB 11.85KiB 0 0.129261 4.31MiB 588.46KiB 12.02KiB 0 0.133186 False False
syslog_loki -271.04KiB -1.79 100.00% 14.75MiB 461.23KiB 9.4KiB 0 0.0305236 14.49MiB 197.41KiB 4.03KiB 0 0.0133028 False False
syslog_log2metric_splunk_hec_metrics -342.41KiB -1.83 100.00% 18.27MiB 873.93KiB 17.78KiB 0 0.04671 17.93MiB 677.55KiB 13.8KiB 0 0.0368887 False False
splunk_hec_route_s3 -362.82KiB -1.86 100.00% 19.09MiB 2.28MiB 47.62KiB 0 0.119332 18.73MiB 2.29MiB 47.86KiB 0 0.122206 False False
syslog_splunk_hec_logs -340.55KiB -1.91 100.00% 17.41MiB 148.97KiB 3.04KiB 0 0.00835282 17.08MiB 115.64KiB 2.36KiB 0 0.00661024 False False
syslog_humio_logs -373.47KiB -2.15 100.00% 16.98MiB 178.56KiB 3.66KiB 0 0.0102664 16.62MiB 144.24KiB 2.95KiB 0 0.00847556 False False
http_pipelines_no_grok_blackhole -480.72KiB -2.44 100.00% 19.23MiB 1.46MiB 30.42KiB 0 0.0756948 18.76MiB 1.48MiB 30.87KiB 0 0.0788841 False False
syslog_log2metric_humio_metrics -384.46KiB -2.59 100.00% 14.48MiB 382.66KiB 7.8KiB 0 0.0257947 14.11MiB 155.88KiB 3.19KiB 0 0.0107874 False False
http_pipelines_blackhole -117.53KiB -2.7 100.00% 4.26MiB 648.22KiB 13.28KiB 0 0.14869 4.14MiB 711.43KiB 14.51KiB 0 0.167712 False False
datadog_agent_remap_datadog_logs -2.0MiB -2.86 100.00% 69.7MiB 2.31MiB 48.25KiB 0 0.033138 67.7MiB 2.26MiB 47.32KiB 0 0.0333474 False False
splunk_transforms_splunk3 -381.54KiB -2.91 100.00% 12.83MiB 2.2MiB 45.89KiB 0 0.171286 12.45MiB 2.16MiB 45.32KiB 0 0.173804 False False
socket_to_socket_blackhole -474.71KiB -3.36 100.00% 13.8MiB 626.26KiB 12.74KiB 0 0.0443072 13.34MiB 504.93KiB 10.29KiB 0 0.036965 False False
datadog_agent_remap_datadog_logs_acks -2.55MiB -3.61 100.00% 70.82MiB 610.77KiB 12.47KiB 0 0.00842085 68.26MiB 2.46MiB 51.48KiB 0 0.03604 False False

Signed-off-by: Spencer Gilbert <[email protected]>
@github-actions github-actions bot added domain: topology Anything related to Vector's topology code domain: transforms Anything related to Vector's transform components domain: vrl Anything related to the Vector Remap Language labels Jun 10, 2022
@spencergilbert spencergilbert self-assigned this Jun 10, 2022
@github-actions
Copy link

Soak Test Results

Baseline: 8069866
Comparison: 548190f
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_to_http_noack 103.75KiB 0.43 100.00% 23.75MiB 1.08MiB 22.51KiB 0 0.0454472 23.85MiB 242.45KiB 4.95KiB 0 0.00992642 False False
http_to_http_acks 38.8KiB 0.21 13.47% 17.82MiB 7.57MiB 158.27KiB 0 0.424853 17.86MiB 7.9MiB 165.18KiB 0 0.442444 True True
fluent_elasticsearch 50.96KiB 0.06 88.72% 79.42MiB 1.56MiB 32.11KiB 0 0.0196228 79.47MiB 53.6KiB 1.08KiB 0 0.000658516 False False
splunk_hec_to_splunk_hec_logs_noack 530.13B 0 4.31% 23.84MiB 328.17KiB 6.71KiB 0 0.0134418 23.84MiB 334.43KiB 6.85KiB 0 0.0136978 False False
splunk_hec_to_splunk_hec_logs_acks 342.98B 0 1.10% 23.75MiB 833.6KiB 16.95KiB 0 0.0342674 23.75MiB 860.96KiB 17.51KiB 0 0.0353913 False False
http_to_http_json 94.19B 0 0.78% 23.85MiB 330.29KiB 6.74KiB 0 0.0135236 23.85MiB 324.12KiB 6.62KiB 0 0.0132707 False False
splunk_hec_indexer_ack_blackhole -5.02KiB -0.02 19.09% 23.78MiB 712.63KiB 14.51KiB 0 0.0292638 23.77MiB 731.68KiB 14.89KiB 0 0.0300521 False False
file_to_blackhole -155.19KiB -0.16 96.23% 95.33MiB 2.23MiB 46.28KiB 0 0.0233402 95.17MiB 2.84MiB 58.6KiB 0 0.0297935 False False
syslog_regex_logs2metric_ddmetrics -62.86KiB -0.48 99.87% 12.74MiB 667.22KiB 13.58KiB 0 0.0511428 12.68MiB 693.36KiB 14.11KiB 0 0.0534037 False False
http_pipelines_no_grok_blackhole -121.0KiB -0.63 99.71% 18.61MiB 1.45MiB 30.44KiB 0 0.0781503 18.49MiB 1.29MiB 26.96KiB 0 0.0698182 False False
datadog_agent_remap_blackhole_acks -602.04KiB -0.92 100.00% 63.79MiB 4.91MiB 102.37KiB 0 0.0768834 63.21MiB 3.98MiB 83.15KiB 0 0.0629628 False False
splunk_transforms_splunk3 -154.89KiB -1.21 98.45% 12.47MiB 2.16MiB 45.15KiB 0 0.173471 12.32MiB 2.17MiB 45.34KiB 0 0.175934 False False
http_pipelines_blackhole_acks -58.49KiB -1.26 99.98% 4.52MiB 543.71KiB 11.12KiB 0 0.117327 4.47MiB 553.71KiB 11.31KiB 0 0.121012 False False
syslog_humio_logs -229.79KiB -1.32 100.00% 17.0MiB 578.6KiB 11.86KiB 0 0.0332364 16.77MiB 410.78KiB 8.4KiB 0 0.023912 False False
http_pipelines_blackhole -70.52KiB -1.52 99.99% 4.53MiB 593.13KiB 12.16KiB 0 0.127791 4.46MiB 630.44KiB 12.86KiB 0 0.137927 False False
syslog_splunk_hec_logs -373.52KiB -2.14 100.00% 17.03MiB 483.89KiB 9.88KiB 0 0.0277483 16.66MiB 392.83KiB 8.03KiB 0 0.0230198 False False
datadog_agent_remap_datadog_logs_acks -1.81MiB -2.68 100.00% 67.69MiB 1.22MiB 25.48KiB 0 0.017998 65.87MiB 2.12MiB 44.27KiB 0 0.032116 False False
socket_to_socket_blackhole -397.02KiB -2.9 100.00% 13.35MiB 602.08KiB 12.25KiB 0 0.0440189 12.97MiB 359.58KiB 7.35KiB 0 0.0270755 False False
syslog_loki -454.17KiB -2.95 100.00% 15.01MiB 795.0KiB 16.2KiB 0 0.0517031 14.57MiB 684.13KiB 13.97KiB 0 0.0458469 False False
syslog_log2metric_splunk_hec_metrics -570.01KiB -3.06 100.00% 18.17MiB 728.09KiB 14.82KiB 0 0.0391271 17.61MiB 574.24KiB 11.7KiB 0 0.0318347 False False
splunk_hec_route_s3 -639.16KiB -3.36 100.00% 18.59MiB 2.36MiB 49.29KiB 0 0.126851 17.96MiB 2.45MiB 51.17KiB 0 0.136279 False False
datadog_agent_remap_datadog_logs -2.79MiB -4.27 100.00% 65.25MiB 4.57MiB 95.48KiB 0 0.0700965 62.46MiB 5.1MiB 106.44KiB 0 0.0816156 False False
syslog_log2metric_humio_metrics -643.65KiB -4.4 100.00% 14.28MiB 605.06KiB 12.34KiB 0 0.0413658 13.65MiB 388.8KiB 7.95KiB 0 0.0278044 False False
datadog_agent_remap_blackhole -3.0MiB -5.19 100.00% 57.85MiB 5.7MiB 119.49KiB 0 0.0985725 54.85MiB 4.13MiB 86.55KiB 0 0.0753548 False False

@spencergilbert spencergilbert added the ci-condition: integration tests enable Run integration tests on this PR label Jun 13, 2022
@spencergilbert
Copy link
Contributor

@tobz spent a little time looking at why we're seeing missing event failures now - I didn't notice anything in the changelogs either. Mind taking a look when you can?

Signed-off-by: Spencer Gilbert <[email protected]>
@github-actions github-actions bot added the domain: releasing Anything related to releasing Vector label Jun 13, 2022
@tobz tobz added the ci-condition: k8s e2e tests enable Run Kubernetes E2E test suite for this PR label Jun 13, 2022
@github-actions
Copy link

Soak Test Results

Baseline: 4a82f5f
Comparison: a5868c1
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
http_pipelines_blackhole_acks 29.47KiB 0.66 92.99% 4.34MiB 557.5KiB 11.39KiB 0 0.125558 4.36MiB 568.09KiB 11.6KiB 0 0.1271 False False
http_to_http_noack 69.21KiB 0.28 99.96% 23.78MiB 922.7KiB 18.8KiB 0 0.0378859 23.85MiB 236.52KiB 4.83KiB 0 0.00968395 False False
fluent_elasticsearch 34.97KiB 0.04 98.02% 79.44MiB 742.2KiB 14.96KiB 0 0.00912221 79.47MiB 53.9KiB 1.09KiB 0 0.000662238 False False
splunk_hec_to_splunk_hec_logs_noack -321.56B -0 2.69% 23.84MiB 319.24KiB 6.53KiB 0 0.0130763 23.84MiB 323.31KiB 6.62KiB 0 0.0132434 False False
splunk_hec_indexer_ack_blackhole -510.9B -0 1.79% 23.76MiB 772.16KiB 15.71KiB 0 0.0317256 23.76MiB 770.74KiB 15.68KiB 0 0.0316676 False False
http_to_http_json 105.71B 0 0.84% 23.84MiB 341.25KiB 6.97KiB 0 0.0139744 23.84MiB 341.68KiB 6.97KiB 0 0.0139919 False False
splunk_hec_to_splunk_hec_logs_acks -9.62KiB -0.04 33.42% 23.77MiB 753.2KiB 15.33KiB 0 0.0309405 23.76MiB 794.22KiB 16.15KiB 0 0.0326384 False False
file_to_blackhole -178.94KiB -0.18 94.81% 95.33MiB 3.04MiB 63.3KiB 0 0.0319139 95.16MiB 3.24MiB 66.8KiB 0 0.0339962 False False
http_to_http_acks -72.46KiB -0.4 23.63% 17.84MiB 8.25MiB 172.48KiB 0 0.462401 17.77MiB 8.05MiB 168.37KiB 0 0.453269 True True
datadog_agent_remap_blackhole_acks -342.24KiB -0.49 100.00% 68.86MiB 3.17MiB 66.19KiB 0 0.0460555 68.53MiB 1.45MiB 30.27KiB 0 0.0211315 False False
splunk_transforms_splunk3 -91.1KiB -0.73 84.74% 12.12MiB 2.16MiB 45.18KiB 0 0.17836 12.03MiB 2.14MiB 44.87KiB 0 0.178159 False False
http_pipelines_blackhole -39.12KiB -0.86 96.78% 4.43MiB 623.35KiB 12.78KiB 0 0.13732 4.39MiB 639.02KiB 13.04KiB 0 0.141995 False False
datadog_agent_remap_blackhole -610.09KiB -0.91 100.00% 65.62MiB 2.0MiB 41.83KiB 0 0.0304125 65.02MiB 1.83MiB 38.35KiB 0 0.0281601 False False
syslog_humio_logs -177.46KiB -1.03 100.00% 16.85MiB 315.08KiB 6.46KiB 0 0.0182554 16.68MiB 313.94KiB 6.43KiB 0 0.0183785 False False
syslog_loki -242.62KiB -1.54 100.00% 15.42MiB 434.39KiB 8.86KiB 0 0.0275126 15.18MiB 260.98KiB 5.33KiB 0 0.0167878 False False
syslog_regex_logs2metric_ddmetrics -197.63KiB -1.55 100.00% 12.45MiB 714.56KiB 14.54KiB 0 0.0560567 12.25MiB 761.04KiB 15.47KiB 0 0.0606437 False False
syslog_splunk_hec_logs -280.8KiB -1.58 100.00% 17.31MiB 110.11KiB 2.25KiB 0 0.00620962 17.04MiB 118.13KiB 2.41KiB 0 0.00676876 False False
syslog_log2metric_humio_metrics -266.94KiB -1.9 100.00% 13.75MiB 435.41KiB 8.88KiB 0 0.0309114 13.49MiB 217.62KiB 4.46KiB 0 0.0157481 False False
datadog_agent_remap_datadog_logs -1.59MiB -2.4 100.00% 66.3MiB 3.18MiB 66.37KiB 0 0.0479377 64.72MiB 3.17MiB 66.32KiB 0 0.0489541 False False
splunk_hec_route_s3 -492.83KiB -2.51 100.00% 19.16MiB 2.44MiB 51.02KiB 0 0.12733 18.68MiB 2.44MiB 51.03KiB 0 0.130643 False False
syslog_log2metric_splunk_hec_metrics -491.44KiB -2.66 100.00% 18.03MiB 1.07MiB 22.38KiB 0 0.0595525 17.55MiB 1.08MiB 22.53KiB 0 0.0615798 False False
datadog_agent_remap_datadog_logs_acks -2.14MiB -3.22 100.00% 66.54MiB 2.26MiB 47.38KiB 0 0.0340046 64.4MiB 3.83MiB 80.08KiB 0 0.059526 False False
socket_to_socket_blackhole -512.82KiB -3.53 100.00% 14.17MiB 599.87KiB 12.21KiB 0 0.0413256 13.67MiB 395.26KiB 8.07KiB 0 0.0282274 False False
http_pipelines_no_grok_blackhole -1.07MiB -6.13 100.00% 17.52MiB 1.76MiB 36.87KiB 0 0.100634 16.44MiB 2.01MiB 41.84KiB 0 0.121958 False False

@github-actions
Copy link

Soak Test Results

Baseline: ed2ebbc
Comparison: 80f5b85
Total Vector CPUs: 4

Explanation

A soak test is an integrated performance test for vector in a repeatable rig, with varying configuration for vector. What follows is a statistical summary of a brief vector run for each configuration across SHAs given above. The goal of these tests are to determine, quickly, if vector performance is changed and to what degree by a pull request. Where appropriate units are scaled per-core.

The table below, if present, lists those experiments that have experienced a statistically significant change in their throughput performance between baseline and comparision SHAs, with 90.0% confidence OR have been detected as newly erratic. Negative values mean that baseline is faster, positive comparison. Results that do not exhibit more than a ±8.87% change in mean throughput are discarded. An experiment is erratic if its coefficient of variation is greater than 0.3. The abbreviated table will be omitted if no interesting changes are observed.

No interesting changes in throughput with confidence ≥ 90.00% and absolute Δ mean >= ±8.87%:

Fine details of change detection per experiment.
experiment Δ mean Δ mean % confidence baseline mean baseline stdev baseline stderr baseline outlier % baseline CoV comparison mean comparison stdev comparison stderr comparison outlier % comparison CoV erratic declared erratic
datadog_agent_remap_blackhole_acks 2.17MiB 3.75 100.00% 57.75MiB 5.58MiB 116.38KiB 0 0.0966219 59.91MiB 4.66MiB 97.34KiB 0 0.0777741 False False
http_to_http_acks 437.74KiB 2.44 95.06% 17.5MiB 7.57MiB 158.28KiB 0 0.432429 17.93MiB 7.49MiB 156.61KiB 0 0.417755 True True
datadog_agent_remap_blackhole 1.23MiB 1.98 100.00% 61.86MiB 2.3MiB 48.15KiB 0 0.0371318 63.08MiB 2.33MiB 48.85KiB 0 0.036933 False False
socket_to_socket_blackhole 72.29KiB 0.51 100.00% 13.73MiB 583.2KiB 11.87KiB 0 0.0414667 13.8MiB 463.54KiB 9.46KiB 0 0.03279 False False
syslog_loki 51.3KiB 0.33 100.00% 15.21MiB 499.97KiB 10.19KiB 0 0.0320967 15.26MiB 316.21KiB 6.46KiB 0 0.0202333 False False
http_to_http_noack 54.21KiB 0.22 99.81% 23.79MiB 820.02KiB 16.72KiB 0 0.0336488 23.85MiB 237.38KiB 4.85KiB 0 0.00971911 False False
fluent_elasticsearch 47.41KiB 0.06 99.31% 79.43MiB 868.97KiB 17.5KiB 0 0.010682 79.47MiB 54.63KiB 1.1KiB 0 0.000671172 False False
splunk_hec_to_splunk_hec_logs_acks -219.61B -0 0.77% 23.77MiB 769.94KiB 15.66KiB 0 0.0316319 23.77MiB 783.34KiB 15.94KiB 0 0.0321825 False False
splunk_hec_indexer_ack_blackhole -155.47B -0 0.56% 23.77MiB 753.49KiB 15.33KiB 0 0.0309533 23.77MiB 753.95KiB 15.34KiB 0 0.0309725 False False
splunk_hec_to_splunk_hec_logs_noack -1.12KiB -0 9.38% 23.84MiB 323.32KiB 6.62KiB 0 0.0132431 23.84MiB 334.15KiB 6.85KiB 0 0.0136873 False False
http_to_http_json 1.18KiB 0 9.45% 23.84MiB 345.52KiB 7.06KiB 0 0.0141492 23.84MiB 340.06KiB 6.94KiB 0 0.0139248 False False
file_to_blackhole -134.64KiB -0.14 59.84% 95.02MiB 5.45MiB 112.84KiB 0 0.0573475 94.89MiB 5.53MiB 114.13KiB 0 0.0583183 False False
datadog_agent_remap_datadog_logs -133.91KiB -0.19 88.61% 67.12MiB 2.93MiB 61.06KiB 0 0.0435829 66.99MiB 2.8MiB 58.69KiB 0 0.0418506 False False
datadog_agent_remap_datadog_logs_acks -422.47KiB -0.64 100.00% 64.61MiB 1.53MiB 31.95KiB 0 0.0236301 64.19MiB 3.36MiB 70.1KiB 0 0.0522573 False False
http_pipelines_blackhole -32.01KiB -0.69 92.00% 4.51MiB 636.71KiB 13.04KiB 0 0.137875 4.48MiB 628.35KiB 12.82KiB 0 0.137014 False False
syslog_log2metric_humio_metrics -152.7KiB -1.11 100.00% 13.49MiB 1.17MiB 24.46KiB 0 0.0868239 13.34MiB 950.68KiB 19.46KiB 0 0.0695965 False False
splunk_hec_route_s3 -287.51KiB -1.51 99.99% 18.64MiB 2.47MiB 51.55KiB 0 0.132321 18.35MiB 2.43MiB 50.87KiB 0 0.132558 False False
http_pipelines_blackhole_acks -75.03KiB -1.64 100.00% 4.48MiB 556.48KiB 11.38KiB 0 0.121372 4.4MiB 589.53KiB 12.05KiB 0 0.13072 False False
splunk_transforms_splunk3 -374.02KiB -2.92 100.00% 12.5MiB 2.2MiB 46.03KiB 0 0.176357 12.13MiB 2.16MiB 45.13KiB 0 0.177634 False False
syslog_regex_logs2metric_ddmetrics -378.56KiB -2.95 100.00% 12.51MiB 667.54KiB 13.6KiB 0 0.0520832 12.14MiB 618.49KiB 12.59KiB 0 0.0497252 False False
syslog_splunk_hec_logs -590.53KiB -3.34 100.00% 17.28MiB 255.24KiB 5.21KiB 0 0.01442 16.71MiB 260.07KiB 5.32KiB 0 0.0151999 False False
syslog_humio_logs -608.08KiB -3.49 100.00% 17.02MiB 412.34KiB 8.45KiB 0 0.0236606 16.42MiB 380.72KiB 7.79KiB 0 0.0226365 False False
syslog_log2metric_splunk_hec_metrics -727.11KiB -3.93 100.00% 18.09MiB 903.0KiB 18.38KiB 0 0.0487476 17.38MiB 684.96KiB 13.96KiB 0 0.0384879 False False
http_pipelines_no_grok_blackhole -1.09MiB -5.69 100.00% 19.24MiB 1.41MiB 29.55KiB 0 0.0734885 18.15MiB 1.42MiB 29.69KiB 0 0.0784542 False False

@jszwedko jszwedko merged commit 39c5f13 into master Jun 14, 2022
@jszwedko jszwedko deleted the upgrade-rust-1.61.0 branch June 14, 2022 02:22
@jszwedko
Copy link
Member

🥳

@jszwedko
Copy link
Member

jszwedko commented Jun 14, 2022

Thanks to @tobz for tracking this one down! And to @lukesteensen and @spencergilbert for shepherding it in.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
ci-condition: integration tests enable Run integration tests on this PR ci-condition: k8s e2e tests enable Run Kubernetes E2E test suite for this PR domain: ci Anything related to Vector's CI environment domain: codecs Anything related to Vector's codecs (encoding/decoding) domain: core Anything related to core crates i.e. vector-core, core-common, etc domain: releasing Anything related to releasing Vector domain: sinks Anything related to the Vector's sinks domain: sources Anything related to the Vector's sources domain: topology Anything related to Vector's topology code domain: transforms Anything related to Vector's transform components domain: vrl Anything related to the Vector Remap Language
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants