Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

use rust 1.75.0 and cargo-semver-checks 0.33.0 on semver CI #1110

Closed
wants to merge 2 commits into from

Conversation

plebhash
Copy link
Collaborator

addressing #1104 (comment)

Copy link
Contributor

github-actions bot commented Aug 17, 2024

🐰Bencher

ReportSun, August 18, 2024 at 20:20:50 UTC
ProjectStratum v2 (SRI)
Branchmsrv-cargo-semver-check
Testbedsv1
Click to view all benchmark results
BenchmarkEstimated CyclesEstimated Cycles Results
estimated cycles | (Δ%)
Estimated Cycles Upper Boundary
estimated cycles | (%)
InstructionsInstructions Results
instructions | (Δ%)
Instructions Upper Boundary
instructions | (%)
L1 AccessesL1 Accesses Results
accesses | (Δ%)
L1 Accesses Upper Boundary
accesses | (%)
L2 AccessesL2 Accesses Results
accesses | (Δ%)
L2 Accesses Upper Boundary
accesses | (%)
RAM AccessesRAM Accesses Results
accesses | (Δ%)
RAM Accesses Upper Boundary
accesses | (%)
get_authorize✅ (view plot)8,508.00 (+0.81%)8,720.38 (97.56%)✅ (view plot)3,746.00 (+0.14%)3,851.88 (97.25%)✅ (view plot)5,248.00 (+0.06%)5,396.54 (97.25%)✅ (view plot)8.00 (+0.43%)10.32 (77.53%)✅ (view plot)92.00 (+2.07%)94.07 (97.80%)
get_submit✅ (view plot)95,473.00 (-0.08%)96,118.00 (99.33%)✅ (view plot)59,439.00 (-0.05%)59,766.77 (99.45%)✅ (view plot)85,353.00 (-0.06%)85,819.65 (99.46%)✅ (view plot)57.00 (+2.94%)62.45 (91.27%)✅ (view plot)281.00 (-0.34%)287.46 (97.75%)
get_subscribe✅ (view plot)7,957.00 (-0.22%)8,259.00 (96.34%)✅ (view plot)2,841.00 (+0.37%)2,936.96 (96.73%)✅ (view plot)3,972.00 (+0.43%)4,096.11 (96.97%)✅ (view plot)13.00 (-18.58%)19.85 (65.48%)✅ (view plot)112.00 (-0.50%)116.77 (95.92%)
serialize_authorize✅ (view plot)12,227.00 (+0.17%)12,492.69 (97.87%)✅ (view plot)5,317.00 (+0.10%)5,422.88 (98.05%)✅ (view plot)7,412.00 (+0.06%)7,559.97 (98.04%)✅ (view plot)11.00 (+1.56%)13.31 (82.63%)✅ (view plot)136.00 (+0.34%)140.04 (97.11%)
serialize_deserialize_authorize✅ (view plot)24,528.00 (+0.23%)24,703.60 (99.29%)✅ (view plot)9,898.00 (-0.02%)10,021.91 (98.76%)✅ (view plot)13,958.00 (-0.06%)14,144.47 (98.68%)✅ (view plot)35.00 (-4.13%)41.36 (84.62%)✅ (view plot)297.00 (+0.69%)297.91 (99.69%)
serialize_deserialize_handle_authorize✅ (view plot)30,283.00 (+0.42%)30,357.91 (99.75%)✅ (view plot)12,101.00 (+0.04%)12,206.88 (99.13%)✅ (view plot)17,113.00 (-0.02%)17,274.20 (99.07%)✅ (view plot)65.00 (+9.54%)66.25 (98.11%)✅ (view plot)367.00 (+0.81%)367.52 (99.86%)
serialize_deserialize_handle_submit✅ (view plot)126,290.00 (-0.09%)127,005.47 (99.44%)✅ (view plot)73,224.00 (-0.03%)73,606.64 (99.48%)✅ (view plot)104,945.00 (-0.04%)105,492.41 (99.48%)✅ (view plot)125.00 (+3.38%)131.69 (94.92%)✅ (view plot)592.00 (-0.44%)599.10 (98.81%)
serialize_deserialize_handle_subscribe✅ (view plot)27,431.00 (-0.08%)27,595.42 (99.40%)✅ (view plot)9,643.00 (+0.11%)9,738.96 (99.01%)✅ (view plot)13,641.00 (+0.13%)13,771.71 (99.05%)✅ (view plot)63.00 (-4.20%)73.49 (85.72%)✅ (view plot)385.00 (-0.18%)388.44 (99.12%)
serialize_deserialize_submit✅ (view plot)114,955.00 (-0.10%)115,629.71 (99.42%)✅ (view plot)68,001.00 (-0.08%)68,389.11 (99.43%)✅ (view plot)97,555.00 (-0.09%)98,130.59 (99.41%)✅ (view plot)71.00 (+1.95%)75.23 (94.37%)✅ (view plot)487.00 (-0.20%)492.17 (98.95%)
serialize_deserialize_subscribe✅ (view plot)22,850.00 (-0.09%)23,101.27 (98.91%)✅ (view plot)8,195.00 (+0.10%)8,294.45 (98.80%)✅ (view plot)11,545.00 (+0.13%)11,678.95 (98.85%)✅ (view plot)35.00 (-10.45%)44.22 (79.15%)✅ (view plot)318.00 (-0.14%)321.37 (98.95%)
serialize_submit✅ (view plot)99,752.00 (-0.13%)100,446.49 (99.31%)✅ (view plot)61,483.00 (-0.05%)61,815.97 (99.46%)✅ (view plot)88,202.00 (-0.05%)88,673.03 (99.47%)✅ (view plot)56.00 (+0.27%)61.92 (90.43%)✅ (view plot)322.00 (-0.75%)329.15 (97.83%)
serialize_subscribe✅ (view plot)11,260.00 (-0.53%)11,595.08 (97.11%)✅ (view plot)4,188.00 (+0.25%)4,283.96 (97.76%)✅ (view plot)5,830.00 (+0.29%)5,955.31 (97.90%)✅ (view plot)15.00 (-7.81%)18.89 (79.41%)✅ (view plot)153.00 (-1.30%)159.67 (95.82%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

Copy link
Contributor

github-actions bot commented Aug 17, 2024

🐰Bencher

ReportSun, August 18, 2024 at 20:20:52 UTC
ProjectStratum v2 (SRI)
Branchmsrv-cargo-semver-check
Testbedsv2
Click to view all benchmark results
BenchmarkLatencyLatency Results
nanoseconds (ns) | (Δ%)
Latency Upper Boundary
nanoseconds (ns) | (%)
client_sv2_handle_message_common✅ (view plot)44.84 (+0.59%)45.25 (99.09%)
client_sv2_handle_message_mining✅ (view plot)74.52 (+2.14%)80.27 (92.84%)
client_sv2_mining_message_submit_standard✅ (view plot)14.64 (-0.09%)14.70 (99.61%)
client_sv2_mining_message_submit_standard_serialize✅ (view plot)266.83 (+0.83%)283.97 (93.96%)
client_sv2_mining_message_submit_standard_serialize_deserialize✅ (view plot)584.80 (-1.51%)626.51 (93.34%)
client_sv2_open_channel✅ (view plot)166.57 (+0.33%)173.51 (96.00%)
client_sv2_open_channel_serialize✅ (view plot)270.59 (-4.11%)294.14 (91.99%)
client_sv2_open_channel_serialize_deserialize✅ (view plot)370.28 (-2.13%)422.39 (87.66%)
client_sv2_setup_connection✅ (view plot)161.47 (-1.61%)174.61 (92.47%)
client_sv2_setup_connection_serialize✅ (view plot)453.01 (-4.32%)507.93 (89.19%)
client_sv2_setup_connection_serialize_deserialize✅ (view plot)944.68 (-2.78%)1,039.28 (90.90%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

Copy link
Contributor

github-actions bot commented Aug 17, 2024

🐰Bencher

ReportSun, August 18, 2024 at 20:20:50 UTC
ProjectStratum v2 (SRI)
Branch1110/merge
Testbedsv1
Click to view all benchmark results
BenchmarkLatencyLatency Results
nanoseconds (ns) | (Δ%)
Latency Upper Boundary
nanoseconds (ns) | (%)
client-submit-serialize✅ (view plot)6,441.20 (-6.56%)7,373.51 (87.36%)
client-submit-serialize-deserialize✅ (view plot)7,576.20 (-3.13%)8,328.65 (90.97%)
client-submit-serialize-deserialize-handle/client-submit-serialize-deserialize-handle✅ (view plot)8,108.70 (-3.37%)8,838.07 (91.75%)
client-sv1-authorize-serialize-deserialize-handle/client-sv1-authorize-serialize-deserialize-handle✅ (view plot)890.71 (-0.80%)926.41 (96.15%)
client-sv1-authorize-serialize-deserialize/client-sv1-authorize-serialize-deserialize✅ (view plot)706.12 (+1.23%)717.95 (98.35%)
client-sv1-authorize-serialize/client-sv1-authorize-serialize✅ (view plot)246.14 (-0.70%)254.85 (96.58%)
client-sv1-get-authorize/client-sv1-get-authorize✅ (view plot)156.28 (-0.54%)162.21 (96.34%)
client-sv1-get-submit✅ (view plot)6,244.20 (-6.32%)7,143.42 (87.41%)
client-sv1-get-subscribe/client-sv1-get-subscribe✅ (view plot)275.00 (-1.25%)291.12 (94.46%)
client-sv1-subscribe-serialize-deserialize-handle/client-sv1-subscribe-serialize-deserialize-handle✅ (view plot)751.97 (+0.59%)776.10 (96.89%)
client-sv1-subscribe-serialize-deserialize/client-sv1-subscribe-serialize-deserialize✅ (view plot)621.47 (+1.08%)637.76 (97.45%)
client-sv1-subscribe-serialize/client-sv1-subscribe-serialize✅ (view plot)207.31 (+0.28%)219.76 (94.33%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

Copy link
Contributor

github-actions bot commented Aug 17, 2024

🐰Bencher

ReportSun, August 18, 2024 at 20:20:50 UTC
ProjectStratum v2 (SRI)
Branchmsrv-cargo-semver-check
Testbedsv2

🚨 6 ALERTS: Threshold Boundary Limits exceeded!
BenchmarkMeasure (units)ViewValueLower BoundaryUpper Boundary
client_sv2_mining_message_submit_standard_serialize_deserializeInstructions (instructions)🚨 (view plot | view alert)10,594.00 (+0.45%)10,582.31 (100.11%)
client_sv2_mining_message_submit_standard_serialize_deserializeL1 Accesses (accesses)🚨 (view plot | view alert)15,410.00 (+0.42%)15,393.89 (100.10%)
client_sv2_open_channel_serialize_deserializeInstructions (instructions)🚨 (view plot | view alert)8,030.00 (+0.53%)8,021.25 (100.11%)
client_sv2_open_channel_serialize_deserializeL1 Accesses (accesses)🚨 (view plot | view alert)11,683.00 (+0.54%)11,668.13 (100.13%)
client_sv2_setup_connection_serialize_deserializeInstructions (instructions)🚨 (view plot | view alert)14,858.00 (+0.29%)14,848.91 (100.06%)
client_sv2_setup_connection_serialize_deserializeL1 Accesses (accesses)🚨 (view plot | view alert)21,821.00 (+0.30%)21,805.40 (100.07%)

Click to view all benchmark results
BenchmarkEstimated CyclesEstimated Cycles Results
estimated cycles | (Δ%)
Estimated Cycles Upper Boundary
estimated cycles | (%)
InstructionsInstructions Results
instructions | (Δ%)
Instructions Upper Boundary
instructions | (%)
L1 AccessesL1 Accesses Results
accesses | (Δ%)
L1 Accesses Upper Boundary
accesses | (%)
L2 AccessesL2 Accesses Results
accesses | (Δ%)
L2 Accesses Upper Boundary
accesses | (%)
RAM AccessesRAM Accesses Results
accesses | (Δ%)
RAM Accesses Upper Boundary
accesses | (%)
client_sv2_handle_message_common✅ (view plot)2,076.00 (+1.07%)2,136.05 (97.19%)✅ (view plot)476.00 (+1.07%)486.24 (97.89%)✅ (view plot)736.00 (+0.51%)754.52 (97.55%)✅ (view plot)9.00 (+25.78%)11.09 (81.13%)✅ (view plot)37.00 (+0.70%)38.75 (95.48%)
client_sv2_handle_message_mining✅ (view plot)8,223.00 (+0.29%)8,334.38 (98.66%)✅ (view plot)2,143.00 (+0.68%)2,171.87 (98.67%)✅ (view plot)3,173.00 (+0.83%)3,217.54 (98.62%)✅ (view plot)30.00 (-20.69%)44.68 (67.15%)✅ (view plot)140.00 (+0.76%)142.03 (98.57%)
client_sv2_mining_message_submit_standard✅ (view plot)6,289.00 (+0.16%)6,391.31 (98.40%)✅ (view plot)1,759.00 (+0.50%)1,764.13 (99.71%)✅ (view plot)2,564.00 (+0.37%)2,576.23 (99.53%)✅ (view plot)17.00 (-2.76%)22.42 (75.81%)✅ (view plot)104.00 (+0.08%)106.97 (97.22%)
client_sv2_mining_message_submit_standard_serialize✅ (view plot)14,812.00 (+0.22%)15,030.97 (98.54%)✅ (view plot)4,703.00 (+0.19%)4,708.13 (99.89%)✅ (view plot)6,762.00 (+0.11%)6,775.28 (99.80%)✅ (view plot)49.00 (+3.31%)52.24 (93.79%)✅ (view plot)223.00 (+0.22%)229.83 (97.03%)
client_sv2_mining_message_submit_standard_serialize_deserialize✅ (view plot)27,590.00 (+0.37%)27,849.65 (99.07%)🚨 (view plot | view alert)10,594.00 (+0.45%)10,582.31 (100.11%)🚨 (view plot | view alert)15,410.00 (+0.42%)15,393.89 (100.10%)✅ (view plot)84.00 (+0.27%)89.21 (94.16%)✅ (view plot)336.00 (+0.31%)345.13 (97.36%)
client_sv2_open_channel✅ (view plot)4,276.00 (-4.46%)4,636.84 (92.22%)✅ (view plot)1,464.00 (+0.25%)1,474.17 (99.31%)✅ (view plot)2,166.00 (+0.58%)2,174.14 (99.63%)✅ (view plot)9.00 (-23.24%)15.32 (58.75%)✅ (view plot)59.00 (-8.77%)68.99 (85.52%)
client_sv2_open_channel_serialize✅ (view plot)14,027.00 (-1.24%)14,458.36 (97.02%)✅ (view plot)5,067.00 (+0.07%)5,077.17 (99.80%)✅ (view plot)7,327.00 (+0.12%)7,339.61 (99.83%)✅ (view plot)38.00 (+1.99%)41.85 (90.79%)✅ (view plot)186.00 (-2.81%)198.83 (93.55%)
client_sv2_open_channel_serialize_deserialize✅ (view plot)22,588.00 (-0.22%)23,008.02 (98.17%)🚨 (view plot | view alert)8,030.00 (+0.53%)8,021.25 (100.11%)🚨 (view plot | view alert)11,683.00 (+0.54%)11,668.13 (100.13%)✅ (view plot)74.00 (+0.87%)81.60 (90.68%)✅ (view plot)301.00 (-1.08%)314.53 (95.70%)
client_sv2_setup_connection✅ (view plot)4,650.00 (-0.99%)4,763.49 (97.62%)✅ (view plot)1,505.00 (+0.24%)1,515.17 (99.33%)✅ (view plot)2,280.00 (+0.14%)2,298.99 (99.17%)✅ (view plot)12.00 (+28.65%)13.97 (85.91%)✅ (view plot)66.00 (-2.64%)69.66 (94.75%)
client_sv2_setup_connection_serialize✅ (view plot)16,111.00 (-0.88%)16,486.04 (97.73%)✅ (view plot)5,966.00 (+0.06%)5,976.17 (99.83%)✅ (view plot)8,661.00 (+0.06%)8,677.23 (99.81%)✅ (view plot)48.00 (+6.95%)49.42 (97.14%)✅ (view plot)206.00 (-2.23%)217.44 (94.74%)
client_sv2_setup_connection_serialize_deserialize✅ (view plot)35,571.00 (+0.09%)35,746.48 (99.51%)🚨 (view plot | view alert)14,858.00 (+0.29%)14,848.91 (100.06%)🚨 (view plot | view alert)21,821.00 (+0.30%)21,805.40 (100.07%)✅ (view plot)97.00 (-2.41%)112.08 (86.55%)✅ (view plot)379.00 (-0.15%)384.43 (98.59%)

Bencher - Continuous Benchmarking
View Public Perf Page
Docs | Repo | Chat | Help

@plebhash plebhash changed the title use rust 1.75.0 and cargo-semver-checks 0.33.0 on semver CI use rust 1.75.0 and cargo-semver-checks 0.33.0 on semver CI Aug 17, 2024
@plebhash plebhash force-pushed the msrv-cargo-semver-check branch 2 times, most recently from 64cce6c to 1914aa1 Compare August 17, 2024 13:53
@Fi3
Copy link
Collaborator

Fi3 commented Aug 17, 2024

we should use cargo semver latest whith whatever rustc version is needed. This do not means that our MSRV is changed. For example for cargo fmt we use nightly but it do not affect our MSRV

@plebhash
Copy link
Collaborator Author

plebhash commented Aug 18, 2024

we should use cargo semver latest whith whatever rustc version is needed

that was the goal of #1104

I'm confused now. What was the objection to #1104 on this comment? #1104 (comment)

@plebhash plebhash force-pushed the msrv-cargo-semver-check branch from 1914aa1 to ba86a13 Compare August 18, 2024 20:13
@Fi3
Copy link
Collaborator

Fi3 commented Aug 19, 2024

If we need to use rustc 1.77 for semver check we should use it (like we use nightly for cargo fmt) without changing MSRV.
One thing is the rustc version that we use to do the release the checks ecc ecc. Another completely different thing is MSRV, MSRV is the min rustc version that a crate that import our libs MUST have. If you import a crate from protocols you don't need 1.77 1.75 is ok, we don't use feature added after 1.75 in the code. Semver check use feature added after 1.75, but if want to use our libraries you don't need to run semver check.

@plebhash plebhash closed this Aug 19, 2024
@plebhash plebhash deleted the msrv-cargo-semver-check branch August 19, 2024 12:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants