Create transaction_simulation_enhancement.yaml

[junkil-park]

No description provided.

[trunk-io]

⏱️ 3h 42m total CI duration on this PR

Job	Cumulative Duration	Recent Runs
rust-unit-tests	30m	🟥
forge-framework-upgrade-test / forge	26m	🟥
execution-performance / single-node-performance	25m	🟥
forge-compat-test / forge	23m	🟩
rust-unit-tests	21m	🟩
rust-unit-tests	20m	🟩
forge-e2e-test / forge	15m	🟩
rust-move-tests	9m	🟩
rust-move-tests	9m	🟩
rust-move-tests	8m	🟩
rust-cargo-deny	5m	🟩 🟩 🟩
general-lints	5m	🟩 🟩 🟩
test-target-determinator	5m	🟩
rust-doc-tests	4m	🟩
execution-performance / test-target-determinator	4m	🟩
check-dynamic-deps	4m	🟩 🟩 🟩
check	4m	🟩
semgrep/ci	1m	🟩 🟩 🟩
file_change_determinator	35s	🟩 🟩 🟩
file_change_determinator	30s	🟩 🟩 🟩
file_change_determinator	18s	🟩
permission-check	13s	🟩 🟩 🟩
permission-check	8s	🟩 🟩 🟩
permission-check	7s	🟩 🟩 🟩
permission-check	7s	🟩 🟩 🟩
permission-check	4s	🟩
determine-docker-build-metadata	4s	🟩

🚨 3 jobs on the last run were significantly faster/slower than expected

Job	Duration	vs 7d avg	Delta
forge-framework-upgrade-test / forge	26m	12m
forge-compat-test / forge	23m	15m
execution-performance / single-node-performance	25m	17m

_{settings ⋅ feedback ⋅ docs ⋅ learn more about trunk.io}

[github-actions]

✅ Forge suite realistic_env_max_load success on bcf786e2e43cb425ecee58ce86097747f563e72f

two traffics test: inner traffic : committed: 11656.66 txn/s, latency: 3407.37 ms, (p50: 3300 ms, p90: 3900 ms, p99: 6600 ms), latency samples: 4432120
two traffics test : committed: 100.06 txn/s, latency: 2871.53 ms, (p50: 2500 ms, p90: 3100 ms, p99: 10100 ms), latency samples: 1880
Latency breakdown for phase 0: ["QsBatchToPos: max: 0.242, avg: 0.218", "QsPosToProposal: max: 0.653, avg: 0.487", "ConsensusProposalToOrdered: max: 0.336, avg: 0.324", "ConsensusOrderedToCommit: max: 0.621, avg: 0.584", "ConsensusProposalToCommit: max: 0.948, avg: 0.908"]
Max non-epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 0.77s no progress at version 2153293 (avg 0.24s) [limit 15].
Max epoch-change gap was: 0 rounds at version 0 (avg 0.00) [limit 4], 7.16s no progress at version 2153291 (avg 7.16s) [limit 15].
Test Ok

• Grafana dashboard
• Humio Logs
• Axiom Logs
• Validator CPU Profile
• Fullnode CPU Profile
• Test runner output
• Test run is land-blocking

[github-actions]

✅ Forge suite compat success on d1bf834728a0cf166d993f4728dfca54f3086fb0 ==> bcf786e2e43cb425ecee58ce86097747f563e72f

Compatibility test results for d1bf834728a0cf166d993f4728dfca54f3086fb0 ==> bcf786e2e43cb425ecee58ce86097747f563e72f (PR)
1. Check liveness of validators at old version: d1bf834728a0cf166d993f4728dfca54f3086fb0
compatibility::simple-validator-upgrade::liveness-check : committed: 10855.67 txn/s, latency: 2991.28 ms, (p50: 2100 ms, p90: 6800 ms, p99: 18000 ms), latency samples: 364480
2. Upgrading first Validator to new version: bcf786e2e43cb425ecee58ce86097747f563e72f
compatibility::simple-validator-upgrade::single-validator-upgrading : committed: 7326.41 txn/s, latency: 3899.54 ms, (p50: 4300 ms, p90: 4700 ms, p99: 4700 ms), latency samples: 141220
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 7115.73 txn/s, latency: 4393.93 ms, (p50: 4400 ms, p90: 7100 ms, p99: 7400 ms), latency samples: 236900
3. Upgrading rest of first batch to new version: bcf786e2e43cb425ecee58ce86097747f563e72f
compatibility::simple-validator-upgrade::half-validator-upgrading : committed: 6495.47 txn/s, latency: 4196.22 ms, (p50: 4700 ms, p90: 5600 ms, p99: 5700 ms), latency samples: 119320
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 6651.51 txn/s, latency: 4775.81 ms, (p50: 4800 ms, p90: 7200 ms, p99: 7400 ms), latency samples: 220720
4. upgrading second batch to new version: bcf786e2e43cb425ecee58ce86097747f563e72f
compatibility::simple-validator-upgrade::rest-validator-upgrading : committed: 9733.70 txn/s, latency: 2629.34 ms, (p50: 2400 ms, p90: 3900 ms, p99: 4800 ms), latency samples: 192940
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 9592.84 txn/s, latency: 3217.66 ms, (p50: 2600 ms, p90: 5700 ms, p99: 7000 ms), latency samples: 339140
5. check swarm health
Compatibility test for d1bf834728a0cf166d993f4728dfca54f3086fb0 ==> bcf786e2e43cb425ecee58ce86097747f563e72f passed
Test Ok

• Grafana dashboard
• Humio Logs
• Axiom Logs
• Validator CPU Profile
• Fullnode CPU Profile
• Test runner output
• Test run is land-blocking

[github-actions]

✅ Forge suite framework_upgrade success on d1bf834728a0cf166d993f4728dfca54f3086fb0 ==> bcf786e2e43cb425ecee58ce86097747f563e72f

Compatibility test results for d1bf834728a0cf166d993f4728dfca54f3086fb0 ==> bcf786e2e43cb425ecee58ce86097747f563e72f (PR)
Upgrade the nodes to version: bcf786e2e43cb425ecee58ce86097747f563e72f
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1279.06 txn/s, submitted: 1281.81 txn/s, failed submission: 2.75 txn/s, expired: 2.75 txn/s, latency: 2534.70 ms, (p50: 2300 ms, p90: 3900 ms, p99: 5500 ms), latency samples: 111740
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1289.58 txn/s, submitted: 1292.28 txn/s, failed submission: 2.70 txn/s, expired: 2.70 txn/s, latency: 2476.16 ms, (p50: 2100 ms, p90: 3900 ms, p99: 5700 ms), latency samples: 114540
5. check swarm health
Compatibility test for d1bf834728a0cf166d993f4728dfca54f3086fb0 ==> bcf786e2e43cb425ecee58ce86097747f563e72f passed
Upgrade the remaining nodes to version: bcf786e2e43cb425ecee58ce86097747f563e72f
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 1221.13 txn/s, submitted: 1222.70 txn/s, failed submission: 1.57 txn/s, expired: 1.57 txn/s, latency: 2540.08 ms, (p50: 2300 ms, p90: 4100 ms, p99: 5100 ms), latency samples: 108760
Test Ok

• Grafana dashboard
• Humio Logs
• Axiom Logs
• Validator CPU Profile
• Fullnode CPU Profile
• Test runner output
• Test run is land-blocking