[Storage][Sharding] Sharded state kv pruner.

[grao1991]

Description

Test Plan

Working in progress.

[github-actions]

✅ Forge suite compat success on aptos-node-v1.4.4 ==> 70e67769b022b83f013ceff16ce72a158c406d97

Compatibility test results for aptos-node-v1.4.4 ==> 70e67769b022b83f013ceff16ce72a158c406d97 (PR)
1. Check liveness of validators at old version: aptos-node-v1.4.4
compatibility::simple-validator-upgrade::liveness-check : committed: 7067 txn/s, latency: 4732 ms, (p50: 4700 ms, p90: 7000 ms, p99: 7900 ms), latency samples: 240280
2. Upgrading first Validator to new version: 70e67769b022b83f013ceff16ce72a158c406d97
compatibility::simple-validator-upgrade::single-validator-upgrade : committed: 4182 txn/s, latency: 7557 ms, (p50: 8600 ms, p90: 9600 ms, p99: 10100 ms), latency samples: 163120
3. Upgrading rest of first batch to new version: 70e67769b022b83f013ceff16ce72a158c406d97
compatibility::simple-validator-upgrade::half-validator-upgrade : committed: 4569 txn/s, latency: 7026 ms, (p50: 8000 ms, p90: 8600 ms, p99: 9000 ms), latency samples: 169080
4. upgrading second batch to new version: 70e67769b022b83f013ceff16ce72a158c406d97
compatibility::simple-validator-upgrade::rest-validator-upgrade : committed: 6506 txn/s, latency: 5108 ms, (p50: 5200 ms, p90: 7000 ms, p99: 9100 ms), latency samples: 227740
5. check swarm health
Compatibility test for aptos-node-v1.4.4 ==> 70e67769b022b83f013ceff16ce72a158c406d97 passed
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions]

✅ Forge suite land_blocking success on 70e67769b022b83f013ceff16ce72a158c406d97

performance benchmark : committed: 5726 txn/s, submitted: 5727 txn/s, latency: 6924 ms, (p50: 5400 ms, p90: 10200 ms, p99: 27400 ms), latency samples: 2445158
Max round gap was 3 [limit 4] at version 2747706. Max no progress secs was 6.499156 [limit 10] at version 2747706.
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking

[github-actions]

✅ Forge suite framework_upgrade success on aptos-node-v1.4.4 ==> 70e67769b022b83f013ceff16ce72a158c406d97

Compatibility test results for aptos-node-v1.4.4 ==> 70e67769b022b83f013ceff16ce72a158c406d97 (PR)
Upgrade the nodes to version: 70e67769b022b83f013ceff16ce72a158c406d97
framework_upgrade::framework-upgrade::full-framework-upgrade : committed: 4933 txn/s, latency: 6465 ms, (p50: 6300 ms, p90: 9100 ms, p99: 17200 ms), latency samples: 187460
5. check swarm health
Compatibility test for aptos-node-v1.4.4 ==> 70e67769b022b83f013ceff16ce72a158c406d97 passed
Test Ok

• Grafana dashboard
• Humio Logs
• Test runner output
• Test run is land-blocking