Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[testing] Validate node bootstrap for mainnet and testnet #3077

Closed
marun opened this issue Jun 3, 2024 · 2 comments · Fixed by #3352
Closed

[testing] Validate node bootstrap for mainnet and testnet #3077

marun opened this issue Jun 3, 2024 · 2 comments · Fixed by #3352
Assignees
Labels
enhancement New feature or request testing This primarily focuses on testing

Comments

@marun
Copy link
Contributor

marun commented Jun 3, 2024

Enable testing of bootstrapping in full sync (non-archival) and state-sync configurations for both mainnet and testnet.

Notes

  • public github workers only support a maximum of < 30GB of disk which is insufficient for mainnet or testnet nodes
  • prefer kubernetes deployment to avoid having to deal with host provisioning (e.g. ec2)
    • suggest deploying one pod to run the test and the test pod can deploy the node as another pod
  • pruning is enabled by default ({"pruning-enabled": true})
  • state-sync is enabled by default for nodes with an empty db ({"state-sync-enbled": true})
@marun marun added the enhancement New feature or request label Jun 3, 2024
@marun marun self-assigned this Jun 3, 2024
@marun marun moved this to In Progress 🏗 in Platform Engineering Group Jun 3, 2024
@marun marun changed the title [testing] Enable bootstrap testing [testing] Validate node bootstrap for mainnet and testnet Jun 3, 2024
@marun marun added the testing This primarily focuses on testing label Jun 3, 2024
@marun marun moved this from In Progress 🏗 to Backlog 🗄️ in Platform Engineering Group Jul 10, 2024
@marun marun moved this from Backlog 🗄️ to In Progress 🏗 in Platform Engineering Group Jul 10, 2024
@marun
Copy link
Contributor Author

marun commented Jul 17, 2024

Status update:

  • state-sync testnet passed in ~18.5h without extra storage on a runner with 8 vcores / 16GB of ram
  • still waiting on full-sync testnet, a couple of initial attempts failed due to infra failure and timeout. The currently running job completing successfully depends on being able to complete within the 5 day limit for a job on a self-hosted runner and requiring < 200GB of storage
  • still waiting on a runner with a PVC with more than 200GB of storage, which precludes testing mainnet.
  • based on expected execution duration for a testnet full-sync bootstrap, it seems doubtful that a mainnet full-sync bootstrap can succeed within the 5 day limit and will require bespoke scheduling.

Copy link

This issue has become stale because it has been open 60 days with no activity. Adding the lifecycle/frozen label will cause this issue to ignore lifecycle events.

@marun marun linked a pull request Sep 23, 2024 that will close this issue
4 tasks
@github-project-automation github-project-automation bot moved this from In Progress 🏗 to Done ✅ in Platform Engineering Group Oct 1, 2024
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement New feature or request testing This primarily focuses on testing
Projects
Archived in project
Development

Successfully merging a pull request may close this issue.

1 participant