Skip to content
This repository has been archived by the owner on Mar 28, 2020. It is now read-only.

tuning the liveness check time of etcd pod #2108

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

armstrongli
Copy link

@armstrongli armstrongli commented Aug 5, 2019

liveness probe needs to take care of the following steps' time:

  • time to transmit a 4GB snapshot from leader to member -- 4000MB / 50MB/s = 80s
  • time to load snapshot —— 4000MB / 200MB/s = 20s
  • time to set up streams and follow up leader revisions -- 100s * 10 heartbeat/s * 1KB/heartbeat / 1024KB/MB / 50MB/s ~= 20s

total time -- 120s

Fix: #2109

Please read https://github.com/coreos/etcd-operator/blob/master/CONTRIBUTING.md#contribution-flow

liveness probe needs to take care of the following steps' time:
* time to transmit a 4GB snapshot from leader to member -- 4000MB / 50MB/s = 80s
* time to load snapshot —— 4000MB / 200MB/s = 20s
* time to set up streams and follow up leader revisions -- 100s * 10 heartbeat/s * 1KB/heartbeat / 1024KB/MB / 50MB/s ~= 20s

total time -- 120s
@andyliuliming
Copy link

Hi @armstrongli FYI, I also did something for this.
in this PR:
#2124
the liveness/readiness probe are exposed as some configs.

# for free to subscribe to this conversation on GitHub. Already have an account? #.
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

etcd member cannot start up because of liveness check failures
2 participants