Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[Docs] Update docs to reflect behaviour with Kafka 2.x #20

Closed
robbavey opened this issue Mar 13, 2020 · 0 comments · Fixed by #99
Closed

[Docs] Update docs to reflect behaviour with Kafka 2.x #20

robbavey opened this issue Mar 13, 2020 · 0 comments · Fixed by #99

Comments

@robbavey
Copy link
Contributor

Currently, in the docs we advise that The value of the configuration request_timeout_ms must always be larger than max_poll_interval_ms.

According to this stack overflow article, it looks like this advice is no longer accurate when dealing with Kafka 2.0+

I believe the advice originally came from the 10.1.0 upgrade notes:

The new Java Consumer now supports heartbeating from a background thread. There is a new configuration max.poll.interval.ms which controls the maximum time between poll invocations before the consumer will proactively leave the group (5 minutes by default). **The value of the configuration request.timeout.ms must always be larger than max.poll.interval.ms** because this is the maximum time that a JoinGroup request can block on the server while the consumer is rebalancing, so we have changed its default value to just above 5 minutes. Finally, the default value of session.timeout.ms has been adjusted down to 10 seconds, and the default value of max.poll.records has been changed to 500.

But that now appears to be outdated as of the 2.0.0 upgrade notes:

Also as part of KIP-266, the default value of request.timeout.ms has been changed to 30 seconds. The previous value was a little higher than 5 minutes to account for maximum time that a rebalance would take. Now we treat the JoinGroup request in the rebalance as a special case and use a value derived from max.poll.interval.ms for the request timeout. All other request types use the timeout defined by request.timeout.ms
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging a pull request may close this issue.

1 participant