Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

kafka-python v1.4.5 drastically impacts consumer performance. #30

Closed
jutley opened this issue Aug 22, 2019 · 3 comments
Closed

kafka-python v1.4.5 drastically impacts consumer performance. #30

jutley opened this issue Aug 22, 2019 · 3 comments
Labels
Milestone

Comments

@jutley
Copy link
Contributor

jutley commented Aug 22, 2019

I made an issue over in the kafka-python project about new versions causing the consumer to perform with only an eighth of the throughput. You can see the here:
dpkp/kafka-python#1888

In our case, this is a big issue as the the latest versions of this project can no longer keep up with our __consumer_offsets topic in some clusters.

I think that this project should explicitly depend on kafka-python v1.4.4 until this is fixed.

@braedon braedon added this to the patch-0.5.3 milestone Aug 23, 2019
@braedon braedon removed this from the patch-0.5.3 milestone Sep 5, 2019
@braedon
Copy link
Owner

braedon commented Sep 5, 2019

Decided in #31 not to hold back kafka-python for now, since the performance decrease in 1.4.5+ isn't expected to be problematic for most users.

Leaving this issue open until dpkp/kafka-python#1888 is resolved.

If you're affected by this issue, please weigh in!

@jutley
Copy link
Contributor Author

jutley commented Oct 2, 2019

@braedon kafka-python 1.4.7 should be in a good state. Can we cut a new release of this project to update the dependency?

@braedon
Copy link
Owner

braedon commented Oct 4, 2019

I've released 0.5.4 with exclusions for kafka-python 1.4.5 and 1.4.6. The 0.5.4 docker tag has been built using kafka-python 1.4.7.

@braedon braedon closed this as completed Oct 4, 2019
@braedon braedon added this to the patch-0.5.4 milestone Oct 4, 2019
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
Projects
None yet
Development

Successfully merging a pull request may close this issue.

2 participants