Apache Kafka

[benbjohnson]

Overview

Status: Proposal

Apache Kafka is a scalable, distributed publish-subscribe messaging system. It allows organizations to use it as an event bus and decouple systems from one another.

Sections

• Basics of Apache Kafka
• Replication
• Internals / Zookeeper interaction

[hauntedhost]

👍

[dannykansas]

+1 for this. Your raft explanation was magnificent. Thanks!

[benbjohnson]

Update: I finally started working on this. The Raft visualization was time intensive so I've been trying to find a way to make the format useful while also making it easier to code up. I'm working on getting D3.js visualizations embeddable inside medium.com so that I can do a better narrative around the visualization. Something sort of similar to Mike Bostock's algorithm visualization post:

http://bost.ocks.org/mike/algorithms/

I'll post the narrative for review once I get it written up. I'd love some feedback at that point before I really dig into the visualization side.

[ongardie]

Nice, looking forward to seeing what you come up with.

On Thu, Sep 18, 2014 at 2:02 PM, Ben Johnson notifications@github.com
wrote:

Update: I finally started working on this. The Raft visualization was
time intensive so I've been trying to find a way to make the format useful
while also making it easier to code up. I'm working on getting D3.js
visualizations embeddable inside medium.com so that I can do a better
narrative around the visualization. Something sort of similar to Mike
Bostock's algorithm visualization post:

http://bost.ocks.org/mike/algorithms/

I'll post the narrative for review once I get it written up. I'd love some
feedback at that point before I really dig into the visualization side.

—
Reply to this email directly or view it on GitHub
#4 (comment)
.

[hauntedhost]

Fantastic. Looking forward to it. Thanks for update.

[benbjohnson]

Really basic start to the Kafka post:

http://thesecretlivesofdata.com/kafka/basics/

Just some "intro to log processing" and a simple log visualization. I was going to post larger chunks but I figured that I'd get some feedback as I go. Feedback welcome!

[benbjohnson]

Also, my goal is to make the posts and visualizations accessible on mobile devices so feedback is welcome there too.

[benbjohnson]

/cc @otoolep

[otoolep]

Thanks for including me on this. Good to see it getting going. Nice introductory visual.

I would say that it makes more than just a software developer's job easier -- in fact, it makes system designers' job easier. It's bigger than just developers IMHO.

[xo4n]

+1

[samebchase]

This would be wonderful!

[tobegit3hub]

Still working on it? Need any help?

[benbjohnson]

@tobegit3hub thanks but i'm moving TSLD over to a video format and it's been slow to learn all the video tools. i'll hopefully start getting some videos out soon. :fingers_crossed: :)

[tobegit3hub]

Great! Thanks for all your contribution @benbjohnson 👍

[wanghaisheng]

thx

[GreedyWang]

Thanks for all your contribution @benbjohnson 👍

[jicahoo]

@benbjohnson 👍 Very cool.

[ding102992]

@benbjohnson 👍Fantastic.Looking forward for years.

[wudyStudy]

Looking forward for years.

[yourNameIsGood]

Sounds really great and looking forward to it

[NargiT]

Wow just discover this! I Want MORE !

[bowenpz]

hey, is that still alive...?

[NargiT]

I don't think so 😢

[Hongten]

The Apache Kafka had been released 3.1.0 on 24 Jan 2022 which using the Kraft. Any update for this?

[zwGithubStation]

thx looking forward new subjects

[NargiT]

@zwGithubStation I am afraid this project is no more maintained 😢