Fully Managed Apache Kafka Cluster with Ansible & Terraform.

A real-time event pipeline around Kafka Ecosystem for Chicago Transit Authority.

A data streaming pipeline built with Apache Kafka and Faust to perform automatic word counting of scientific files dropped in AWS S3 bucket

Real-time data streaming project using Python, Pandas, and Confluent Kafka to publish and consume retail data through Kafka topics, demonstrating scalability and dynamic consumer behavior.

A data pipeline example using Kafka on Docker

CLI and Lambda functions to manage Kafka Topics, ACLs and Schemas in AWS CFN

crawl given link and create graph according to link and its adjacent that is in the same domain

Operations tasks for a Kafka cluster

The project's goal is to read data from sensors installed in heavy trucks and send it to Kafka. Apache Kafka is an application platform for distributed event storage and stream processing. Lastly, we are consuming data from Kafka to MongoDB

This repository is a demo how to process data streaming using Faust Library and Kafka.

3 node Kafka cluster and 3 node zookeeper cluster with a containerized consumer and producer in python