kafka-streaming

Here are 26 public repositories matching this topic...

microsoft / Mobius

C# and F# language binding and extensions to Apache Spark

streaming spark apache-spark csharp fsharp bigdata dataset spark-streaming eventhubs mapreduce dataframe rdd dstream mobius kafka-streaming near-real-time

Updated Jan 31, 2024
C#

kishlayjeet / Stock-Market-Real-Time-Data-Pipeline-with-Apache-Kafka-and-Cassandra

Star

A end-to-end real-time stock market data pipeline with Python, AWS EC2, Apache Kafka, and Cassandra Data is processed on AWS EC2 with Apache Kafka and stored in a local Cassandra database.

Updated Jun 7, 2023
Python

Thomas-George-T / Kafka-Tweet-Stream

Star

Stream real time Tweets of current affairs like covid-19 using Kafka 2.0.0 high throughput producer & consumer into Elasticsearch using safe, idempotent and compression configurations. Aggregate the data and use it for further analytics.

elasticsearch twitter kafka twitter-api zookeeper twitter-streaming-api kafka-consumer kafka-producer bonsai kafka-streaming coronavirus coronavirus-real-time covid-19 coronavirus-dataset kafka-twitter-streaming kafka-console-consumer throughput-producer kafka-servers twitterproducer

Updated Sep 6, 2023
Java

IBM / ibm-streams-with-kafka

Star

Build a Kafka streaming app using IBM Streams

kafka jupyter-notebook python3 stream-processing apache-kafka kafka-streaming ibm-streams ibm-cloud ibm-cloud-pak streams-flows

Updated Mar 10, 2021
Jupyter Notebook

felipegutierrez / explore-kafka

Star

This project implements an end-to-end pipeline for batch to stream processing using Kafka on Docker images. Besides that, there are exercises for a full course in Kafka.

java kafka mockito jacoco kafka-schema-registry kafka-streaming kafka-cluster kafka-connectors

Updated Apr 30, 2021
Java

chandnii7 / Big-Data-Processing-Pipeline

Star

A pipeline that consumes twitter data to extract meaningful insights about a variety of topics using the following technologies: twitter API, Kafka, MongoDB, and Tableau.

kafka big-data mongodb twitter-api data-visualization zookeeper data-analytics kafka-consumer kafka-producer tableau nosql-database kafka-streaming big-data-processing data-processing-pipelines

Updated Aug 2, 2021
Python

pedrodeoliveira / kafka-streaming-tests

Star

Kafka streaming performance tests.

python java k8s faust kafka-streams kafka-streaming cloudbuild goka

Updated Sep 25, 2020
Python

gerardodavidlopezcastillo / GrafanaStepFunctionsSNS_Public

Star

Data streaming project with Apache Druid & Grafana: Real-time data processing, alerts, integration with AWS. It uses a combination of technologies and services, including Confluent-Kafka, Apache Druid, AWS SNS, EC2, Athena, S3, Glue and EventBridge, StepFunctions. Contribute to this powerful solution!

aws-s3 grafana aws-ec2 aws-sns kafka-streaming aws-athena aws-step-functions aws-glue wsl-ubuntu apache-druid aws-eventbridge

Updated Oct 10, 2023
Jupyter Notebook

mallory-jpg / kafka-fraud

Star

Streaming fraud detection system

python kafka kafka-streaming

Updated Nov 18, 2021
Python

tashi-2004 / FMA-A-Dataset-For-Music-Analysis

Star

Scripts for music feature analysis, model training, and real-time recommendation using Apache Kafka. Extract features, store them in MongoDB, and process the data with Apache Spark. A web interface is also included.