Skip to content

This application streams real time tweets by any topic(s) using Twitter Hosebird Client that is build on kafka.

Notifications You must be signed in to change notification settings

d-klotz/kafka-twitter-producer

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Twitter Kafka Producer

This application streams real time tweets by any topic(s) using Twitter Hosebird Client that is build on kafka.

🔌 Requirements

  • Java 8
  • Maven
  • Kafka

🔐 Initital Instructions

Clone this repository and install all dependencies.

# Install all dependencies using Maven
$ mvn install
  • Create a Twitter app and generate the necessary secret keys.
  • Include the generated keys in the Producer class.

💥 Run the Application

In order to send tweets to the producer we have to start Zookeeper and Kafka.

# Start Zookeeper
$ zookeeper-server-start.bat config\zookeeper.properties
# Start Kafka
$ kafka-server-start.bat config\server.properties
# Create a topic
$ kafka-topics.bat --zookeeper 127.0.01:2181 --create --topic <YOUT TOPIC HERE> -partitions 6 --replication-factor 1

Now you can start the application.


About

This application streams real time tweets by any topic(s) using Twitter Hosebird Client that is build on kafka.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages