Skip to content

This script shows how to scrape your tweets by date or year using the opensource project Twint and turn it into a beautiful HTML table. No API key is required..

Notifications You must be signed in to change notification settings

androiddevnotesyoutube/scrape-twitter-json-to-html-table

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Scrape Twitter JSON to HTML Table


This script shows how to scrape your tweets by date or year using the opensource project Twint and turn it into a beautiful HTML table. No API key is required..


Twint: https://github.com/twintproject/twint

json2html: https://github.com/softvar/json2html


Video Usage Instructions on Awesome Dev Notes YouTube: https://youtu.be/042-QIhC5ms


Twitter Badge androiddevnotes GitHub badge


twint awesomedevnotes - androiddevnotes youtube thumbnail


filter.py: To filter out the JSON nodes. You can modify the script to remove the JSON data that is not required or add the ones you need.

jsonhtml.py: To convert the JSON data to HTML table. You don't need to modify this script to work.


Installing Twint

Make sure you have python and pip installed.

pip3 install --user --upgrade git+https://github.com/twintproject/twint.git@origin/master#egg=twint

Run Twint

Parameters are explained in the video or go to wiki

twint -u androiddevnotes --since 2020-05-20 --until 2021-03-01 -o twint_androiddevnotes.json --json

The output will be JSON data.

Watch the Video to see how to turn the above scraped Twitter JSON data to HTML table.

The video shows the usage of filter.py and jsonhtml.py


💻 Find us on

About

This script shows how to scrape your tweets by date or year using the opensource project Twint and turn it into a beautiful HTML table. No API key is required..

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages