Gather data from a variety of sources and in a variety of formats, assess its quality and tidiness, then clean it. Showcase your wrangling efforts through analyses and visualizations.
Real-world data rarely comes clean. Using Python and its libraries, you will gather data from a variety of sources and in a variety of formats, assess its quality and tidiness, then clean it. This is called data wrangling. You will document your wrangling efforts in a Jupyter Notebook, plus showcase them through analyses and visualizations using Python (and its libraries) and/or SQL.
The dataset that you will be wrangling (and analyzing and visualizing) is the tweet archive of Twitter user @dog_rates , also known as WeRateDogs. WeRateDogs is a Twitter account that rates people's dogs with a humorous comment about the dog. These ratings almost always have a denominator of 10. The numerators, though? Almost always greater than 10. 11/10, 12/10, 13/10, etc. Why? Because "they're good dogs Brent." WeRateDogs has over 4 million followers and has received international media coverage.
WeRateDogs downloaded their Twitter archive and sent it to Udacity via email exclusively for you to use in this project. This archive contains basic tweet data (tweet ID, timestamp, text, etc.) for all 5000+ of their tweets as they stood on August 1, 2017. More on this soon.
We notcied that the most used platform for tweets is Iphone and there is an explanation for this: @WeRateDogs account is located in United States of America and the first audience of accounts are the most closest community. We can say that the account has been followed by many americans first before expanding to other countries. The Apple, Inc company has conquered the local market, means that most americans users have an Iphone.
Most the dogs are rated 12. Looks like There are good dogs
more than we can ever imagine. Even though there are rating notes under 10, we can argue that our wrangling efforts have not been made without errors because "the rating numerators are greater than the denominators does not need to be cleaned. This unique rating system is a big part of the popularity of WeRateDogs." So it can be considered as error every rating numerator under 10. Hopefully, these errors aren't many and we could process our analysis without big troubles.
We noticed in our analysing effortsthat there is a high correlation between retweet_count
and favorite_count
over 0.90
. This means that the more an tweet is retweeted, the more it can get liked as favorite
because when someone retweet, it makes the tweet available for his audience and most of his audience like it and retweet it again and aigain and so on.