This repository holds all the necassary components to run a Scrapy web crawler on the Sports Book Review website. The scraper is currently configured to write the documents to a JSON file called "items.jl".
The program can be run by running the following in the command line:
git clone https://github.com/a-i-sports/line_bot.git
cd line_bot
pip install -r requirements.txt
python release_spiders.py