Environment, Architecture

Language: Python3.6

Environment: MacOS,PyCharm

Database: MongoDB

Framework :Scrapy

Instructions for use

Pre-boot configuration

• Install MongoDB and start without configuration
• Install Scrapy
• Install Python dependent modules：pymongo, json,re
• Modify the configuration by needed etc.

Start up

$sudo mongod
$cd meituan_spider
$scrapy crawl meituan