README.md

Installation

1. Install Python 3.6 or up

2. Install python libraries [you could create a virtualenv if you want to]

    pip install -r requirements.txt
   

3. Download spacy en corpus

    python -m spacy download en
   

4. Install mongodb

5. Create database yelp with collections reviews and business

Import Yelp dataset and clean and create indices

1. Run mongoimport command to read json into your local mongo collections

    $ mongoimport -d yelp -c business <yelp_academic_dataset_business.json>
   
    $ mongoimport -d yelp -c reviews <path to yelp_academic_dataset_review.json>
    
    $ mongoimport -d yelp -c checkins <path to yelp_academic_dataset_checkin.json>
   

2. Delete business data which are not restaurants or canadian or closed

    var food_ids = []
    db.business.find(
        {
            '$or':[
                {'categories': {'$not': /.*Restaurants.*/}},
                {'state': {'$in': ['AB','BC','MB','NB','NL','NT','NS','NU','ON','PE','QC','SK','YT']}},
                {'is_open': 0}
            ]
        },
        {'business_id': 1}
    ).forEach(row => {
         food_ids.push(row['business_id'])
    })
   
    db.checkins.deleteMany({'business_id': {$in: food_ids}})
    db.reviews.deleteMany({'business_id': {$in: food_ids}})
    db.business.deleteMany({'business_id': {$in: food_ids}})
   

3. Create index

    db.business.createIndex({'business_id': 1})
    db.reviews.createIndex({'business_id': 1})
    db.checkins.createIndex({'business_id': 1})
   

4. Create dataset dictionary

5. Run the following command in the home directory to create the data dictionary python3 create_data_dict.py

Run app

1. Run the flask server and head to localhost:5000

    python run.py