Web Crawler

Crawls a site and produces a sitemap of internal links

Usage

make build # Uses godep to install all dependencies to vendor/ ./bin/crawler https://monzo.com

Testing

make test

Author

Vik Bhatti github@vikbhatti.com