sandcrawler.js is a node library aiming at providing developers with concise but exhaustive tools to scrape the web.
Disclaimer: this library is an unreleased work in progress.
The library's full documentation is available on github pages.
Contributions are more than welcome. Feel free to submit any pull request as long as you added unit tests if relevant and passed them all.
To install the development environment, clone your fork and use the following commands:
# Install dependencies
npm install
# Testing
npm testsandcrawler.js is being developed by Guillaume Plique @ SciencesPo - médialab.
Logo by Daniele Guido.