Crawler A naive web crawler written in C. To compile and use it, make sure libglib2.0-dev is installed. Notice No caching, file whose size greater than 500k is truncated.