Skip to content

My multi-threaded, multi-processed, breadth-first-search web crawler implemented in Python, developed to automate mundane tasks while working as an Assistant System Administrator in OU's Dept. of Physics & Astronomy. Supports website-wide expression matching, broken-link detection, and accessibility review

Notifications You must be signed in to change notification settings

clay-curry/Crawler

Repository files navigation

Crawler

No instructions; just the following advice:

EXPECT BUGS

About

My multi-threaded, multi-processed, breadth-first-search web crawler implemented in Python, developed to automate mundane tasks while working as an Assistant System Administrator in OU's Dept. of Physics & Astronomy. Supports website-wide expression matching, broken-link detection, and accessibility review

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages