Crawler using ad hoc Selenium for dynamically-loaded websites. Crawls category lists drop-downs and URLs (can by DIY).
javascript python crawler spider selenium web-scraping data-extraction selenium-webdriver chrome-headless dynamic-content dynamic-components
-
Updated
Apr 11, 2024 - Python