🕷some website spider application base on proxy pool (support http & websocket)
-
Updated
Dec 11, 2021 - Python
🕷some website spider application base on proxy pool (support http & websocket)
Scrapy-Django PostgreSQL integrated API with Proxy IP configuration that scrapes all medicine data (meds, prices, generics, companies, indications) from Bangladesh (30k+ pages)
Add a description, image, and links to the proxy-ip topic page so that developers can more easily learn about it.
To associate your repository with the proxy-ip topic, visit your repo's landing page and select "manage topics."