rainmana
Follow
Webscraping
List of libraries, tools and APIs for web scraping and data processing.
A Smart, Automatic, Fast and Lightweight Web Scraper for Python
Guide, reference and cheatsheet on web scraping using rvest, httr and Rselenium.
Web scrapping and related analytics using Python tools
A browser testing and web crawling library for PHP and Symfony
Custom Selenium Chromedriver | Zero-Config | Passes ALL bot mitigation systems (like Distil / Imperva/ Datadadome / CloudFlare IUAM)
Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, an…
🚀 Fast and simple Node.js version manager, built in Rust
artoo.js - the client-side scraping companion.
Websites crawler with built-in exploration and control web interface
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any sc…
🥫 The simple, fast, and modern web scraping library
Python & Command-line tool to gather text and metadata on the Web: Crawling, scraping, extraction, output as CSV, JSON, HTML, MD, TXT, XML
A suite of utilities for converting to and working with CSV, the king of tabular file formats.
Downloads videos and playlists from YouTube
Abstraction layer over YouTube's internal API
splinter - python test framework for web applications
Community maintained fork of pdfminer - we fathom PDF
Google Apps Script library - interprets Google Sheets Formats, converts to formatted text or html
Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
GraphQL automated security testing toolkit
🕸️ Blazing fast GraphQL endpoints finder using subdomain enumeration, scripts analysis and bruteforce. 🕸️