- Scrapling by D4Vinci, 103k stars. Python scraping framework covering single requests through full crawls
- crawl4ai by unclecode, 87k stars. Apache-2.0 web crawler that outputs markdown for LLM pipelines
- obscura by h4ckf0r0day, 35k stars. Headless browser built for AI agents and scraping with CDP support
- CloakBrowser by CloakHQ, 33k stars. Chromium build with fingerprint patches that works as a Playwright drop-in
- Scrapegraph-ai by ScrapeGraphAI, 33k stars. Python library that uses an LLM to extract data from web pages
- crawlee by apify, 26k stars. Node.js library for building reliable web crawlers and browser automation
- maxun by getmaxun, 18k stars. No-code tool that turns web pages into structured data feeds and APIs
- SurfSense by MODSetter, 17k stars. Private NotebookLM alternative: an agent that researches and edits documents
- browserless by browserless, 14k stars. Runs headless Chrome and Firefox in Docker for automation and scraping
- pinchtab by pinchtab, 11k stars. Browser automation bridge that runs multiple Chrome instances with a dashboard
- google-maps-scraper by gosom, 8.1k stars. Scraper that pulls place details, ratings and reviews from Google Maps
- cli by brightdata, 6.2k stars. Terminal CLI for scraping, searching, and extracting structured web data
- pipet by bjesus, 4.8k stars. Command line tool for scraping and pulling data out of web pages
- AnyCrawl by any4ai, 3.5k stars. Node.js crawler that turns sites and search results into structured data
- open-agent-builder by firecrawl, 2.7k stars. Drag-and-drop canvas for building agents and web scraping pipelines
- invisible_playwright by feder-cr, 2.6k stars. Python Playwright API on a stealth Firefox build that evades bot detection
- google-maps-scraper-kit by Mahanaicoach, 2.5k stars. Python scraper that exports Google Maps business listings and contact links to CSV
- JustHireMe by vasu-devs, 2.3k stars. Local-first tool that scrapes job listings, ranks fit and drafts applications
- ff-ruyijs by cutetailbud, 1.2k stars. Runs site JavaScript from Python on a real Firefox engine for automation
- invisible_playwright_mcp by feder-cr, 865 stars. MCP server that gives agents a stealth Firefox browser through Playwright
- Krawl by BlessedRebuS, 841 stars. Honeypot web server that serves fake pages with planted vulnerabilities to crawlers
- fortress by tiliondev, 802 stars. Stealth Chromium build that avoids bot detection for Playwright and Puppeteer
- figranium by figranium, 786 stars. Visual block editor for browser automation flows, runnable through an API
- video-scraping-apis by cporter202, 767 stars. Collection of APIs for pulling video metadata and engagement stats across platforms
- oc by only-cli, 695 stars. Wraps a website as a compact CLI so agents can browse with few tokens
- goscrapy by tech-engine, 373 stars. Scraping framework in Go modeled on Python's Scrapy spider design
- PyScrappy by mldsveda, 265 stars. Python web scraping toolkit with self-healing selectors and an MCP server
- crawlie by spronta, 127 stars. Fast open source technical SEO and GEO crawler with an MCP interface
- jevcrawl by RayenMlayeh, 89 stars. MCP server and CLI that fetches the page answering a question for agents
- selector-forge by Intuned, 71 stars. Browser extension that generates CSS and XPath selectors with AI assistance
New repos every two days, stars refreshed daily. Visits are counted without cookies, and the numbers are public. How it works Data RSS Newsletter