Python scraper based on AI

Fast, local-first web content extraction for LLMs. Scrape, crawl, extract structured data — all from Rust. CLI, REST API, and MCP server.

Fast, lightweight Firecrawl/Tavily alternative in Rust. Web scraper, crawler & search API with MCP server for AI agents. Drop-in Firecrawl-compatible API (/scrape, /crawl, /search). 2.3x faster than Tavily, 1.5x faster than Firecrawl in 1K-URL benchmarks. 6 MB RAM, single binary. Self-host or use managed cloud.

High-performance web crawler API optimized for LLMs. Turn any search or website into clean Markdown using remote browsers. Firecrawl alternative

Open‑source alternative to Perplexity Comet, director.ai and firecrawl combined

AI-native web scraper. Single binary with a bundled Claude Code skill. MIT-licensed alternative to Firecrawl.

🕷️ A lightweight Model Context Protocol (MCP) server that exposes Crawl4AI web scraping and crawling capabilities as tools for AI agents. Similar to Firecrawl's API but self-hosted and free. Perfect for integrating web scraping into your AI workflows with OpenAI Agents SDK, Cursor, Claude Code, and other MCP-compatible tools.

Firecrawl Skill: Scrape, Search, Crawl, Browse. Token-efficient scraping skill, optimized for Claude Code, Codex, Gemini.

AnyCrawl — Coolify v4 Template

LLM-friendly web crawler & scraper with a dedicated Reddit engine, built on Crawl4AI — Open WebUI compatible

Self-hosted web scraping and Markdown extraction for AI agents

🔍 Control browsers using natural language commands with multi-AI model support for seamless automation and task management.

Self-hosted web scraper — convert any URL to agent-friendly markdown/JSON. Anti-bot bypass + autonomous browser agents. Free alternative to Firecrawl.

Open-source web retrieval & research agent built for AI agents. Works with LangChain, LlamaIndex, CrewAI, OpenAI, MCP, and any REST agent. Supports scrape, search, crawl, map, extract, and research.

Massive autonomous web research for AI coding agents. ⭐ Free Firecrawl alternative. No API keys. Open source. Sponsor ❤️

Transform Web Content into LLM-Ready Data

🕸️ Web Scraping Intelligence — Multi-agent web scraping framework. Firecrawl-equivalent. Zero API keys, zero setup.

Self-hosted Firecrawl alternative. Scrape, crawl, extract with multi-LLM (Claude/GPT/Ollama), schedule, diff. One docker compose up.

Universal free OSS web-scraping cascade — 9-tier replacement for Firecrawl/WebFetch with site-specific APIs, archive proxies, OCR, headless Playwright, and logged-in browser fallback. MIT.

🔥 The Web Scraping API That Doesn't Rip You Off — Turn any website into LLM-ready markdown. 10x cheaper than Firecrawl.