MCP CheckMCP servers for web scraping
Every web scraping server in the official MCP Registry, 250 in all, ranked by how closely it fits. 180 work without an API key and 2 come from the company itself. Each row shows the security checks, the secrets asked for and an install command.
web scraping MCP servers 250
Now showing are unlisted. These entries didn't pass our listing filter: no source repo, a very short or duplicated description, or a publisher with 100+ servers. Same automated checks, shown as-is. How we check
| Type | Secrets | Version | Actions | ||||
|---|---|---|---|---|---|---|---|
 ★ 7.7k io.github.firecrawl/firecrawl-mcp-server Official Firecrawl Firecrawl, the context API for AI agents: search, scrape, interact with the web, plus paper search. | 8/8All passed | 76health of 100 | npmLocal or hosted | 1secret asked | 3.36.0 | ||
★ 1.2k io.github.fastcrw/crw Open-source web scraper for AI agents with scrape, crawl, and map tools | 3/41 warning | 70health of 100 | DockerRuns locally | Noneno keys asked | 0.39.0 | ||
★ 1.2k io.github.us/crw Open-source web scraper for AI agents with scrape, crawl, and map tools | 3/41 warning | 74health of 100 | DockerRuns locally | Noneno keys asked | 0.36.0 | ||
★ 322 io.github.AliAkhtari78/spotifyscraper Public Spotify metadata, lyrics and podcasts for LLM agents. No API key, read-only. | 7/7All passed | 70health of 100 | PyPIRuns locally | 1secret asked | 3.9.2 | ||
★ 192 io.github.xberg-io/crawlberg Scrape, crawl, and map websites to Markdown or JSON via local CLI. | 4/4All passed | 71health of 100 | DockerRuns locally | Noneno keys asked | 1.12.3 | ||
★ 192 io.github.kreuzberg-dev/kreuzcrawl Scrape, crawl, and map websites to Markdown or JSON via local CLI. | 4/4All passed | 71health of 100 | DockerRuns locally | Noneno keys asked | 0.3.0 | ||
★ 182 io.github.DasDigitaleMomentum/searxncrawl Web search via SearXNG and/or You.com, plus clean Markdown crawling via Crawl4AI. Self-hosted. | 6/71 warning | 65health of 100 | PyPIRuns locally | 2secrets asked | 0.32.0 | ||
★ 170 io.github.scrapeless-ai/scrapeless-mcp-server Web search, browser automation, scraping, crawling and CAPTCHA solving for AI agents. | 8/8All passed | 65health of 100 | npmLocal or hosted | 1secret asked | 0.6.4 | ||
★ 145 xyz.crawlhive/crawlhive Memecoin safety scanner for Solana, BNB and Robinhood Chain with an onchain track record | 3/3All passed | 63health of 100 | RemoteHosted | Noneno keys asked | 1.0.0 | ||
★ 119 io.github.ScrapeGraphAI/scrapegraph-mcp AI-powered web scraping and data extraction capabilities through ScrapeGraph API | 7/7All passed | 53health of 100 | PyPIRuns locally | 1secret asked | 1.0.1 | ||
 ★ 115 app.crawlie/crawlie Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs. | 3/3All passed | 64health of 100 | RemoteHosted | Noneno keys asked | 0.1.0 | ||
★ 107 io.github.Sriram-PR/doc-scraper Crawl documentation sites into local corpora agents can search, read, and diff fully offline. | 3/41 warning | 49health of 100 | MCPBRuns locally | Noneno keys asked | 2.24.1 | ||
★ 75 io.github.maximilianfeix/proxy-scraper Free proxies that actually work: checked HTTP/SOCKS proxies, and pages fetched through them | 7/7All passed | 66health of 100 | PyPIRuns locally | Noneno keys asked | 1.31.0 | ||
 ★ 73 io.github.puneetindersingh/open-seo-crawler Self-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages. | 6/6All passed | 51health of 100 | MCPBRuns locally | Noneno keys asked | 1.0.0 | ||
★ 72 io.github.goesByhc/cn-scraper-mcp MCP server for AI agents to search major Chinese internet platforms with local-first login support. | 7/7All passed | 53health of 100 | PyPIRuns locally | Noneno keys asked | 0.4.1 | ||
★ 70 io.github.DevsHero/ShadowCrawl Rust MCP stealth scraper: anti-bot search/scrape with CDP fallback + HITL non-robot. | 2/2All passed | 54health of 100 | RemoteRuns locally | Noneno keys asked | 2.3.0 | ||
★ 70 io.github.DevsHero/shadow-crawl Stealth scraping & search. Bypasses Cloudflare, DataDome & LinkedIn via Cyborg HITL approach. | 3/3All passed | 54health of 100 | RemoteHosted | Noneno keys asked | 2.0.0-rc | ||
 ★ 45 io.github.webscraping-ai/webscraping-ai Web scraping tools with Chromium JS rendering, rotating proxies, and AI question answering. | 7/7All passed | 69health of 100 | npmRuns locally | 1secret asked | 1.0.7 | ||
★ 44 io.github.adityaarsharma/librecrawl-technical-seo-audit-mcp Self-hosted technical SEO audit MCP. 50+ checks, WAF detection, ephemeral. Built on LibreCrawl. | 2/2All passed | 57health of 100 | RemoteRuns locally | Noneno keys asked | 2.0.5 | ||
★ 32 com.mcparmory/firecrawl Scrape, crawl, and extract structured data from websites at scale | 7/7All passed | 51health of 100 | PyPIRuns locally | Noneno keys asked | 1.0.3 | ||
★ 32 com.mcparmory/scrapingant Scrape webpages, handle JavaScript and CAPTCHA, extract structured data | 7/7All passed | 51health of 100 | PyPIRuns locally | Noneno keys asked | 1.0.1 | ||
★ 22 io.github.SanggonBoy/PyreCrawl Web scraping + research toolkit for AI agents: scrape, crawl, monitor URLs with anti-bot bypass. | 7/7All passed | 62health of 100 | PyPIRuns locally | Noneno keys asked | 0.8.1 | ||
★ 19 io.github.IliasSami/scrawly MCP server for the Scrawly SEO crawler: query local audits and propose confirmation-gated fixes. | 6/71 warning | 51health of 100 | PyPIRuns locally | Noneno keys asked | 1.0.0 | ||
★ 15 io.github.Mingye-Lu/acrawl Autonomous web crawler. 17 browser tools + goal-driven run_goal agent. Single binary, stealth. | 5/61 warning | 52health of 100 | MCPBRuns locally | Noneno keys asked | 0.17.0 | ||
★ 15 io.github.nickjlamb/pubcrawl PubMed & Europe PMC literature search, US/UK drug labelling, and clinical trials for AI assistants. | 7/7All passed | 56health of 100 | npmRuns locally | 1secret asked | 2.6.4 | ||
★ 13 io.github.schemacrawler/schemacrawler-ai Enables natural language schema queries — explore tables, keys, procedures, and get SQL help fast | 4/4All passed | 53health of 100 | DockerRuns locally | 2secrets asked | v17.16.0-1 | ||
★ 11 io.github.eurafaeldecarvalho/browser-scraper Stealth Chrome for AI agents: bot-protected sites, Turnstile, closed Shadow DOM, clean Markdown. | 7/7All passed | 58health of 100 | npmRuns locally | Noneno keys asked | 0.8.3 | ||
| 3/3All passed | 42health of 100 | RemoteHosted | Noneno keys asked | 1.0.0 | |||
★ 10 com.hasdata/web-scraping Fetch any public web page through managed proxies, with optional JS rendering and extraction rules. | 8/8All passed | 62health of 100 | npmLocal or hosted | 1secret asked | 1.0.2 | ||
★ 8 app.crawlio/crawlio-browser Bridge a live Chrome browser to your agent: 150 tools for capture, extraction, and observation. | 7/7All passed | 57health of 100 | npmRuns locally | Noneno keys asked | 1.11.0 | ||
★ 7 io.github.alphaparkinc/genpark-bloom-filter-url-dedup-crawler-skill In-memory Bloom filter for URL and document hash deduplication preventing redundant web crawler inge | 3/41 warning | 52health of 100 | MCPBRuns locally | Noneno keys asked | 1.0.1 | ||
★ 7 io.github.pucilpet/crawlgraph-mcp Backlink lookups and competitor gap analysis on Common Crawl's open web graph (4.4B links). | 5/61 warning | 50health of 100 | MCPBRuns locally | 1secret asked | 0.2.2 | ||
★ 6 io.github.mysleekdesigns/crawlforge-mcp-server Web scraping, crawling, deep research & autonomous extraction — 31 MCP tools, clean Markdown/JSON | 6/82 warnings | 51health of 100 | npmRuns locally | 3secrets asked | 6.24.0 | ||
★ 6 com.superagnt/web-scraping Web scraping for AI agents: scrape, search, crawl, map any website to markdown + JSON. No browser. | 3/3All passed | 57health of 100 | RemoteHosted | Noneno keys asked | 0.1.0 | ||
★ 6 io.github.ofershap/scraper Web scraping MCP — extract clean markdown, links, and metadata from any URL. | 7/7All passed | 53health of 100 | npmRuns locally | Noneno keys asked | 1.0.1 | ||
★ 4 io.github.Perufitlife/multi-scraper-mcp 14 web scrapers as MCP tools: Reddit, Amazon, Google Maps, Yelp, YouTube, Indeed & more. | 7/7All passed | 45health of 100 | npmRuns locally | 1secret asked | 1.0.1 | ||
★ 4 io.github.outscraper/outscraper-mcp-server Outscraper MCP business discovery, Maps intelligence, enrichment, reviews, and contact data. | 8/8All passed | 53health of 100 | npmLocal or hosted | 1secret asked | 0.2.3 | ||
★ 3 io.github.crawlerpeek/crawlerpeek Check whether AI crawlers (GPTBot, ClaudeBot, PerplexityBot) can access a URL. Read-only. | 7/7All passed | 57health of 100 | npmRuns locally | Noneno keys asked | 0.2.0 | ||
★ 3 io.github.scrapeeverything/mcp Public data from Instagram, TikTok, X, YouTube, Facebook, Telegram, Spotify, Pinterest and Twitch. | 7/7All passed | 53health of 100 | npmRuns locally | 1secret asked | 0.1.0 | ||
★ 3 io.github.jsilets/twscrape-twitter-mcp Read-only X/Twitter MCP: posts, threads, replies, search via twscrape. No API key. | 7/7All passed | 58health of 100 | PyPIRuns locally | Noneno keys asked | 0.1.2 | ||
★ 2 com.scrapeunblocker/scrapeunblocker-mcp Fetch any web page's HTML or AI-parsed JSON, or run 100+ site plugins, via ScrapeUnblocker. | 7/7All passed | 57health of 100 | npmRuns locally | 1secret asked | 0.8.1 | ||
★ 2 io.github.77777R7/octocrawl Web pages as clean Markdown and JSON for AI agents, in fewer tokens, with an Evidence Record. | 8/8All passed | 53health of 100 | npmLocal or hosted | 1secret asked | 0.7.0 | ||
★ 2 io.github.scrape-badger/scrapebadger Twitter/X scraping for AI agents: profiles, tweets, followers, trends, lists and communities. | 7/7All passed | 51health of 100 | PyPIRuns locally | 1secret asked | 0.1.2 | ||
 ★ 2 io.github.waiky-github/CrawlEyes Web scraping & search for AI agents: extract, SearXNG search, rerank, robots compliance. No API key. | 7/7All passed | 58health of 100 | PyPIRuns locally | 1secret asked | 0.2.0 | ||
★ 2 io.github.yubinkim444/ai-first-scraper-mcp Three MCP tools: fetch_page, fetch_pages_batch, search_web. Ad-free Markdown for AI agents. | 7/7All passed | 51health of 100 | PyPIRuns locally | Noneno keys asked | 1.0.2 | ||
★ 2 io.github.manchittlab/thecrawler Universal web scraper with LLM-ready markdown, RAG chunking, PDF/DOCX support. | 7/7All passed | 45health of 100 | npmRuns locally | Noneno keys asked | 0.5.8 | ||
★ 2 io.github.carrasquelalex1/webscrape-mcp Fetch any URL and get clean Markdown. Web scraping for AI agents. | 3/3All passed | 40health of 100 | RemoteHosted | Noneno keys asked | 1.0.0 | ||
★ 2 io.github.hshintelligence/agent-scrape Pay-per-call web scraping for AI agents via x402 on Base USDC. Six tools, no signup. | 4/4All passed | 40health of 100 | RemoteHosted | Noneno keys asked | 0.6.1 | ||
★ 2 io.github.ChocoData-com/amazon-scraper-api-mcp Scrape Amazon products, search, and async batch ASIN lookups across 20 marketplaces | 7/7All passed | 56health of 100 | npmRuns locally | 1secret asked | 0.1.4 | ||
 ★ 1 io.github.nolindnaidoo/scrape-le Analyse robots.txt content and report whether a path may be crawled. | 7/7All passed | 63health of 100 | npmRuns locally | Noneno keys asked | 2.6.0 |
Showing 1 to 50 of 250. These are the most recently updated; search or pick a category for the rest.
web scraping MCP servers: common questions
What is the best MCP server for web scraping?
Start with the official one, Firecrawl MCP Server, since it comes from the company itself. Among community builds, the most-starred on GitHub are Firecrawl MCP Server (★ 7.7k), CRW Web Scraper (★ 1.2k) and CRW Web Scraper (★ 1.2k). If you want one that passed every check, Firecrawl MCP Server did.
Are web scraping MCP servers safe to install?
On registry checks, 228 of 250 come out clean. We also read the code or live tool list of 157 of them without running anything, and 11 raised a warning worth reading, such as an install script or text aimed at the AI. Treat a pass as "nothing found", and give any server the least access that works.
Is a Claude skill better than an MCP server for web scraping?
An MCP server gives the AI new tools, such as reaching web scraping itself. A skill only teaches it how to do a task with tools it already has. There are 368 Claude skills for web scraping if that fits better.
How fresh are these web scraping MCP servers?
136 of the 250 were updated in the 30 days before 31 Oct 2026. The latest was doc-scraper, on 28 October.
How do I add a web scraping MCP server to Claude?
To connect web scraping through Firecrawl MCP Server, run this in a terminal: claude mcp add --transport http firecrawl-mcp-server https://mcp.firecrawl.dev/v2/mcp. Pin the version shown before you rely on it.
Do I have to install a web scraping MCP server?
138 can run hosted, so you only paste a URL into Claude, Cursor or VS Code. The 137 that run locally ship as 86 npm, 30 PyPI, 9 Docker, 9 MCPB bundle and 1 NuGet packages.
More topics: every “MCP server for…” page. Prefer a skill? Claude skills for this (368).