Best Web Scraping MCP servers.

Pay-per-call agent superpowers: media/video gen, product demos, research, GTM, scraping, compute.

Technical SEO + GEO (AI-search) site audits: hosted crawls, prioritized fixes, report diffs.

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Scrape customer comments and reviews from Reddit, YouTube, Amazon, TikTok, and 25+ platforms.

Robots-aware website audits, pre-crawl quotes, and structured evidence for people and agents.

Turn any website or API into structured JSON with LLM-authored declarative scraping configs.

AI-native web scraper: scrape, crawl and map any site to clean markdown over stdio. MIT-licensed.

Real BTC full node: fees, mempool, txs, portfolio, trace, whales, SEC, scraping, Reddit via x402.

Made-to-order data for AI agents: company intel, B2B contacts, scraping. Pay per call via x402.

Trust-aware repository facts for agents: build, test, docs, license, and security, no scraping.

X/Twitter automation MCP: scrape, post, schedule, analyze, engage. No API key required.

Scrape, crawl, map & search the web. Open-source, self-hostable Rust crawler & search for AI agents.

Scrape, crawl, and map websites to Markdown or JSON via local CLI.

AI-agent marketplace: agent templates, web search & crawl, SEO audit, RO company data, city info.

SEO MCP server: crawl your site, find AI-visibility gaps, and ship the fix from your coding agent.

Scrape Twitter/X profiles, tweets, search. No API key. Structured JSON. x402 pay-per-call.

Resurrect expired domains: scrape Wayback, AI-rewrite, generate images, publish to WordPress.

Web scraper for agents: fetch any URL as clean markdown (headings, links). x402 for JS rendering.

Bulk-validates EU VAT numbers against the European Commission's official VIES service.

Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.