Best Web Scraping MCP servers.

Scrape any e-shop and match products across shops without EAN. API & MCP for AI agents.

Read, crawl and act on websites, signed in as the user, and turn any site into an API.

Deterministic Zero-LLM Web Compiler, Scraper, Crawler, and Site Mapper for AI Agents.

Web data for agents. Extract web pages, crawl websites, discover URLs, and search the web.

Web scraping for agents: scrape, crawl, map, search and extract pages as clean markdown or JSON.

Crawls any documentation or SaaS site and compiles a standards-compliant /llms.txt manifest and J.

AI search readiness MCP: score a site for ChatGPT/Claude/Perplexity crawlers. 3 free/day.

Free AI visibility check: can AI crawlers read a site, and do ChatGPT, Gemini, Perplexity cite it?

Remote job boards, LinkedIn jobs, company ATS pages and Upwork jobs as tools. Runs on Apify.

Google Maps places with emails, phones and the tech stack of their websites. Runs on Apify.

Zillow homes and rentals, Zumper rentals and Craigslist housing listings as tools. Runs on Apify.

Reddit posts, comments, keyword search and historical archives as tools. Runs on Apify.

Instagram, TikTok, YouTube and Threads profiles, posts, comments and transcripts. Runs on Apify.

Live jobs from companies you name, 17 ATS, one schema; misses never charged.

Verification layer for the agentic web: a signed answer about any site before an agent acts.

Pay-per-call keyword research via Apify: autocomplete, volume, CPC, difficulty, ideas, Google Trends

Analyse robots.txt content and report whether a path may be crawled.

Self-hosted SEO crawler: run site audits and AI crawler checks, then read the issues and pages.

Fetch web/social data, screenshots, scrape/extract content, generate images, audit SEO & links.

Video transcripts, metadata and structured data from YouTube, TikTok, Instagram, X; web scraping.