CrawlForge
HomePlaygroundUse CasesIntegrationsPricingDocumentationBlog
27 Specialized MCP Tools Available

Turn Any Website Into Clean Data for AI Agents

One API for scraping, search, and extraction — 27 MCP-native tools that plug straight into Claude, Cursor, LangChain, or your own code. Get clean markdown or structured JSON from any URL in a single call.

1,000 free credits • No credit card required
<500ms average response time
27
Specialized Tools
1,000
Free Credits to Start
Open Source
MCP Server on npm & GitHub
Get Started in Minutes

How It Works

Three steps from zero to live web data in your AI agent.

Step 1

Install

Add the CrawlForge MCP server to your AI client with a single config entry.

Step 2

Configure

Set your API key and choose which tools to enable for your workflow.

Step 3

Scrape

Call any of 27 tools directly from your AI agent. Data flows back instantly.

Developer Experience

Simple to Integrate, Powerful to Use

Add CrawlForge to your MCP client config and start calling tools immediately.

mcp-config.json
{
  "mcpServers": {
    "crawlforge": {
      "command": "npx",
      "args": ["-y", "crawlforge-mcp-server"]
    }
  }
}
usage.ts
// Extract clean content from any URL
const content = await mcp.extract_content({
  url: "https://example.com/blog/post",
  format: "markdown",
});

// Search the web and get structured results
const results = await mcp.search_web({
  query: "latest AI infrastructure trends",
  max_results: 10,
});

// Deep research with conflict detection
const research = await mcp.deep_research({
  query: "Compare pricing of top cloud providers",
  sources: 5,
});
Use Cases

Built for Real Production Workflows

From AI agent pipelines to competitive intelligence, see how teams use CrawlForge.

AI Agent Data Pipelines

Feed your AI agents live web data with structured extraction and multi-source research.

deep_researchextract_content

E-commerce Price Monitoring

Track competitor prices and product availability across hundreds of e-commerce sites.

batch_scrapetrack_changes

SEO Analysis & Auditing

Audit your site and competitors for metadata, broken links, content gaps, and ranking opportunities.

extract_metadatamap_siteanalyze_content

Competitive Intelligence

Gather competitor data discreetly using stealth browsing and structured extraction.

stealth_modescrape_structured

Start scraping in the next five minutes

Test any tool in the playground right now, or create a free account with 1,000 credits — no credit card required.

1,000 free credits • Refills monthly • Cancel anytime

Footer

CrawlForge

Enterprise web scraping for AI Agents. 27 specialized MCP tools designed for modern developers building intelligent systems.

Product

  • Features
  • Playground
  • Pricing
  • Use Cases
  • Integrations
  • Alternatives
  • Changelog

Resources

  • Getting Started
  • API Reference
  • Templates
  • Guides
  • Blog
  • Glossary
  • FAQ
  • Sitemap

Developers

  • MCP Protocol
  • Claude Desktop
  • Cursor IDE
  • LangChain
  • LlamaIndex

Company

  • About
  • Contact
  • Privacy
  • Terms
  • Acceptable Use
  • Cookies

Stay updated

Get the latest updates on new tools and features.

Built with Next.js and MCP protocol

© 2025-2026 CrawlForge. All rights reserved.

27 Specialized Tools

Everything You Need for Web Scraping

27 real MCP tools with transparent credit-based pricing. From simple extraction to deep multi-source research.

Real-time Scraping

Get fresh data with millisecond latency and automatic retry logic

AI-Optimized Output

Structured data formats perfect for LLM training and inference

Credit-based Pricing

Pay only for what you use with transparent, predictable costs

1 credit

fetch_url

Fetch raw HTML or rendered content from any URL

1 credit

extract_text

Extract clean plain text from web pages

1 credit

extract_links

Extract and categorize all links from a page

1 credit

extract_metadata

Pull title, description, OG tags, and structured data

2 credits

scrape_structured

Extract data matching a custom schema definition

2 credits

extract_content

Get clean, AI-ready markdown or text content

2 credits

map_site

Discover and map all pages on a website

2 credits

process_document

Process PDFs, DOCs, and other document formats

2 credits

localization

Detect and extract content across languages

3 credits

track_changes

Track page changes with baselines, schedules, and alerts

3 credits

analyze_content

Analyze readability, topics, and sentiment

3 credits

extract_structured

LLM-powered schema extraction with selector fallback

4 credits

summarize_content

Generate concise summaries of web page content

4 credits

crawl_deep

Crawl entire sites following internal links

5 credits

search_web

Search Google and get structured SERP results

5 credits

serp_rank

Check where a domain ranks in Google's organic results for a keyword

5 credits

batch_scrape

Process hundreds of URLs in parallel

5 credits

scrape_with_actions

Scrape pages that require clicks, scrolls, or form fills

5 credits

stealth_mode

Bypass anti-bot protections with residential proxies

5 credits

generate_llms_txt

Generate standard-compliant llms.txt for AI crawlers

10 credits

deep_research

Multi-source research with conflict detection

3 credits

extract_with_llm

AI extraction with local Ollama by default — no separate LLM-provider key required

Free

list_ollama_models

Discover available local Ollama models for AI extraction.

1 credit

scrape_template

Pre-built scrapers for GitHub, Amazon, LinkedIn, and 7 more platforms.

2 credits

scrape

Unified multi-format scrape — markdown, HTML, links, metadata, and more in one fetch

8 credits

agent

Autonomous research from a natural-language prompt — no URLs required

1 credit

get_batch_results

Retrieve paginated results from a batch_scrape job

Ready to integrate these tools into your AI workflow?

Integrations

Built for Modern AI Workflows

Works with the tools and frameworks your team already uses.

27 Tools
Specialized MCP tools for every scraping need
1,000 Free Credits
Start free with monthly refills, no credit card required
MCP Native
First-class Model Context Protocol integration
<500ms Response
Fast, reliable API responses

Works with your favorite AI tools

Claude Desktop
Cursor
LangChain
LlamaIndex
n8n
Vercel AI SDK
OpenAI
Windsurf