Step 1
Install
Add the CrawlForge MCP server to your AI client with a single config entry.
npx -y crawlforge-mcp-serverMCP server · 31 tools · open source
One API for scraping, search, and extraction — 31 MCP-native tools that plug straight into Claude, Cursor, LangChain, or your own code. Get clean markdown or structured JSON from any URL in a single call.
31
Specialized Tools
1,000
Free Credits to Start
Open Source
MCP Server on npm & GitHub
1,000 free credits • No credit card required
01The forge
Every page on the web is raw ore. CrawlForge is the forge: 31 MCP tools that fetch, render, search and extract, then hand your agent clean markdown or typed JSON.
02The process
Three steps from zero to live web data in your AI agent.
Step 1
Add the CrawlForge MCP server to your AI client with a single config entry.
npx -y crawlforge-mcp-serverStep 2
Set your API key and choose which tools to enable for your workflow.
export CRAWLFORGE_API_KEY=cf_live_••••••••Step 3
Call any of 31 tools directly from your AI agent. Data flows back instantly.
scrape({ url: "https://example.com" }) // → markdown03On the anvil
Add CrawlForge to your MCP client config and start calling tools immediately.
04The arsenal
31 real MCP tools with transparent credit-based pricing. From simple extraction to deep multi-source research.
Extract and categorize all links from a page
Pull title, description, OG tags, and structured data
Extract clean plain text from web pages
Fetch raw HTML or rendered content from any URL
Retrieve paginated results from a batch_scrape job
Discover available local Ollama models for AI extraction.
Read back a result that came back truncated — slice, search, page by line or json_path it by handle
Pre-built scrapers for GitHub, Amazon, LinkedIn, and 7 more platforms.
Get clean, AI-ready markdown or text content
Read data from a page's embedded JavaScript state (Next.js, Nuxt, Redux)
Detect and extract content across languages
Discover and map all pages on a website
Process PDFs, DOCs, and other document formats
Unified multi-format scrape — markdown, HTML, links, metadata, and more in one fetch
Extract data matching a custom schema definition
Analyze readability, topics, and sentiment
Keep one browser page alive across calls — open, snapshot for element refs, act, read, close
LLM-powered schema extraction with selector fallback
AI extraction with local Ollama by default — no separate LLM-provider key required
Track page changes with baselines, schedules, and alerts
Crawl entire sites following internal links
Generate concise summaries of web page content
Process hundreds of URLs in parallel
Generate standard-compliant llms.txt for AI crawlers
Search Reddit posts, comments, or full threads via community archives
Scrape pages that require clicks, scrolls, or form fills
Search Google and get structured SERP results
Check where a domain ranks in Google's organic results for a keyword
Bypass anti-bot protections with residential proxies
Autonomous research from a natural-language prompt — no URLs required
Multi-source research with conflict detection
05In production
From AI agent pipelines to competitive intelligence, see how teams use CrawlForge.
06Plays well with others
Works with the tools and frameworks your team already uses.
Weekly npm downloads
31 Tools
Specialized MCP tools for every scraping need
1,000 Free Credits
Start free with 1,000 credits, no credit card required
MCP Native
First-class Model Context Protocol integration
<500ms Response
Fast, reliable API responses
07Pricing
Start with 1,000 free credits — no credit card. Upgrade only when your usage grows.
Yearly plans get two months free and receive the full year's credits on day one.
Perfect for trying out CrawlForge MCP
1,000 credits to start
Great for personal projects and small applications
Billed $190/year · Save $38
60,000 credits/year
Perfect for growing businesses and production applications
Billed $990/year · Save $198
600,000 credits/year
For enterprise applications with high volume needs
Billed $3,990/year · Save $798
3,000,000 credits/year
How credits are spent
1 credit
Fetch or extract a page
2–4 credits
Full page scrape or deep crawl
5–10 credits
Search, agents, and deep research
Paid plans roll unused credits over while your subscription is active. The Free plan's 1,000 credits are one-time.
Ready when you are
Test any tool in the playground right now, or create a free account with 1,000 credits — no credit card required.
1,000 free credits • One-time • Cancel anytime