CrawlForge
API Reference

CrawlForge MCP API Reference

Complete reference for all 19 CrawlForge MCP tools. Build powerful web scraping applications with our developer-first API.

API Overview

Base URL
https://crawlforge.dev/api/v1
Authentication

All API requests require an API key passed in the X-API-Key header:

Bash

Get your API key from the dashboard.

Request Format

All tool endpoints accept JSON in the request body:

Json
Response Format

All responses follow a standard format:

Json

HTTP Status Codes

CodeDescription
200OK - Request successful
400Bad Request - Invalid parameters
401Unauthorized - Invalid or missing API key
402Payment Required - Insufficient credits
429Too Many Requests - Rate limit exceeded
500Internal Server Error

Rate Limits

Free Plan
2 requests per second
Hobby Plan
5 requests per second
Professional Plan
20 requests per second
Business Plan
50 requests per second

All Tools

Basic Tools

1-2 credits
fetch_url
Fetch and parse web pages with automatic handling
1 credit
extract_text
Extract clean text from HTML with intelligent parsing
1 credit
extract_links
Discover and extract all links from a webpage
1 credit
extract_metadata
Extract page metadata, OpenGraph, and Twitter Card tags
1 credit
custom_headers
Make requests with custom HTTP headers and cookies
1 credit
scrape_structured
Extract structured data using CSS selectors
2 credits
extract_content
2 credits
map_site
2 credits
screenshot
Capture screenshots of web pages (PNG, JPEG, WebP)
2 credits
pdf_extract
Extract text, tables, and images from PDFs
2 credits
process_document
2 credits
data_validation
Validate extracted data against schemas
2 credits
localization
2 credits

Advanced Tools

3-6 credits
structured_extract
AI-assisted structured data extraction
3 credits
form_submit
Fill and submit web forms automatically
3 credits
proxy_request
Route requests through proxies and custom configurations
3 credits
monitor_changes
Monitor web pages for content changes
3 credits
content_analysis
Analyze content for sentiment, SEO, and quality
4 credits
analyze_content
3 credits
summarize_content
4 credits
crawl_deep
4 credits
rate_limit_bypass
Intelligent rate limit handling and retry logic
4 credits
stealth_mode
Bypass anti-bot detection with advanced stealth techniques
5 credits
scrape_with_actions
5 credits
batch_scrape
Scrape multiple URLs concurrently with rate limiting
5 credits
search_web
5 credits
api_discovery
Discover and document APIs from web applications
6 credits

Premium Tools

8-10 credits
smart_crawl
Intelligent web crawling with depth and breadth controls
8 credits
deep_research
AI-powered research across multiple sources
10 credits

Error Handling

Json

See the Error Reference for a complete list of error codes and solutions.

Ready to start building?
Pick a tool and explore its documentation
View Tool DocsBack to Getting Started