Integration
Integration Guide
Connect CrawlForge MCP to Claude Desktop, LangChain, LlamaIndex, and other AI frameworks. Built on the Model Context Protocol for universal compatibility.
What is the Model Context Protocol?
The Model Context Protocol (MCP) is an open standard created by Anthropic that enables AI assistants to securely connect to external data sources and tools. CrawlForge MCP implements this protocol to provide web scraping capabilities to any MCP-compatible AI application.
Universal Integration: Once configured, CrawlForge MCP works with any MCP-compatible tool—Claude Desktop, custom AI agents, LangChain, LlamaIndex, and more.
Why Use MCP Integration?
Universal Compatibility
Works with any MCP-compatible AI tool or framework
Zero Dependencies
No additional packages required beyond MCP client libraries
Real-Time Data
Give your AI access to live web data without training
Simple Setup
Configure once, use everywhere with standard MCP protocol
Integration Options
NPM Installation
Install CrawlForge MCP server globally via npm for use with any MCP client
Quick Start
MCP Protocol
Model Context Protocol specification and server configuration
Core
Claude Desktop
Install and configure CrawlForge MCP with Claude Desktop app
Popular
Cursor IDE
Enable AI-powered web scraping in Cursor IDE with .cursorrules config
IDE
LangChain
Integrate with LangChain for document loaders and retrieval chains
Framework
LlamaIndex
Use CrawlForge MCP as a data connector in LlamaIndex
Framework
Quick Start
Option 1: Claude Desktop Integration
The fastest way to get started—configure CrawlForge MCP in Claude Desktop with a JSON config file.
Claude Desktop Setup Guide →
Option 2: Cursor IDE Integration
Enable AI-powered web scraping in your development workflow with Cursor IDE.
Cursor IDE Setup Guide →
Option 3: LangChain/LlamaIndex Integration
Integrate CrawlForge MCP into your AI application using popular frameworks.
LangChain Guide → · LlamaIndex Guide → (/docs/integration/llamaindex)
Option 4: Custom MCP Implementation
Build your own MCP client using the protocol specification.
MCP Protocol Docs →
Need Help with Integration?
Check our troubleshooting guides or contact support for personalized assistance.