CrawlForge
Integration
Integration

Integration Guide

Connect CrawlForge MCP to Claude Desktop, LangChain, LlamaIndex, and other AI frameworks. Built on the Model Context Protocol for universal compatibility.

What is the Model Context Protocol?

The Model Context Protocol (MCP) is an open standard created by Anthropic that enables AI assistants to securely connect to external data sources and tools. CrawlForge MCP implements this protocol to provide web scraping capabilities to any MCP-compatible AI application.

Universal Integration: Once configured, CrawlForge MCP works with any MCP-compatible tool—Claude Desktop, custom AI agents, LangChain, LlamaIndex, and more.

Why Use MCP Integration?

Universal Compatibility
Works with any MCP-compatible AI tool or framework
Zero Dependencies
No additional packages required beyond MCP client libraries
Real-Time Data
Give your AI access to live web data without training
Simple Setup
Configure once, use everywhere with standard MCP protocol

Integration Options

NPM Installation
Quick Start
Install CrawlForge MCP server globally via npm for use with any MCP client
MCP Protocol
Core
Model Context Protocol specification and server configuration
Claude Desktop
Popular
Install and configure CrawlForge MCP with Claude Desktop app
Cursor IDE
IDE
Enable AI-powered web scraping in Cursor IDE with .cursorrules config
LangChain
Framework
Integrate with LangChain for document loaders and retrieval chains
LlamaIndex
Framework
Use CrawlForge MCP as a data connector in LlamaIndex

Quick Start

Option 1: Claude Desktop Integration
The fastest way to get started—configure CrawlForge MCP in Claude Desktop with a JSON config file.
Claude Desktop Setup Guide
Option 2: Cursor IDE Integration
Enable AI-powered web scraping in your development workflow with Cursor IDE.
Cursor IDE Setup Guide
Option 3: LangChain/LlamaIndex Integration
Integrate CrawlForge MCP into your AI application using popular frameworks.
LangChain GuideLlamaIndex Guide
Option 4: Custom MCP Implementation
Build your own MCP client using the protocol specification.
MCP Protocol Docs
Need Help with Integration?
Check our troubleshooting guides or contact support for personalized assistance.
View Getting StartedAPI Reference