Cline Integration
Give Cline live web access with CrawlForge MCP. One mcpServers entry in Cline's MCP settings file adds the server, and autoApprove skips the per-call prompt for tools you trust.
Prerequisites
npx, so nothing needs a global install—only a key.Sign in from the terminal: the CLI opens a browser page where you approve a new key, then saves it to ~/.crawlforge/config.json.
npm install -g crawlforge-mcp-server
crawlforge login # opens the browser approval pageOr copy a key from the dashboard and paste it into the config in the next step.
crawlforge login and the other ways to authenticate.AOption A: MCP Servers panel
In the Cline panel click the MCP Servers icon, open the Configure tab and click Configure MCP Servers. This opens cline_mcp_settings.json; add the server under mcpServers:
{
"mcpServers": {
"crawlforge": {
"command": "npx",
"args": [
"-y",
"crawlforge-mcp-server@latest",
"mcp"
],
"env": {
"CRAWLFORGE_API_KEY": "cf_live_your_api_key_here"
},
"disabled": false,
"autoApprove": []
}
}
}disabled: false turns the server on. Add tool names to autoApprove (for example "scrape") to run them without a confirmation prompt.
BOption B: Cline CLI
The Cline CLI reads ~/.cline/mcp.json with the same shape, and cline mcp opens a wizard to add, edit or disable servers.
cf_live_your_api_key_here with your key, or let the configurator fill it in.Limit the tool list (optional)
CrawlForge ships 31 tools. Set CRAWLFORGE_TOOL_GROUPS in the same env block to load only the groups you need, for example basic,search:
"env": {
"CRAWLFORGE_API_KEY": "cf_live_your_api_key_here",
"CRAWLFORGE_TOOL_GROUPS": "basic,search"
}Groups: basic, search, crawl, extract, batch, research, tracking, llmstxt, stealth, templates, scrape, agent.
- Open Cline — click the Cline icon in the activity bar
- Check the server — the MCP Servers panel shows crawlforge with a green dot and its tool list
- Test a prompt — try one of the examples below; Cline asks before each tool call unless it is in
autoApprove
Example Prompts
"Search for the latest AI news"
"Extract all links from example.com"
"Crawl the documentation site and summarize it"
"Extract product prices from this e-commerce site"
See the full API reference for all 31 tools and their parameters.
Troubleshooting
Server not connecting?
- Check
cline_mcp_settings.jsonis valid JSON - Ensure Node.js 18+ is installed:
node --version - Click Retry Connection in the MCP Servers panel and read the error
- Restart VS Code completely
Authentication Errors?
- Check the API key starts with
cf_live_ - Run
crawlforge loginto save a fresh key - Generate a new API key from the dashboard
Tools not being used?
- Make sure the server is not
disabledin the settings file - Enable the server's toggle in the MCP Servers panel
- Approve the tool call when Cline asks, or add the tool to
autoApprove