Skip to content
CrawlForge MCP

Templates

Crawl documentation sites and build a structured knowledge base for AI-powered search. Outputs clean Markdown chunks ready for RAG and vector embedding.
AI & LLMIntermediate

01The config

MCP Configuration

documentation-knowledge-base.json
{  "tools": [    {      "name": "crawl_deep",      "params": {        "url": "https://docs.example.com",        "max_depth": 3,        "follow_links": true      }    },    {      "name": "extract_content",      "params": {        "format": "markdown",        "remove_navigation": true      }    },    {      "name": "summarize_content",      "params": {        "max_length": 500      }    }  ]}

Tags

  • #documentation
  • #knowledge-base
  • #AI
  • #summaries

02The run

How It Works

10◆ credits
Estimated total: ~10 credits per run
  1. 01crawl_deep 4 credits
  2. 02extract_content 2 credits
  3. 03summarize_content 4 credits

03Keep exploring

Related Templates

AI & LLMIntermediate

AI Training Data Collector

Feed a known URL list through batch_scrape and turn the results into clean training text. Strips navigation and boilerplate so every document is ready for fine-tuning.

batch_scrape 5 creditsextract_content 2 credits

Total: ~7 credits per run

Start forging

Ready to Use This Template?

Every new account gets 1,000 free credits. No credit card required.

Start Free with 1,000 Credits