Skip to content
CrawlForge MCP

Templates

Feed a known URL list through batch_scrape and turn the results into clean training text. Strips navigation and boilerplate so every document is ready for fine-tuning.
AI & LLMIntermediate

01The config

MCP Configuration

ai-training-data-collector.json
{  "tools": [    {      "name": "batch_scrape",      "params": {        "urls": [          "https://docs.example.com/page-1",          "https://docs.example.com/page-2"        ],        "format": "markdown"      }    },    {      "name": "extract_content",      "params": {        "format": "text",        "remove_navigation": true      }    }  ]}

Tags

  • #AI
  • #training-data
  • #machine-learning
  • #datasets

02The run

How It Works

7◆ credits
Estimated total: ~7 credits per run
  1. 01batch_scrape 5 credits
  2. 02extract_content 2 credits

03Keep exploring

Related Templates

AI & LLMIntermediate

Documentation Knowledge Base

Crawl documentation sites and build a structured knowledge base for AI-powered search. Outputs clean Markdown chunks ready for RAG and vector embedding.

crawl_deep 4 creditsextract_content 2 creditssummarize_content 4 credits

Total: ~10 credits per run

Start forging

Ready to Use This Template?

Every new account gets 1,000 free credits. No credit card required.

Start Free with 1,000 Credits