AI & LLMIntermediate

AI Training Data Collector

Feed a known URL list through batch_scrape and turn the results into clean training text. Strips navigation and boilerplate so every document is ready for fine-tuning.

MCP Configuration

{
  "tools": [
    {
      "name": "batch_scrape",
      "params": {
        "urls": [
          "https://docs.example.com/page-1",
          "https://docs.example.com/page-2"
        ],
        "format": "markdown"
      }
    },
    {
      "name": "extract_content",
      "params": {
        "format": "text",
        "remove_navigation": true
      }
    }
  ]
}

How It Works

batch_scrape

5 credits

extract_content

2 credits

Estimated total: ~7 credits per run

Ready to Use This Template?

Every new account gets 1,000 free credits. No credit card required.

Start Free with 1,000 Credits

Related Templates

AI & LLMIntermediate

Documentation Knowledge Base

Crawl documentation sites and build a structured knowledge base for AI-powered search. Outputs clean Markdown chunks ready for RAG and vector embedding.

crawl_deep (4 cr)extract_content (2 cr)summarize_content (4 cr)

AI & LLMIntermediate

AI Training Data Collector

Feed a known URL list through batch_scrape and turn the results into clean training text. Strips navigation and boilerplate so every document is ready for fine-tuning.

MCP Configuration

{
  "tools": [
    {
      "name": "batch_scrape",
      "params": {
        "urls": [
          "https://docs.example.com/page-1",
          "https://docs.example.com/page-2"
        ],
        "format": "markdown"
      }
    },
    {
      "name": "extract_content",
      "params": {
        "format": "text",
        "remove_navigation": true
      }
    }
  ]
}