scrape_template

Pre-built scrapers for 10 of the most-requested sites. No schema, no selectors, no LLM — just pass a template name and a URL. Built-in extractors handle the parsing and return clean, typed JSON for 1 credit per call.

Use Cases

Quick E-Commerce Data

Pull Amazon product price, rating, and stock without writing a single selector.

Developer Profile Aggregation

Combine GitHub repos, npm packages, and Stack Overflow activity into one developer view.

Social Media Monitoring

Track tweets, Reddit threads, and Product Hunt launches with a single endpoint per source.

Endpoint

POST/api/v1/tools/scrape_template

Auth Required

2 req/s on Free plan

1 credit

Parameters

url is required for every template except list. Send template: "list" alone to discover available templates.

Name	Type	Required	Default	Description
template	string	Required	-	Template name. One of the 10 supported templates, or "list" to discover them programmatically. Example: github-repo
url	string	Optional	-	URL to scrape. Required unless template === "list". Example: https://github.com/crawlforge/mcp-server
timeout	number	Optional	15000	Request timeout in milliseconds (5000–60000). Example: 15000

Supported Templates

10 templates available — Each template returns a normalized JSON shape tuned for that site.

amazon-product

Product title, price, rating, reviews, stock status

linkedin-profile

Name, headline, location, experience, education

github-repo

Stars, forks, language, last commit, description

youtube-video

Title, channel, views, likes, duration, publish date

tweet

Author, handle, text, likes, retweets, posted timestamp

reddit-thread

Title, subreddit, author, upvotes, comment count

hacker-news-front-page

Request Examples

cURL — github-repo

terminalBash

TypeScript — amazon-product

scrapeTemplate.tsTypescript

cURL — discover templates

terminalBash

Response Example

200 OK0.8s

{
  "success": true,
  "data": {
    "template": "github-repo",
    "url": "https://github.com/crawlforge/mcp-server",
    "extracted": {
      "name": "crawlforge/mcp-server",
      "stars": 12843,
      "forks": 1024,
      "language": "TypeScript",
      "description": "Powerful web scraping MCP server",
      "last_commit": "2026-05-15T10:23:00Z"
    },
    "scraped_at": "2026-05-18T12:00:00.000Z"
  },
  "credits_used": 1,
  "credits_remaining": 999,
  "processing_time": 812
}

Field Descriptions

data.extractedNormalized shape tuned for the chosen template

data.scraped_atISO 8601 timestamp of when the scrape finished

credits_usedFlat 1 credit per call regardless of template

Credit Cost