scrape_template

Pre-built scrapers for 10 of the most-requested sites. No schema, no selectors, no LLM — just pass a template name and a URL. Built-in extractors handle the parsing and return clean, typed JSON for 1 credit per call.

Use Cases

Quick E-Commerce Data

Pull Amazon product price, rating, and stock without writing a single selector.

Developer Profile Aggregation

Combine GitHub repos, npm packages, and Stack Overflow activity into one developer view.

Social Media Monitoring

Track tweets, Reddit threads, and Product Hunt launches with a single endpoint per source.

Supported Templates

10 templates available

Each template returns a normalized JSON shape tuned for that site.

amazon-productProduct title, price, rating, reviews, stock status

linkedin-profileName, headline, location, experience, education

github-repoStars, forks, language, last commit, description

youtube-videoTitle, channel, views, likes, duration, publish date

tweetAuthor, handle, text, likes, retweets, posted timestamp

reddit-threadTitle, subreddit, author, upvotes, comment count

hacker-news-front-pageTop stories, points, and comment counts

producthunt-launchProduct name, tagline, upvotes, maker info

stackoverflow-questionQuestion, votes, answers, tags, acceptance

npm-packageVersion, weekly downloads, license, dependencies

Pass { "template": "list" } (no url required) to fetch this list programmatically. Useful for keeping client SDKs in sync.

Endpoint

POST/api/v1/tools/scrape_template

Auth Required

2 req/s on Free plan

1 credit

Parameters

Name	Type	Required	Default	Description
template	string	Required	-	Template name. One of the 10 supported templates, or "list" to discover them programmatically. Example: github-repo
url	string	Optional	-	URL to scrape. Required unless template === "list". Example: https://github.com/crawlforge/mcp-server
timeout	number	Optional	15000	Request timeout in milliseconds (5000–60000). Example: 15000

url is required for every template except list. Send template: "list" alone to discover available templates.

Request Examples

cURL — github-repo

terminalBash

TypeScript — amazon-product

scrapeTemplate.tsTypescript

cURL — discover templates

terminalBash

Response Example

200 OK0.8s

{
  "success": true,
  "data": {
    "template": "github-repo",
    "url": "https://github.com/crawlforge/mcp-server",
    "extracted": {
      "name": "crawlforge/mcp-server",
      "stars": 12843,
      "forks": 1024,
      "language": "TypeScript",
      "description": "Powerful web scraping MCP server",
      "last_commit": "2026-05-15T10:23:00Z"
    },
    "scraped_at": "2026-05-18T12:00:00.000Z"
  },
  "credits_used": 1,
  "credits_remaining": 999,
  "processing_time": 812
}

Field Descriptions

data.extractedNormalized shape tuned for the chosen template

data.scraped_atISO 8601 timestamp of when the scrape finished

credits_usedFlat 1 credit per call regardless of template

Credit Cost

1 credit

1 credit per request

Flat 1 credit per call. The cheapest way to pull structured data from a supported site.

Tip: Need a site that isn't supported? Use scrape_structured for custom selectors (2 credits) or extract_with_llm for LLM-powered extraction.

Related Tools

scrape_structured

Custom CSS selector extraction (2 credits)

extract_with_llm

LLM-powered extraction for any site

Ready to scrape popular sites in one call? Sign up for free and get 1,000 credits.