scrape_template

Pre-built scrapers for 10 of the most-requested sites. No schema, no selectors, no LLM — just pass a template name and a URL. Built-in extractors handle the parsing and return clean, typed JSON for 1 credit per call.

Use Cases

Quick E-Commerce Data

Pull Amazon product price, rating, and stock without writing a single selector.

Developer Profile Aggregation

Combine GitHub repos, npm packages, and Stack Overflow activity into one developer view.

Social Media Monitoring

Track tweets, Reddit threads, and Product Hunt launches with a single endpoint per source.

Endpoint

POST/api/v1/tools/scrape_template

Auth Required

1 req/s on Free plan

1 credit

Parameters

url is required for every template except list. Send template: "list" alone to discover available templates.

Name	Type	Required	Default	Description
template	string	Required	-	Template name. One of the 10 supported templates, or "list" to discover them programmatically. Example: github-repo
url	string	Optional	-	URL to scrape. Required unless template === "list". Example: https://github.com/mysleekdesigns/crawlforge-mcp
timeout	number	Optional	15000	Request timeout in milliseconds (5000–60000). Example: 15000

Supported Templates

10 templates available — Each template returns a normalized JSON shape tuned for that site.

amazon-product

Product title, price, rating, reviews, stock status

linkedin-profile

Name, headline, location, experience, education

github-repo

Stars, forks, language, last commit, description

youtube-video

Title, channel, views, likes, duration, publish date

tweet

Author, handle, text, likes, retweets, posted timestamp

reddit-thread

Title, subreddit, author, upvotes, comment count

hacker-news-front-page

Request Examples

cURL — github-repo

terminalBash

curl -X POST https://crawlforge.dev/api/v1/tools/scrape_template \
  -H "X-API-Key: cf_test_YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "template": "github-repo",
    "url": "https://github.com/mysleekdesigns/crawlforge-mcp"
  }'

TypeScript — amazon-product

scrapeTemplate.tsTypescript

const response = await fetch('https://crawlforge.dev/api/v1/tools/scrape_template', {
  method: 'POST',
  headers: {
    'X-API-Key': process.env.CRAWLFORGE_API_KEY!,
    'Content-Type': 'application/json',
  },
  body: JSON.stringify({
    template: 'amazon-product',
    url: 'https://www.amazon.com/dp/B08XYZ1234',
    timeout: 20000,
  }),
});

const data = await response.json();
if (data.success) {
  const product = data.data.extracted;
  console.log(product.title, product.price, product.rating);
}

cURL — discover templates

terminalBash

curl -X POST https://crawlforge.dev/api/v1/tools/scrape_template \
  -H "X-API-Key: cf_test_YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{ "template": "list" }'

Response Example

200 OK0.8s

{
  "success": true,
  "data": {
    "template": "github-repo",
    "url": "https://github.com/mysleekdesigns/crawlforge-mcp",
    "extracted": {
      "name": "mysleekdesigns/crawlforge-mcp",
      "stars": 12843,
      "forks": 1024,
      "language": "TypeScript",
      "description": "Powerful web scraping MCP server",
      "last_commit": "2026-05-15T10:23:00Z"
    },
    "scraped_at": "2026-05-18T12:00:00.000Z"
  },
  "credits_used": 1,
  "credits_remaining": 999,
  "processing_time": 812
}

Field Descriptions

data.extractedNormalized shape tuned for the chosen template

data.scraped_atISO 8601 timestamp of when the scrape finished

credits_usedFlat 1 credit per call regardless of template

Credit Cost

1 credit

1 credit per request

Flat 1 credit per call. The cheapest way to pull structured data from a supported site.

Tip: Need a site that isn't supported? Use scrape_structured for custom selectors (2 credits) or extract_with_llm for LLM-powered extraction.

Related Tools

scrape_structured

Custom CSS selector extraction (2 credits)

extract_with_llm

LLM-powered extraction for any site

Ready to scrape popular sites in one call? Sign up for free and get 1,000 credits.

Use Cases

Quick E-Commerce Data

Pull Amazon product price, rating, and stock without writing a single selector.

Developer Profile Aggregation

Combine GitHub repos, npm packages, and Stack Overflow activity into one developer view.

Social Media Monitoring

Track tweets, Reddit threads, and Product Hunt launches with a single endpoint per source.

Parameters

url is required for every template except list. Send template: "list" alone to discover available templates.

Name	Type	Required	Default	Description
template	string	Required	-	Template name. One of the 10 supported templates, or "list" to discover them programmatically. Example: github-repo
url	string	Optional	-	URL to scrape. Required unless template === "list". Example: https://github.com/mysleekdesigns/crawlforge-mcp
timeout	number	Optional	15000	Request timeout in milliseconds (5000–60000). Example: 15000

Supported Templates

10 templates available — Each template returns a normalized JSON shape tuned for that site.

amazon-product

Product title, price, rating, reviews, stock status

linkedin-profile

Name, headline, location, experience, education

github-repo

Stars, forks, language, last commit, description

youtube-video

Title, channel, views, likes, duration, publish date

tweet

Author, handle, text, likes, retweets, posted timestamp

reddit-thread

Title, subreddit, author, upvotes, comment count

hacker-news-front-page

cURL — github-repo

terminalBash

curl -X POST https://crawlforge.dev/api/v1/tools/scrape_template \
  -H "X-API-Key: cf_test_YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "template": "github-repo",
    "url": "https://github.com/mysleekdesigns/crawlforge-mcp"
  }'

TypeScript — amazon-product

scrapeTemplate.tsTypescript

const response = await fetch('https://crawlforge.dev/api/v1/tools/scrape_template', {
  method: 'POST',
  headers: {
    'X-API-Key': process.env.CRAWLFORGE_API_KEY!,
    'Content-Type': 'application/json',
  },
  body: JSON.stringify({
    template: 'amazon-product',
    url: 'https://www.amazon.com/dp/B08XYZ1234',
    timeout: 20000,
  }),
});

const data = await response.json();
if (data.success) {
  const product = data.data.extracted;
  console.log(product.title, product.price, product.rating);
}

cURL — discover templates

terminalBash

curl -X POST https://crawlforge.dev/api/v1/tools/scrape_template \
  -H "X-API-Key: cf_test_YOUR_KEY" \
  -H "Content-Type: application/json" \
  -d '{ "template": "list" }'

Response Example

200 OK0.8s

{
  "success": true,
  "data": {
    "template": "github-repo",
    "url": "https://github.com/mysleekdesigns/crawlforge-mcp",
    "extracted": {
      "name": "mysleekdesigns/crawlforge-mcp",
      "stars": 12843,
      "forks": 1024,
      "language": "TypeScript",
      "description": "Powerful web scraping MCP server",
      "last_commit": "2026-05-15T10:23:00Z"
    },
    "scraped_at": "2026-05-18T12:00:00.000Z"
  },
  "credits_used": 1,
  "credits_remaining": 999,
  "processing_time": 812
}

Field Descriptions

data.extractedNormalized shape tuned for the chosen template

data.scraped_atISO 8601 timestamp of when the scrape finished

credits_usedFlat 1 credit per call regardless of template