CrawlForge MCP
HomePlaygroundUse CasesIntegrationsPricingDocumentationBlog
Reddit Scraper for Claude Code: What Claude Actually Calls
Tutorials
Back to Blog
Tutorials

Reddit Scraper for Claude Code: What Claude Actually Calls

C
CrawlForge Team
Engineering Team
September 2, 2026
4 min read

On this page

Quick Answer

In Claude Code a Reddit scraper is one MCP tool call: reddit_search, which reads the Arctic Shift community archive instead of reddit.com. You ask in plain English and Claude picks the mode — a scoped subreddit search, a comment search, or a full thread read — at 5 credits a call with no Reddit credentials. The part worth knowing is that dropping the subreddit changes the mechanism rather than just the scope: an unscoped Reddit-wide search is served by a site-restricted web search that discovers up to 10 posts and then reads them from the archive, so results come back in relevance order and date filters are not applied at all.

Claude Code can search Reddit. It just never touches reddit.com to do it — every direct path returns 403, including stealth browsers, and we tested all of them. This post assumes you accept that and want to know what actually happens in your terminal.

Setup is one line — Claude Code's own MCP documentation covers the three install scopes. If the server does not show up afterwards, that is a different problem with a longer answer:

Bash
claude mcp add crawlforge \
  --env CRAWLFORGE_API_KEY=cf_live_your_key_here \
  -- npx -y crawlforge-mcp-server

What happens when you ask Claude Code to search Reddit?

You describe an outcome, not a tool:

Text
What are people in r/LocalLLaMA complaining about with long context this month? Read the top thread in full.

Claude makes two calls. The first is scoped, so it goes straight to the archive:

Json
{
  "tool": "reddit_search",
  "arguments": {
    "query": "long context",
    "subreddit": "LocalLLaMA",
    "mode": "posts",
    "after": "30d",
    "limit": 25
  }
}

The second takes an id from those results and reads the discussion:

Json
{
  "tool": "reddit_search",
  "arguments": {
    "mode": "thread",
    "link_id": "1vbf4nh",
    "limit": 100
  }
}

Two calls, 10 credits, no Reddit credentials anywhere. What comes back is normalized archive rows, so Claude can hand them to summarize_content without a parsing step in between — the full parameter list is in the API reference.

Why does a Reddit-wide search cost a web search?

Drop the subreddit and the request changes mechanism, not just scope. This is the part that catches people out.

Arctic Shift cannot keyword-search across all of Reddit — its API requires a subreddit, author or post scope. PullPush could, until it stopped serving automated clients in August 2026. So an unscoped query takes a two-step route: a site-restricted web search finds the matching posts, then those post IDs are read out of the archive.

What comes back is still real archive rows, not search-engine snippets. But three things change, and all three are stated in the response's own notes array:

  • Results are ordered by web-search relevance, not by score or date.
  • Discovery caps at 10 posts per call, whatever limit you asked for.
  • after and before are not applied. The response says so explicitly rather than returning unfiltered results.

That last one matters most in an agent loop. Claude will happily pass after: "7d" on an unscoped search, and the filter is dropped — the note is the only thing that tells either of you the window was ignored.

When should you override Claude's choice?

Rarely, with two exceptions worth learning.

Name a subreddit whenever you can. It is the difference between a 10-post relevance sample and a real archive query with working date filters. "Search Reddit for X" and "search r/webscraping for X" are different operations, not two phrasings of one.

Say "search comments" when you want opinions. mode: "comments" searches comment bodies rather than post titles and selftext, and Claude tends to default to posts. The candid material is usually three replies deep.

What does this cost inside an agent loop?

5 credits per call, whichever route answers — so the free tier's one-time 1,000 credits are 200 searches. A thread read costs the same 5 whether the thread holds 12 comments or 400, which makes "search, then read the top three threads" a predictable 20 credits instead of something that scales with how busy the discussion got.

The accuracy limit to design around: scores and comment counts on content younger than about 36 hours can read 0 or 1. The archive captures a post the moment it appears and does not re-poll it as votes arrive. Sentiment questions are fine. "Top-voted today" is not.

Try this yourself — no signup needed

Run any of CrawlForge's 29 scraping and extraction tools in the playground, then start free with 1,000 credits.

1,000 free credits • One-time • No credit card required

Tags

redditclaude codemcpreddit_searchweb scraping

About the Author

C

CrawlForge Team

Engineering Team

Building the most comprehensive web scraping MCP server. We create tools that help developers extract, analyze, and transform web data for AI applications.

Stay updated with the latest insights

Get tutorials, product updates, and web scraping tips delivered to your inbox.

No spam. Unsubscribe anytime.

Put this into practice

Test CrawlForge's tools on any URL — free, no signup.

On this page

Frequently Asked Questions

Why did Claude Code return only 10 Reddit posts when I asked for 50?+

Because the search was unscoped. A Reddit-wide keyword search is served by discovery — a site-restricted web search finds the posts, and one search call returns at most 10 results — so the limit you passed is capped there regardless of its value. Add a subreddit or author to the request and it queries the Arctic Shift archive directly, where limit goes up to 100.

Do I need to name reddit_search in my prompt?+

No. Describing the outcome is enough in most sessions, and Claude picks the tool and the mode itself. What is worth naming is the scope: saying "r/webscraping" rather than "Reddit" changes which backend answers, whether date filters work, and how many results you can ask for. That is a bigger difference than any wording of the tool name.

Why was my after/before date filter ignored?+

You almost certainly ran an unscoped search. Discovery runs through a web search, which cannot filter by post date, so after and before are dropped rather than silently half-applied — the response includes a note saying exactly that. Scope the search to a subreddit or author and the filters work, accepting ISO 8601, epoch seconds, or offsets like "7d".

Does this work outside Claude Code?+

Yes. Any MCP client works the same way — Claude Desktop, Cursor, Windsurf — and there is a REST endpoint at /api/v1/tools/reddit_search taking the same parameters with an X-API-Key header, at the same 5 credits, so the identical search runs from a cron job or a CI step with no MCP client involved.

Related Articles

How to Scrape Reddit Without the API (2026)
Tutorials

How to Scrape Reddit Without the API (2026)

Every direct path to reddit.com returns 403 in 2026 — even stealth browsers, and the .json trick is dead. Here is the archive route that works, step by step.

C
CrawlForge Team
|
Aug 24
|
6m
CrawlForge MCP v5.1.0: Search Reddit Without the API
Product Updates

CrawlForge MCP v5.1.0: Search Reddit Without the API

reddit.com blocks every scraper we have — so v5.1.0 ships reddit_search, a 28th tool that searches posts and comments and reads full threads through community archives. No Reddit API key, no credentials, 5 credits.

C
CrawlForge Team
|
Aug 24
|
9m
Reddit API Alternatives That Still Work in 2026
Web Scraping

Reddit API Alternatives That Still Work in 2026

Reddit closed self-service API signup in November 2025, and reddit.com blocks scrapers outright. Here are the five routes to Reddit data that still work in 2026 — honestly compared, including the ones we do not sell.

C
CrawlForge Team
|
Aug 24
|
6m

Footer

CrawlForge MCP

Enterprise web scraping for AI Agents. 29 specialized MCP tools designed for modern developers building intelligent systems.

Product

  • Features
  • Playground
  • Pricing
  • Use Cases
  • Integrations
  • Alternatives
  • Changelog

Resources

  • Getting Started
  • API Reference
  • Templates
  • Guides
  • Blog
  • Glossary
  • FAQ
  • Sitemap

Developers

  • MCP Protocol
  • Claude Desktop
  • Cursor IDE
  • LangChain
  • LlamaIndex

Company

  • About
  • Contact
  • Privacy
  • Terms
  • Acceptable Use
  • Cookies

Stay updated

Get the latest updates on new tools and features.

Built with Next.js and MCP protocol

© 2025-2026 CrawlForge. All rights reserved.