CrawlForge
首页Playground应用场景集成价格文档博客
如何用 Claude + CrawlForge 构建竞争情报 agent
Tutorials
返回博客
教程

如何用 Claude + CrawlForge 构建竞争情报 agent

C
CrawlForge Team
工程团队
2026年1月21日
阅读时长 12 分钟
更新于 2026年4月14日

本页内容

竞争情报对业务成功至关重要,但手动监控竞争对手非常耗时。在本教程中,你将构建一个 AI agent,它会自动调研竞争对手、分析他们的策略并交付每周报告——全部使用 Claude 和 CrawlForge MCP。

你将构建什么

读完本教程,你将拥有一个竞争情报 agent,它能够:

  • 监控竞争对手网站的变化
  • 跟踪竞争对手的定价与产品更新
  • 分析竞争对手的内容策略
  • 生成每周摘要报告
  • 在出现重大动态时提醒你

所需时间: 30-45 分钟 成本: 约 50 credits(在免费套餐范围内)

前置条件

开始之前,请确保你已具备:

  1. 已安装 Claude Code: npm install -g @anthropic-ai/claude-code
  2. 已配置 CrawlForge MCP: 参照我们的配置指南
  3. 免费的 CrawlForge 账户: 在此注册即可获得 1,000 个免费 credits

步骤 1:定义你的竞争对手

首先,为你的竞争对手创建一个配置文件。在你的项目目录中:

Json
// competitors.json
{
  "competitors": [
    {
      "name": "Competitor A",
      "website": "https://competitor-a.com",
      "pricing_page": "https://competitor-a.com/pricing",
      "blog": "https://competitor-a.com/blog"
    },
    {
      "name": "Competitor B",
      "website": "https://competitor-b.com",
      "pricing_page": "https://competitor-b.com/pricing",
      "blog": "https://competitor-b.com/blog"
    }
  ],
  "focus_areas": [
    "pricing",
    "features",
    "content_strategy"
  ]
}

步骤 2:构建调研 agent

现在我们来创建这个 agent。在 Claude Code 中,以这个 system prompt 开始:

Markdown
You are a competitive intelligence analyst. Your job is to:

1. Research competitors using CrawlForge tools
2. Track pricing and feature changes
3. Analyze content strategies
4. Identify market trends
5. Generate actionable insights

Always use the most credit-efficient tool:
- fetch_url (1 credit) for basic page content
- extract_content (2 credits) for clean article text
- search_web (5 credits) only when you need to find new sources
- analyze_content (3 credits) for NLP analysis

Never use deep_research (10 credits) for known competitor URLs.

步骤 3:实现核心调研功能

功能 1:获取竞争对手的定价

Typescript
// In Claude Code, ask:
"Fetch the pricing page for [competitor] and extract:
1. Plan names and prices
2. Feature lists for each tier
3. Any promotional offers
4. Compare to last known pricing"

// CrawlForge will use extract_content (2 credits)
// to get clean, structured pricing data

功能 2:监控产品更新

Typescript
// Ask Claude:
"Check [competitor]'s changelog or product updates page.
Summarize any new features released in the past month.
Flag anything that competes directly with our offerings."

// Uses: fetch_url (1 credit) + Claude's analysis

功能 3:分析内容策略

Typescript
// Ask Claude:
"Analyze [competitor]'s blog for the past month:
1. What topics are they covering?
2. What keywords are they targeting?
3. How frequently are they publishing?
4. What's their content format (tutorials, news, case studies)?"

// Uses: extract_links (1 credit) to find blog posts
// Then: batch_scrape (5 credits) to get content
// Then: analyze_content (3 credits) for NLP insights

步骤 4:设置变更跟踪

CrawlForge 的 track_changes 工具会监控页面是否有更新:

Typescript
// Set up monitoring for a competitor's pricing page:
"Create a change monitor for https://competitor.com/pricing
Alert me when:
- Prices change by more than 10%
- New plans are added
- Features are added or removed"

// Uses: track_changes (3 credits for setup)
// Ongoing monitoring included

变更跟踪配置

Json
{
  "url": "https://competitor.com/pricing",
  "trackingOptions": {
    "trackText": true,
    "trackStructure": true,
    "granularity": "section",
    "significanceThresholds": {
      "minor": 0.1,
      "moderate": 0.3,
      "major": 0.7
    }
  },
  "monitoringOptions": {
    "interval": 86400000, // Daily check
    "notificationThreshold": "moderate"
  }
}

步骤 5:生成每周报告

为每周报告创建一个 prompt:

Markdown
Generate a competitive intelligence report for the week of [date]:

## Executive Summary
[2-3 sentence overview of key findings]

## Pricing Intelligence
[Any pricing changes detected across competitors]

## Product Updates
[New features or changes from competitors]

## Content Analysis
[What competitors are publishing and why it matters]

## Market Trends
[Patterns observed across multiple competitors]

## Recommended Actions
[3-5 specific actions we should consider]

---
Sources: [List all URLs analyzed]
Credits Used: [Total credits consumed]

步骤 6:用定时任务实现自动化

在生产环境中,把你的 agent 安排为每周运行:

Bash
# Create a weekly cron job (macOS/Linux)
crontab -e

# Add this line (runs every Monday at 9 AM):
0 9 * * 1 cd /path/to/project && claude "Run weekly competitive intelligence report" > /path/to/reports/report-$(date +%Y%m%d).md

credits 优化技巧

用这些策略把你的成本压低:

1. 优先使用最便宜的工具

任务低效高效
查看定价页deep_research (10)extract_content (2)
查找竞品博客文章search_web (5)extract_links (1)
获取文章正文scrape_with_actions (5)fetch_url (1)

2. 批量处理你的请求

Typescript
// Instead of 10 separate fetch_url calls (10 credits):
// Use batch_scrape for multiple URLs (5 credits total)
"Batch scrape these 10 competitor pages: [urls]"

3. 缓存竞争对手数据

调整你的分析结构,以复用已获取的数据:

Typescript
// Fetch once, analyze multiple times:
"1. Fetch competitor.com/pricing
 2. Extract pricing tiers
 3. Compare to our pricing
 4. Identify positioning gaps
 5. Suggest response strategies"

// All analysis after step 1 uses Claude (no additional credits)

输出示例

一份竞争情报报告大致是这样的:

Markdown
# Competitive Intelligence Report
## Week of January 20, 2026

### Executive Summary
Competitor A launched a new enterprise tier at $199/month, positioning
directly against our Pro plan. Competitor B increased their content
velocity by 40%, focusing heavily on AI automation tutorials.

### Pricing Intelligence
| Competitor | Change | Details |
|------------|--------|---------|
| Competitor A | New Tier | Enterprise plan launched at $199/mo |
| Competitor B | No Change | Prices stable for 3 months |

### Product Updates
**Competitor A:**
- Released API v2 with GraphQL support
- Added team collaboration features
- New dashboard analytics

**Competitor B:**
- Mobile app beta launched
- Webhook improvements

### Content Analysis
**Competitor A (12 posts):**
- Primary topics: AI automation, enterprise use cases
- Target keywords: "enterprise AI", "team collaboration"
- Format: Long-form tutorials (avg 2,500 words)

**Competitor B (8 posts):**
- Primary topics: Developer tutorials, integrations
- Target keywords: "API integration", "developer tools"
- Format: Code-heavy how-tos (avg 1,800 words)

### Recommended Actions
1. Consider matching Competitor A's enterprise pricing
2. Accelerate our content velocity to maintain SEO position
3. Prioritize GraphQL support in our roadmap
4. Create competitive comparison landing page

---
**Credits Used:** 47/1,000 (free tier)
**Sources Analyzed:** 24 pages across 2 competitors

进阶:监控多个竞争对手

要跟踪众多竞争对手,可使用这种高效模式:

Typescript
const competitors = [
  { name: "A", url: "https://a.com" },
  { name: "B", url: "https://b.com" },
  { name: "C", url: "https://c.com" },
  // ... up to 50 URLs
];

// Use batch_scrape for all pricing pages at once
"Batch scrape all competitor pricing pages and compare:
${competitors.map(c => c.url + '/pricing').join('\n')}"

// 5 credits for up to 50 URLs
// vs 50 credits for individual fetch_url calls

下一步

你已经构建出一个可用的竞争情报 agent。接下来可以这样扩展它:

  1. 加入情感分析: 对竞争对手的评论使用 analyze_content
  2. 跟踪社交媒体: 监控竞争对手的 Twitter/LinkedIn
  3. 设置提醒: 为重大变化配置邮件通知
  4. 构建 dashboard: 可视化随时间变化的趋势

相关资源:

  • MCP web scraping 完整指南
  • 面向受保护站点的 Stealth Mode
  • CrawlForge 文档

免费开始 - 含 1,000 个 credits

亲自试一试——无需注册

在 Playground 中运行 CrawlForge 的 27 个抓取与提取工具中的任意一个,然后免费开始,获取 1,000 credits。

1,000 免费 credits • 每月补充 • 无需信用卡

标签

tutorialcompetitive-intelligenceclaudeautomationclaude-web-scraping

关于作者

C

CrawlForge Team

工程团队

我们正在打造功能最全面的 Web 抓取 MCP server。我们开发的工具帮助开发者为 AI 应用提取、分析和转换 Web 数据。

及时获取最新洞察

将教程、产品更新与 Web 抓取技巧直接发送到你的收件箱。

拒绝垃圾邮件,随时可取消订阅。

付诸实践

在任意 URL 上测试 CrawlForge 的工具——免费,无需注册。

本页内容

相关文章

如何用 TypeScript 构建一个 web scraping MCP server(2026)
Tutorials

如何用 TypeScript 构建一个 web scraping MCP server(2026)

用 TypeScript 和官方 SDK 构建一个可用的 web scraping MCP server:一台最小化服务器、一个真实的 cheerio 抓取工具、测试,以及 Claude Desktop 配置。

C
CrawlForge Team
|
6月16日
|
12 分钟
从命令行进行 web scraping:CrawlForge CLI 指南
Tutorials

从命令行进行 web scraping:CrawlForge CLI 指南

在终端里构建生产级 scraper。15 个命令,输出可用于管道的 JSON,无需 MCP 客户端。30 秒即可安装。

C
CrawlForge Team
|
5月21日
|
10 分钟
如何在 Make 和 Zapier 中使用 CrawlForge
Tutorials

如何在 Make 和 Zapier 中使用 CrawlForge

把 CrawlForge 接入 Make(Integromat)和 Zapier,实现自动化网页抓取。借助 HTTP 模块、webhook 和工作流示例完成无代码配置。

C
CrawlForge Team
|
4月23日
|
8 分钟

页脚

CrawlForge

面向 AI Agent 的企业级网页抓取。27 个专业 MCP 工具,专为构建智能系统的现代开发者而设计。

产品

  • 功能
  • Playground
  • 价格
  • 应用场景
  • 集成
  • 替代方案
  • 更新日志

资源

  • 快速上手
  • API 参考
  • 模板
  • 指南
  • 博客
  • 术语表
  • 常见问题
  • 网站地图

开发者

  • MCP 协议
  • Claude Desktop
  • Cursor IDE
  • LangChain
  • LlamaIndex

公司

  • 关于我们
  • 联系我们
  • 隐私政策
  • 服务条款
  • 可接受使用政策
  • Cookie

保持更新

获取新工具和新功能的最新动态。

基于 Next.js 和 MCP 协议构建

© 2025-2026 CrawlForge。保留所有权利。