search_web
Programmatic web search powered by Google Custom Search API with advanced filtering, ranking, and result metadata. Perfect for automating research and content discovery.
Use Cases
Research Automation
Automate research by searching for academic papers, news articles, or technical documentation
Content Discovery
Find relevant content, blogs, or resources for content creation and curation
Competitive Monitoring
Track mentions of your brand, products, or competitors across the web
Lead Generation
Find potential customers, partners, or opportunities based on search criteria
SEO Research
Analyze search results to understand ranking factors and competitor strategies
Data Collection
Gather URLs for further scraping or analysis based on search queries
Endpoint
/api/v1/tools/search_web
Parameters
Name | Type | Required | Default | Description |
---|---|---|---|---|
query | string | Required | - | Search query (supports advanced operators) Example: best web scraping tools 2025 |
limit | number | Optional | 10 | Number of results to return (1-100) Example: 25 |
timeRange | string | Optional | - | Filter by publish date: day, week, month, year, or custom Example: month |
safeSearch | boolean | Optional | true | Filter explicit content Example: true |
site | string | Optional | - | Restrict search to specific site or domain Example: github.com |
fileType | string | Optional | - | Filter by file type: pdf, doc, xls, ppt, etc. Example: pdf |
language | string | Optional | en | Language code (ISO 639-1) Example: en |
country | string | Optional | - | Country code for geo-specific results (ISO 3166-1) Example: us |
Request Examples
Response Example
{ "success": true, "data": { "query": "best web scraping tools 2025", "totalResults": 12500000, "resultsReturned": 25, "results": [ { "position": 1, "title": "Top 10 Web Scraping Tools for 2025 - Developer Guide", "url": "https://example.com/scraping-tools", "displayUrl": "example.com › scraping-tools", "snippet": "Discover the best web scraping tools in 2025 including CrawlForge MCP, Beautiful Soup, and Scrapy. Compare features, pricing, and use cases...", "date": "2025-09-15", "domain": "example.com", "favicon": "https://example.com/favicon.ico" }, { "position": 2, "title": "CrawlForge MCP: The Ultimate Web Scraping Solution", "url": "https://crawlforge.dev", "displayUrl": "crawlforge.dev", "snippet": "CrawlForge MCP offers 19 powerful web scraping tools in one API. Start with 1,000 free credits and automate your data extraction...", "date": "2025-09-28", "domain": "crawlforge.dev", "favicon": "https://crawlforge.dev/favicon.ico" } ], "searchMetadata": { "searchTime": 0.45, "language": "en", "country": "us", "safeSearch": true, "timeRange": "month" } }, "credits_used": 5, "credits_remaining": 995, "processing_time": 1250}
data.totalResults
Total results available (not all are returned)data.resultsReturned
Number of results in this responsedata.results
Array of search results with metadatadata.results[].snippet
Description excerpt from the pagedata.results[].date
Publication date if availablecredits_used
Fixed 5 credits per search queryprocessing_time
Search typically completes in 1-2 secondsError Handling
Empty Query (400 Bad Request)
Search query cannot be empty. Provide at least 2 characters.
No Results Found (404 Not Found)
No search results match your query. Try broader search terms or remove filters.
Invalid Parameters (400 Bad Request)
Check timeRange, language, or country parameters for valid values.
Quota Exceeded (429 Too Many Requests)
Search API has daily limits. Upgrade your plan for higher quotas.
Credit Cost
What's Included:
- Up to 100 results per search
- Advanced filtering (time, site, file type)
- Multiple language and country support
- Safe search filtering
- Result metadata (date, domain, snippet)
Plan Recommendations:
Free Plan: 1,000 credits = 200 searches
Hobby Plan: 5,000 credits = 1,000 searches ($19/mo)
Professional Plan: 50,000 credits = 10,000 searches ($99/mo)