Web search API for AI agents: page text, MCP and real cost
An agent needs a web search API that returns text the model can read, not only ten links. Exa API, Brave Search API, Perplexity Search API and Tavily API return page text in the call or on the same key; the SERP APIs return Google's results page with snippets and need a scraping step for the rest. At 30,000 searches a month, page text starts at $120 on Exa API, and snippets alone at $30.00 on Serper.
Reviewed by Eugene SuslovFacts read November 2026No affiliate links

- 15
- search providers compared
- 4
- return page text, not just snippets
- 11
- ship an official MCP server
- 9
- host a remote MCP endpoint
What an AI search API returns that a SERP API does not
Two kinds of product answer the same request here. Exa API, Tavily API, Brave Search API and Perplexity Search API are built for models: each answers from its own index or its own selection of sources, and returns text a model can read, either page text or query-relevant extracts. An AI search API like these is sold per request and does not tell you where a page ranks on Google.
The SERP APIs relay Google's results page: positions, titles, snippets, AI Overviews. That is what you want when the answer has to match what a person sees on Google, or when ranking itself is the data. A snippet is two lines, though, so an agent that must read the page needs a second step.
Every search provider on this page
15 providers: 4 built for agents and 11 SERP APIs that sell to agent builders. ScrapingBee, Apify, Zyte and Scrapfly also return Google results, but sell scraping first, so they are on the SERP API page instead.
Showing 8 of 15 APIs

DataForSEO
FeaturedBest for pay-as-you-go volume
Twelve pay-as-you-go APIs covering SERPs, keywords, backlinks, on-page and AI search. No subscription, no monthly minimum, and the per-request rates are the lowest of any full-stack provider here.
- SERP data from Google, Bing, Yahoo, Baidu, Naver, YouTube and Seznam
- Keyword volume and CPC sourced from the Google Ads API
- Backlink index with per-row billing
- SERP results
- Keywords & search volume
- Backlinks

Best documented SERP API
The most thoroughly documented SERP API, covering Google AI Mode and AI Overviews alongside dozens of engines. It indemnifies US scraping claims up to $2m from the Production plan, and is itself in court with Google.
- Dozens of engines including Google AI Mode and AI Overview
- Legal indemnification up to $2m on Production and above
- Throughput measured per hour, not per second
- SERP results
- Local & maps
- Content & SERP features

Cheapest credible SERP data
Prepaid Google search credits with sub-two-second responses and no subscription. The cheapest credible SERP data here at volume, though the entry rate is $1 per 1,000, not the headline $0.30.
- Search, Images, News, Maps, Places, Videos, Shopping, Scholar
- Prepaid credit packs, no monthly commitment
- Credits deducted only on successful responses
- SERP results
- Local & maps
- Content & SERP features

Best for hard geotargeting
SERP data on top of the largest commercial proxy network, with unlimited concurrency and parsed JSON for Google and Bing. You pay only for successful requests, and there is no indemnity.
- Parsed JSON for Google and its verticals, and for Bing
- Unlimited concurrency, sub-second responses claimed
- Proxy management, CAPTCHA solving and rendering included
- SERP results
- Local & maps
- Content & SERP features

Best structured SERP parsing
Structured SERP parsing on a monthly plan whose fee becomes credit, spent at a per-target rate. Google is $1.00 per 1,000 results on the $15 Starter plan, falling to $0.50 at Enterprise.
- Per-target pricing: Google rated separately from other sites
- Monthly plans from $15, spent as credit at per-target rates
- JavaScript rendering priced as a separate, higher rate
- SERP results
- Local & maps
- Content & SERP features

Best bulk SERP value
Monthly credit packs for Google SERPs with rate limits measured per minute rather than per second. Reasonable at volume, and the entry rate is $2.24 per 1,000 on monthly billing, not the advertised $0.50.
- Real-time Google SERPs in JSON, HTML or CSV
- Rate limits from 250 to 1,500 requests a minute
- Follows links from the initial SERP at no extra cost
- SERP results
- Local & maps
- Content & SERP features

Best budget multi-engine SERP API
A budget SERP API with dedicated endpoints for Google and its AI Overviews and AI Mode, plus Bing, Baidu, Yahoo and DuckDuckGo. Plans start at $40 a month, and only Standard and above carry unused credits over.
- Google Search API plus AI Overview and AI Mode endpoints
- Bing, Baidu, Yahoo, DuckDuckGo and YouTube endpoints
- LinkedIn, Amazon and general web scraping
- SERP results
- Content & SERP features
- AI search & LLM visibility

Best for page-heavy scraping
A scraping API where the destination sets the price: an ordinary page is 1 credit and any Google or Bing request is 25. Generous for page fetching, costly for SERP volume, with structured Google and AI answer endpoints.
- Structured Google Search, News, Jobs, Shopping and Maps
- ChatGPT, Perplexity, Gemini and AI Mode answers as JSON
- Credits priced by domain: 1 a page, 25 for Google
- SERP results
- Content & SERP features
- Technical & on-page

Best AI engine coverage
A SERP API that covers ChatGPT Search and Perplexity alongside Google, Bing and a long list of other engines, which makes it one of the more practical ways to monitor AI answer engines through a normal search endpoint.
- Google, Bing, YouTube, ChatGPT Search and Perplexity
- Structured JSON across every engine
- AI engine results through a standard SERP interface
- SERP results
- AI search & LLM visibility
- Content & SERP features

Best for very large batches
ValueSERP's sibling from Traject Data, with more Google search types (Scholar, Autocomplete, Places detail) and a batch endpoint. It costs more per search than ValueSERP at every volume we can compare.
- Google search, news, places, shopping, images and Scholar
- Batch endpoint built for large keyword sets
- AI Overviews via a parameter on web search
- SERP results
- Local & maps
- Content & SERP features

Simplest plan structure
A straightforward SERP API with a small free tier and simple search-count plans: $49.99 buys 25,000 searches. Nothing unusual, which is occasionally the point.
- Google, Bing and Yandex results
- Image, news, shopping, maps, Trending Now and AI Overview endpoints
- Location and device targeting
- SERP results
- Local & maps
- Content & SERP features

Best for semantic discovery
A search engine for AI with its own index, sold per request in dollars. $4 (lite) or $7 (auto) per 1,000 searches includes page content for ten results, and asking for more results is what raises the bill.
- Own web index plus people, company and publication indexes
- Text and highlights for ten results inside the base price
- Search, Contents, Answer, Monitors and Agent endpoints
- Content & SERP features
- Competitor & traffic

Best for crawl and extract pipelines
A web access API for AI agents covering search, extract, map, crawl and research, billed in credits. One credit buys a basic search, five extracted pages or ten mapped URLs.
- Search, Extract, Map, Crawl and Research endpoints
- Cleaned, chunked page content rather than bare links
- Official remote MCP server plus a keyless mode
- Content & SERP features
- Competitor & traffic
Best for grounding from an independent index
Web search from Brave's own index, sold as prepaid credits at $5 per 1,000 requests. The same price buys a results page or LLM Context, which returns extracted page text sized to a token budget.
- Own web index, with no fallback to Google or Bing, Brave says
- LLM Context endpoint returns extracted page chunks, not just links
- Web, news, image, video and place search on one key
- Content & SERP features
- Local & maps
- Competitor & traffic
Best for high-volume agent search loops
Ranked web results from Perplexity's index as JSON, each with text extracted from the page for your query. $5 per 1,000 requests, $1 on Fast Search, and one request can carry five queries.
- Query-relevant page text in every result, no model in the loop
- Up to five queries per request, billed once
- Fast Search at $1 per 1,000 requests
- Content & SERP features
- Competitor & traffic
What a month of agent searches costs
Set how much work the agent does. Tick the box if the model reads pages rather than snippets.
30,000 searches a month
- 1Serper50k pack + overage · Google results page; snippets only$30.00
- 2Bright Data SERP APIPay as you go · Google results page; snippets only$45.00
- 3DataForSEOPay as you go · Live mode, results in seconds; snippets only$60.00
- 4ValueSERPPay as you go · Google results page; snippets only$75.00
- 5ScrapingdogStandard · Google results page; snippets only$90.00
- 6Oxylabs SERP Scraper APIBasic · Google results page; snippets only$100
- 7SearchApiProduction · Google results page; snippets only$100
- 8Exa APIPay as you go · Lite search, text for 10 results included; auto search $7 per 1,000$120
- 9ScraperAPIStartup · Google results page; snippets only$149
- 10ZenserpMedium · Google results page; snippets only$150
- 11Brave Search APIPay as you go · LLM Context returns page text at the search price$150
- 12Perplexity Search APIPay as you go · Query-relevant extracts; full page text $1 per 1,000 URLs$150
- 13Tavily APIStartup · Basic search, 1 credit; page text through Extract$220
- 14Scale SERP50,000 · Google results page; snippets only$249
- 15SerpApiBig Data · Google results page; snippets only$275
Monthly cost of the cheapest published route, before tax and before model tokens. Prices read in November 2026.
For snippets, the SERP APIs are the cheap end: Serper costs $30.00 for 30,000 searches a month. Once the model reads pages, only 4 providers price it in one place, from $120 on Exa API to $460 on Tavily API. Tavily API and Perplexity Search API charge for page text per URL, so the bill grows with every page the agent opens.
Tavily API is priced through its Extract endpoint here. Its search can also return raw page content, and its credit page prices search by depth alone, but the docs never say that content is free, so we did not assume it.
Whose results, what text, which MCP server
The three questions an agent builder asks first, provider by provider.
| Provider | Results from | Page text | Official MCP server |
|---|---|---|---|
| DataForSEO | Google's results page | Separate On-Page endpoint returns Markdown | Yeshosted at mcp.dataforseo.com |
| SerpApi | Google's results page | Separate Extract API returns Markdown | Yeshosted at mcp.serpapi.com |
| Serper | Google's results page | Snippets only | None found |
| Bright Data SERP API | Google's results page | Web Unlocker returns Markdown on the same account | Yeshosted at mcp.brightdata.com |
| Oxylabs SERP Scraper API | Google's results page | AI Studio search can return Markdown per result | Yeshosted at mcp.oxylabs.io |
| ValueSERP | Google's results page | Snippets only | None found |
| Scrapingdog | Google's results page | Scraping API returns Markdown on the same key | Yesrun locally |
| ScraperAPI | Google's results page | Scraper endpoint returns Markdown on the same key | Yeshosted at mcp.scraperapi.com |
| SearchApi | Google's results page | Scrape API in beta, on request | Yeshosted at searchapi.io/mcp |
| Scale SERP | Google's results page | Snippets only | None found |
| Zenserp | Google's results page | Snippets only | None found |
| Exa API | Exa's own index | Included at the search price | Yeshosted at mcp.exa.ai |
| Tavily API | Tavily's own selection of sources | Per URL, $1.60 per 1,000 | Yeshosted at mcp.tavily.com |
| Brave Search API | Brave's own index | Included at the search price | Yesrun locally |
| Perplexity Search API | Perplexity's own index | Per URL, $1.00 per 1,000 | Yeshosted at api.perplexity.ai/mcp |
Read from each vendor's docs on 20 November 2026. "Official" means a vendor-owned repository or the vendor's own docs.
The split in the second column matters more than it looks. A SERP API is a search engine API in the strict sense: it reports Google's ranking as it stands. Exa API, Tavily API, Brave Search API and Perplexity Search API answer from their own retrieval, so two of them can return different sources for the same question, and neither will match Google.
Web search MCP and Google search MCP servers
An MCP server lets an AI client call the search without code. It bills like the API behind it.
Of the 15 providers here, 11 ship an official web search MCP server, and 9 host a remote endpoint you can point a client at with only a key. Scrapingdog and Brave Search API run locally. We found no official server for Serper, ValueSERP, Scale SERP and Zenserp.
People searching for a Google search MCP usually want Google's results inside Claude or Cursor. The servers that do that are run by SERP API vendors, DataForSEO, SerpApi, Bright Data SERP API, Oxylabs SERP Scraper API, Scrapingdog, ScraperAPI and SearchApi among them, each calling its own API. Google's route for its own models is Grounding with Google Search, a Gemini feature rather than an MCP server, and its terms forbid storing the links.
What the terms let your agent keep
Storing results, caching them or training on them is a license question, not a technical one.
“store, cache, or create a database of Search Results, in whole or in part, other than transient storage required for operation of Customer Applications”
Brave Search API Terms of Use (1 September 2026), on what a customer shall not do
Brave Search API's self-serve terms also bar using results to train, fine-tune or benchmark models. Brave's FAQ says storage and training rights come with a custom plan, which has no published price.
Perplexity Search API runs the other way: its Search Addendum lets Perplexity "retain, copy, distribute and otherwise use" your queries and the results, and the zero-data-retention commitment made for its other APIs does not apply to search. Fine for public questions; check it before sending customer data.
Read the terms of whichever provider you shortlist with the same question: may we keep what comes back, and what happens to what we send?
Free web search API allowances
Enough to build and test an agent; none of them runs one in production.
| Provider | Free searches | How often | Card |
|---|---|---|---|
| Bright Data SERP API | 5,000 | Every month | Not required |
| Oxylabs SERP Scraper API | 5,000 | Once | Not required |
| Serper | 2,500 | Once | Not required |
| Exa API | 2,500 | Every month | Not required |
| Tavily API | 1,000 | Every month | Not required |
| Brave Search API | 1,000 | Every month | Required |
| SerpApi | 250 | Every month | Not required |
| Scale SERP | 125 | Every month | Not required |
| SearchApi | 100 | Once | Not required |
| Zenserp | 50 | Every month | Not required |
| ScraperAPI | 40 | Every month | Not required |
| Scrapingdog | 10 | Once | Not required |
Credit allowances converted to basic searches at each vendor's own rate. Read in November 2026.
A free web search API allowance that resets monthly is the useful kind for an agent in development. Exa API, Tavily API and Brave Search API reset every month among the providers built for agents; Perplexity Search API publishes no free tier.
Choosing a search API for AI agents
Four questions, in the order they rule providers out.
- 01Does the model read pages, or only snippets?If it reads pages, start with the providers that return page text in the call; it saves a scraping step and a second bill.
- 02Must the answer match Google?A SERP API is the only way to see what Google ranks. A search API for LLM grounding answers from its own index, which is fine for most questions.
- 03May you keep the results?Caching, storing and training are licensed separately on some providers. Read the terms before you design the cache.
- 04MCP, SDK or plain HTTP?A hosted MCP endpoint is the fastest way into Claude, Cursor or an agent framework; the bill is the same as the API.
Many agents use two providers: a web search API for LLM reading, and a search engine API that relays Google to check what people actually see. If you want one web search API for AI work that covers both, test it on both jobs before you commit.
Where to go from here
- Cheapest SERP APIs13 providers, 11 of them also on this page.
- Google News APIs12 providers, 11 of them also on this page.
- Google Search APIs13 providers, 11 of them also on this page.
- Content automationWhere search APIs feed research and drafting workflows.
- Our LLM visibility trackerThe other side: what AI answers say about you.
Web search APIs, answered
Which search API for AI agents is cheapest when the agent reads the pages?
At 30,000 searches a month with 5 pages of text each, Exa API costs $120, then Brave Search API $150, Perplexity Search API $300, Tavily API $460. The SERP APIs are cheaper per search but return snippets only from the search call.Do Tavily and Exa use Google's search results?
No. Exa says it runs its own web index. Tavily returns its own relevance-ranked selection of sources and does not say which index supplies them. Neither reports Google positions.Can I store results from the Brave Search API?
Not on the self-serve plans: the terms allow only transient storage and forbid training on results. Brave says storage rights come with a custom plan, priced by its sales team.Is the Perplexity Search API the same as Sonar?
No. The Search API returns ranked results with extracts, billed per request with no token charges. Sonar was Perplexity's answer API; its chat completions became the Agent API, and Perplexity says Sonar support ended on 27 September 2026.What is the difference between a SERP API and an AI search API for agents?
A SERP API returns Google's results page as data: positions, snippets and features. An AI search API returns sources chosen by its own retrieval with text a model can read. The first tells you what Google shows; the second gives the model something to read.
Picking the provider is the easy half.
busyless runs content and search as a system: we choose the data sources and tools, build the pipelines on top, and measure what they feed. If that is the part you are missing, talk to us.
Ask an assistant about this page
An independent comparison. No provider pays to be listed or to rank higher, outbound links carry nofollow, and we earn nothing if you sign up. Prices and terms were read from each vendor's own pages in November 2026 and change without notice.
Missing, or out of date?
Every entry here was read off the company's own website and dated, so some of it will have moved since. Corrections are free and so is being added. There is no fee, no sponsored position, and nothing that money moves up this page.