Skip to content

Web search API for AI agents: page text, MCP and real cost

An agent needs a web search API that returns text the model can read, not only ten links. Exa API, Brave Search API, Perplexity Search API and Tavily API return page text in the call or on the same key; the SERP APIs return Google's results page with snippets and need a scraping step for the rest. At 30,000 searches a month, page text starts at $120 on Exa API, and snippets alone at $30.00 on Serper.

Reviewed by Eugene SuslovFacts read November 2026No affiliate links

15
search providers compared
4
return page text, not just snippets
11
ship an official MCP server
9
host a remote MCP endpoint

What an AI search API returns that a SERP API does not

Two kinds of product answer the same request here. Exa API, Tavily API, Brave Search API and Perplexity Search API are built for models: each answers from its own index or its own selection of sources, and returns text a model can read, either page text or query-relevant extracts. An AI search API like these is sold per request and does not tell you where a page ranks on Google.

The SERP APIs relay Google's results page: positions, titles, snippets, AI Overviews. That is what you want when the answer has to match what a person sees on Google, or when ranking itself is the data. A snippet is two lines, though, so an agent that must read the page needs a second step.

Every search provider on this page

15 providers: 4 built for agents and 11 SERP APIs that sell to agent builders. ScrapingBee, Apify, Zyte and Scrapfly also return Google results, but sell scraping first, so they are on the SERP API page instead.

Showing 8 of 15 APIs

DataForSEO

Featured

Best for pay-as-you-go volume

Twelve pay-as-you-go APIs covering SERPs, keywords, backlinks, on-page and AI search. No subscription, no monthly minimum, and the per-request rates are the lowest of any full-stack provider here.

  • SERP data from Google, Bing, Yahoo, Baidu, Naver, YouTube and Seznam
  • Keyword volume and CPC sourced from the Google Ads API
  • Backlink index with per-row billing
  • SERP results
  • Keywords & search volume
  • Backlinks
$0.0006 per SERPPay as you go

Best documented SERP API

The most thoroughly documented SERP API, covering Google AI Mode and AI Overviews alongside dozens of engines. It indemnifies US scraping claims up to $2m from the Production plan, and is itself in court with Google.

  • Dozens of engines including Google AI Mode and AI Overview
  • Legal indemnification up to $2m on Production and above
  • Throughput measured per hour, not per second
  • SERP results
  • Local & maps
  • Content & SERP features
$25/moSubscription

Cheapest credible SERP data

Prepaid Google search credits with sub-two-second responses and no subscription. The cheapest credible SERP data here at volume, though the entry rate is $1 per 1,000, not the headline $0.30.

  • Search, Images, News, Maps, Places, Videos, Shopping, Scholar
  • Prepaid credit packs, no monthly commitment
  • Credits deducted only on successful responses
  • SERP results
  • Local & maps
  • Content & SERP features
$1.00 per 1,000Credit packs · Pay as you go

Best for hard geotargeting

SERP data on top of the largest commercial proxy network, with unlimited concurrency and parsed JSON for Google and Bing. You pay only for successful requests, and there is no indemnity.

  • Parsed JSON for Google and its verticals, and for Bing
  • Unlimited concurrency, sub-second responses claimed
  • Proxy management, CAPTCHA solving and rendering included
  • SERP results
  • Local & maps
  • Content & SERP features
$1.50 per 1,000Pay as you go · Subscription

Best structured SERP parsing

Structured SERP parsing on a monthly plan whose fee becomes credit, spent at a per-target rate. Google is $1.00 per 1,000 results on the $15 Starter plan, falling to $0.50 at Enterprise.

  • Per-target pricing: Google rated separately from other sites
  • Monthly plans from $15, spent as credit at per-target rates
  • JavaScript rendering priced as a separate, higher rate
  • SERP results
  • Local & maps
  • Content & SERP features
$15/moSubscription · Credit packs

Best bulk SERP value

Monthly credit packs for Google SERPs with rate limits measured per minute rather than per second. Reasonable at volume, and the entry rate is $2.24 per 1,000 on monthly billing, not the advertised $0.50.

  • Real-time Google SERPs in JSON, HTML or CSV
  • Rate limits from 250 to 1,500 requests a minute
  • Follows links from the initial SERP at no extra cost
  • SERP results
  • Local & maps
  • Content & SERP features
$2.24 per 1,000Subscription · Credit packs · Pay as you go

Best budget multi-engine SERP API

A budget SERP API with dedicated endpoints for Google and its AI Overviews and AI Mode, plus Bing, Baidu, Yahoo and DuckDuckGo. Plans start at $40 a month, and only Standard and above carry unused credits over.

  • Google Search API plus AI Overview and AI Mode endpoints
  • Bing, Baidu, Yahoo, DuckDuckGo and YouTube endpoints
  • LinkedIn, Amazon and general web scraping
  • SERP results
  • Content & SERP features
  • AI search & LLM visibility
$40/moSubscription · Credit packs

Best for page-heavy scraping

A scraping API where the destination sets the price: an ordinary page is 1 credit and any Google or Bing request is 25. Generous for page fetching, costly for SERP volume, with structured Google and AI answer endpoints.

  • Structured Google Search, News, Jobs, Shopping and Maps
  • ChatGPT, Perplexity, Gemini and AI Mode answers as JSON
  • Credits priced by domain: 1 a page, 25 for Google
  • SERP results
  • Content & SERP features
  • Technical & on-page
$49/moSubscription · Credit packs

What a month of agent searches costs

Set how much work the agent does. Tick the box if the model reads pages rather than snippets.

Agent tasks a month
Searches per task

30,000 searches a month

  1. 1Serper50k pack + overage · Google results page; snippets only$30.00
  2. 2Bright Data SERP APIPay as you go · Google results page; snippets only$45.00
  3. 3DataForSEOPay as you go · Live mode, results in seconds; snippets only$60.00
  4. 4ValueSERPPay as you go · Google results page; snippets only$75.00
  5. 5ScrapingdogStandard · Google results page; snippets only$90.00
  6. 6Oxylabs SERP Scraper APIBasic · Google results page; snippets only$100
  7. 7SearchApiProduction · Google results page; snippets only$100
  8. 8Exa APIPay as you go · Lite search, text for 10 results included; auto search $7 per 1,000$120
  9. 9ScraperAPIStartup · Google results page; snippets only$149
  10. 10ZenserpMedium · Google results page; snippets only$150
  11. 11Brave Search APIPay as you go · LLM Context returns page text at the search price$150
  12. 12Perplexity Search APIPay as you go · Query-relevant extracts; full page text $1 per 1,000 URLs$150
  13. 13Tavily APIStartup · Basic search, 1 credit; page text through Extract$220
  14. 14Scale SERP50,000 · Google results page; snippets only$249
  15. 15SerpApiBig Data · Google results page; snippets only$275

Monthly cost of the cheapest published route, before tax and before model tokens. Prices read in November 2026.

For snippets, the SERP APIs are the cheap end: Serper costs $30.00 for 30,000 searches a month. Once the model reads pages, only 4 providers price it in one place, from $120 on Exa API to $460 on Tavily API. Tavily API and Perplexity Search API charge for page text per URL, so the bill grows with every page the agent opens.

Tavily API is priced through its Extract endpoint here. Its search can also return raw page content, and its credit page prices search by depth alone, but the docs never say that content is free, so we did not assume it.

Whose results, what text, which MCP server

The three questions an agent builder asks first, provider by provider.

15 providers
ProviderResults fromPage textOfficial MCP server
DataForSEOGoogle's results pageSeparate On-Page endpoint returns MarkdownYeshosted at mcp.dataforseo.com
SerpApiGoogle's results pageSeparate Extract API returns MarkdownYeshosted at mcp.serpapi.com
SerperGoogle's results pageSnippets onlyNone found
Bright Data SERP APIGoogle's results pageWeb Unlocker returns Markdown on the same accountYeshosted at mcp.brightdata.com
Oxylabs SERP Scraper APIGoogle's results pageAI Studio search can return Markdown per resultYeshosted at mcp.oxylabs.io
ValueSERPGoogle's results pageSnippets onlyNone found
ScrapingdogGoogle's results pageScraping API returns Markdown on the same keyYesrun locally
ScraperAPIGoogle's results pageScraper endpoint returns Markdown on the same keyYeshosted at mcp.scraperapi.com
SearchApiGoogle's results pageScrape API in beta, on requestYeshosted at searchapi.io/mcp
Scale SERPGoogle's results pageSnippets onlyNone found
ZenserpGoogle's results pageSnippets onlyNone found
Exa APIExa's own indexIncluded at the search priceYeshosted at mcp.exa.ai
Tavily APITavily's own selection of sourcesPer URL, $1.60 per 1,000Yeshosted at mcp.tavily.com
Brave Search APIBrave's own indexIncluded at the search priceYesrun locally
Perplexity Search APIPerplexity's own indexPer URL, $1.00 per 1,000Yeshosted at api.perplexity.ai/mcp

Read from each vendor's docs on 20 November 2026. "Official" means a vendor-owned repository or the vendor's own docs.

The split in the second column matters more than it looks. A SERP API is a search engine API in the strict sense: it reports Google's ranking as it stands. Exa API, Tavily API, Brave Search API and Perplexity Search API answer from their own retrieval, so two of them can return different sources for the same question, and neither will match Google.

Web search MCP and Google search MCP servers

An MCP server lets an AI client call the search without code. It bills like the API behind it.

Of the 15 providers here, 11 ship an official web search MCP server, and 9 host a remote endpoint you can point a client at with only a key. Scrapingdog and Brave Search API run locally. We found no official server for Serper, ValueSERP, Scale SERP and Zenserp.

People searching for a Google search MCP usually want Google's results inside Claude or Cursor. The servers that do that are run by SERP API vendors, DataForSEO, SerpApi, Bright Data SERP API, Oxylabs SERP Scraper API, Scrapingdog, ScraperAPI and SearchApi among them, each calling its own API. Google's route for its own models is Grounding with Google Search, a Gemini feature rather than an MCP server, and its terms forbid storing the links.

What the terms let your agent keep

Storing results, caching them or training on them is a license question, not a technical one.

“store, cache, or create a database of Search Results, in whole or in part, other than transient storage required for operation of Customer Applications”

Brave Search API Terms of Use (1 September 2026), on what a customer shall not do

Brave Search API's self-serve terms also bar using results to train, fine-tune or benchmark models. Brave's FAQ says storage and training rights come with a custom plan, which has no published price.

Perplexity Search API runs the other way: its Search Addendum lets Perplexity "retain, copy, distribute and otherwise use" your queries and the results, and the zero-data-retention commitment made for its other APIs does not apply to search. Fine for public questions; check it before sending customer data.

Read the terms of whichever provider you shortlist with the same question: may we keep what comes back, and what happens to what we send?

Free web search API allowances

Enough to build and test an agent; none of them runs one in production.

12 providers
ProviderFree searchesHow oftenCard
Bright Data SERP API5,000Every monthNot required
Oxylabs SERP Scraper API5,000OnceNot required
Serper2,500OnceNot required
Exa API2,500Every monthNot required
Tavily API1,000Every monthNot required
Brave Search API1,000Every monthRequired
SerpApi250Every monthNot required
Scale SERP125Every monthNot required
SearchApi100OnceNot required
Zenserp50Every monthNot required
ScraperAPI40Every monthNot required
Scrapingdog10OnceNot required

Credit allowances converted to basic searches at each vendor's own rate. Read in November 2026.

A free web search API allowance that resets monthly is the useful kind for an agent in development. Exa API, Tavily API and Brave Search API reset every month among the providers built for agents; Perplexity Search API publishes no free tier.

Choosing a search API for AI agents

Four questions, in the order they rule providers out.

  1. 01Does the model read pages, or only snippets?If it reads pages, start with the providers that return page text in the call; it saves a scraping step and a second bill.
  2. 02Must the answer match Google?A SERP API is the only way to see what Google ranks. A search API for LLM grounding answers from its own index, which is fine for most questions.
  3. 03May you keep the results?Caching, storing and training are licensed separately on some providers. Read the terms before you design the cache.
  4. 04MCP, SDK or plain HTTP?A hosted MCP endpoint is the fastest way into Claude, Cursor or an agent framework; the bill is the same as the API.

Many agents use two providers: a web search API for LLM reading, and a search engine API that relays Google to check what people actually see. If you want one web search API for AI work that covers both, test it on both jobs before you commit.

Web search APIs, answered

  • Which search API for AI agents is cheapest when the agent reads the pages?
    At 30,000 searches a month with 5 pages of text each, Exa API costs $120, then Brave Search API $150, Perplexity Search API $300, Tavily API $460. The SERP APIs are cheaper per search but return snippets only from the search call.
  • Do Tavily and Exa use Google's search results?
    No. Exa says it runs its own web index. Tavily returns its own relevance-ranked selection of sources and does not say which index supplies them. Neither reports Google positions.
  • Can I store results from the Brave Search API?
    Not on the self-serve plans: the terms allow only transient storage and forbid training on results. Brave says storage rights come with a custom plan, priced by its sales team.
  • Is the Perplexity Search API the same as Sonar?
    No. The Search API returns ranked results with extracts, billed per request with no token charges. Sonar was Perplexity's answer API; its chat completions became the Agent API, and Perplexity says Sonar support ended on 27 September 2026.
  • What is the difference between a SERP API and an AI search API for agents?
    A SERP API returns Google's results page as data: positions, snippets and features. An AI search API returns sources chosen by its own retrieval with text a model can read. The first tells you what Google shows; the second gives the model something to read.

Picking the provider is the easy half.

busyless runs content and search as a system: we choose the data sources and tools, build the pipelines on top, and measure what they feed. If that is the part you are missing, talk to us.

Ask an assistant about this page

ChatGPTClaudePerplexity

For scripts and agents

Markdownllms.txt

MCP server: https://busyless.space/api/mcp

An independent comparison. No provider pays to be listed or to rank higher, outbound links carry nofollow, and we earn nothing if you sign up. Prices and terms were read from each vendor's own pages in November 2026 and change without notice.

Missing, or out of date?

Every entry here was read off the company's own website and dated, so some of it will have moved since. Corrections are free and so is being added. There is no fee, no sponsored position, and nothing that money moves up this page.