Search

Yahoo Search Scraper

search.yahoo.com

Yahoo Search serves Bing's index on its own results page, with its own ad slots and a regional site for many countries, so where a page ranks and which ads show on Yahoo is worth tracking on its own. A dedicated plugin endpoint takes a keyword and returns the results page already parsed: organic results with position, title, URL, displayed URL, domain and description, top and bottom ads in their own lists, and related searches. proxy_country picks the regional Yahoo site (de.search.yahoo.com for DE, uk.search.yahoo.com for GB) and the exit the page is rendered through in a real browser, so the ads are the ones a searcher in that country sees, and a page that comes back degraded is rendered again. The response has the same shape as our Google /serpApi endpoint, so one pipeline handles every engine.

What you can extract

• Organic results with position, title, URL, displayed URL, domain and description
• Top and bottom ads as separate lists, with the advertiser's domain
• Destination URLs decoded from Yahoo's r.search.yahoo.com redirect links
• Related searches
• Yahoo's regional sites, picked by proxy_country (e.g. de.search.yahoo.com, uk.search.yahoo.com)
• An optional language filter that keeps only results in that language
• Up to 10 result pages per call, about 7 organic results each, with pagesChecked and hasMore

Dedicated endpoints

How to scrape it

curl -X POST \
  -H "X-ScrapeUnblocker-Key: $SU_API_KEY" \
  "https://api.scrapeunblocker.com/search/yahoo?keyword=car%20insurance&pages_to_check=1&proxy_country=US"

import requests

resp = requests.post(
    "https://api.scrapeunblocker.com/search/yahoo",
    headers={"X-ScrapeUnblocker-Key": SU_API_KEY},
    params={"keyword": "car insurance", "pages_to_check": "1", "proxy_country": "US"},
)
print(resp.text)

import { ScrapeUnblockerClient } from 'scrapeunblocker';

const su = new ScrapeUnblockerClient({ apiKey: process.env.SU_API_KEY });

const results = await su.yahooSearch('car insurance', {
  pagesToCheck: 1,
  proxyCountry: 'US',
});
console.log(results);

Requests are POST and take their parameters in the query string. Browser rendering always happens - there is no flag to enable.

Example response

{
  "engine": "yahoo",
  "keyword": "car insurance",
  "country": "US",
  "language": "en",
  "totalResults": null,
  "resultsCollected": 17,
  "topAdsCount": 7,
  "bottomAdsCount": 3,
  "organicResultsCount": 7,
  "topAds": [
    {
      "position": 1,
      "title": "10 Best Auto Insurance Quotes - Lowest Rates in 2 Minutes",
      "url": "https://compare-auto-insurance-quotes.com/?pubcampaignid=7375&term=auto-quote&...",
      "displayedUrl": "compare-auto-insurance-quotes.com",
      "domain": "compare-auto-insurance-quotes.com",
      "description": "Compare the 10 Best Auto Insurance Quotes for Sep 27, 2026. Full Coverage from $34/Month..."
    }
  ],
  "bottomAds": [
    {
      "position": 2,
      "title": "GEICO® Official Site - Get a Free GEICO® Quote Today",
      "url": "https://ad.doubleclick.net/searchads/link/click?lid=43700084044715111&...",
      "displayedUrl": "www.geico.com",
      "domain": "geico.com",
      "description": "GEICO® was Named the Best Car Insurance Company for 2026-2027. Get a Free Quote Today..."
    }
  ],
  "organic": [
    {
      "position": 1,
      "title": "Cheapest Car Insurance Quotes in Springfield, MA, for 2026...",
      "url": "https://insurify.com/car-insurance/massachusetts/springfield/",
      "displayedUrl": "https://insurify.com › car-insurance › massachusetts",
      "domain": "insurify.com",
      "description": "21 hours ago · Compare the cheapest car insurance quotes in Springfield from GEICO, Allstate, Travelers, and more..."
    }
  ],
  "relatedSearches": ["car insurance quotes", "hagerty insurance classic car insurance", "car insurance companies"],
  "pagesChecked": 1,
  "hasMore": true
}

Read the API docs

Frequently asked questions

Related scrapers