Search

DuckDuckGo Scraper

duckduckgo.com

DuckDuckGo builds its results page with JavaScript and challenges clients that are not a real browser, so scraping it yourself means running one. A dedicated plugin endpoint takes a keyword and returns the results already parsed: organic results with position, title, URL, displayed URL, domain and description, the first page's ads in top and bottom lists, and related searches. The first page is rendered in a real browser through an exit in the country you pick, so its ads load; further pages add organic results. The response has the same shape as our Google /serpApi endpoint, so one pipeline handles both engines.

What you can extract

• Organic results with position, title, URL, displayed URL, domain and description
• Top and bottom ads from the first results page, with the advertiser's domain
• Related searches
• Pages checked and a hasMore flag
• Region- and language-specific result sets (proxy_country + language)
• Up to 10 result pages of organic results per call

Dedicated endpoints

How to scrape it

curl -X POST \
  -H "X-ScrapeUnblocker-Key: $SU_API_KEY" \
  "https://api.scrapeunblocker.com/search/duckduckgo?keyword=car%20insurance&pages_to_check=1&proxy_country=US"

import requests

resp = requests.post(
    "https://api.scrapeunblocker.com/search/duckduckgo",
    headers={"X-ScrapeUnblocker-Key": SU_API_KEY},
    params={"keyword": "car insurance", "pages_to_check": "1", "proxy_country": "US"},
)
print(resp.text)

import { ScrapeUnblockerClient } from 'scrapeunblocker';

const su = new ScrapeUnblockerClient({ apiKey: process.env.SU_API_KEY });

const results = await su.duckduckgoSearch('car insurance', {
  pagesToCheck: 1,
  proxyCountry: 'US',
});
console.log(results);

Requests are POST and take their parameters in the query string. Browser rendering always happens - there is no flag to enable.

Example response

{
  "engine": "duckduckgo",
  "keyword": "car insurance",
  "country": "US",
  "language": "en",
  "totalResults": null,
  "resultsCollected": 14,
  "topAdsCount": 3,
  "bottomAdsCount": 1,
  "organicResultsCount": 10,
  "topAds": [
    {
      "position": 2,
      "title": "Side-By-Side Comparison - Car Insurance From $29/Mo",
      "url": "https://www.nerdwallet.com/m/insurance/auto-insurance/compare-quotes-control-29?...",
      "displayedUrl": "https://www.nerdwallet.com › insurance › car",
      "domain": "nerdwallet.com",
      "description": "Discover how much you could save on car insurance. Get multiple quotes in minutes!..."
    }
  ],
  "bottomAds": [
    {
      "position": 1,
      "title": "GEICO® Official Site - Get a Free GEICO® Quote Today",
      "url": "https://ad.doubleclick.net/searchads/link/click?lid=43700084044715165&...",
      "displayedUrl": "https://www.geico.com › Auto",
      "domain": "geico.com",
      "description": "Get a Free Quote Today. GEICO®'s Car Insurance Quotes Are Personalized For You..."
    }
  ],
  "organic": [
    {
      "position": 1,
      "title": "Cheapest Car Insurance in New York: Rates & Top Companies",
      "url": "https://insurify.com/car-insurance/new-york/",
      "displayedUrl": "https://insurify.com › car-insurance › new-york",
      "domain": "insurify.com",
      "description": "Compare the cheapest car insurance in New York for 2026, including average rates, top insurers..."
    }
  ],
  "relatedSearches": ["car insurance quotes online", "car insurance near me", "compare car insurance"],
  "pagesChecked": 1,
  "hasMore": true
}

Read the API docs

Frequently asked questions

Related scrapers