ScrapeDrive

Introduction

Get up and running with the ScrapeDrive API

ScrapeDrive

ScrapeDrive is a web scraping API. Send a URL, get back the page content. It handles proxies, JavaScript rendering, anti-bot detection, and CAPTCHAs for you.


Your First Scrape

curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com"

That's it. The response body is the raw HTML of the page — no JSON wrapper, just the content.

The api_key parameter authenticates your request. Get yours from the ScrapeDrive dashboard.

Keep your API key secret. Never expose it in client-side code or public repositories.


Choosing an Output Format

By default you get raw HTML. You can also get plain text or markdown:

# Just the visible text, no markup
curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com&result_type=page_text"
result_typeWhat you get
htmlRaw HTML source (default)
page_textVisible text only, no markup
page_markdownHTML converted to markdown

JavaScript Rendering

By default, ScrapeDrive uses a headless browser with full JavaScript execution. This means SPAs, client-rendered content, and dynamic pages all work out of the box.

If the page you're scraping is static HTML (no client-side rendering), you can skip the browser for a faster response:

curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com&render_js=false"

You can also choose which device to emulate:

curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com&device_type=mobile"
device_typeViewportUser Agent
desktop1920x1080Chrome (default)
mobile390x844Safari mobile

Taking Screenshots

Capture the page as a PNG. You get back a screenshot_url — a signed URL valid for 24 hours.

curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com&screenshot=true"

Screenshots automatically enable JavaScript rendering and disable resource blocking.


Using Proxies

ScrapeDrive routes every request through a proxy. You choose the tier based on how aggressive the target site's anti-bot measures are:

TierWhat it doesWhen to use it
standardDatacenter proxiesMost sites. Fast and cheap. Default.
advancedResidential proxies + geo-targetingSites that block datacenter IPs.
hyperdriveResidential + human behavior + CAPTCHA solvingThe hardest sites.
curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://tough-site.com&scrape_tier=hyperdrive"

Geo-Targeting

Route through a specific country. Requires advanced or hyperdrive tier.

curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com&scrape_tier=advanced&country_code=US"

Sticky Sessions

Keep the same proxy IP across multiple requests with session_number:

curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com/page/1&session_number=42"
curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com/page/2&session_number=42"

Custom Proxy

Bring your own proxy. Overrides the tier settings.

curl "https://sync.scrapedrive.com/api/v1/scrape?api_key=YOUR_KEY&url=https://example.com&custom_proxy=http://user:pass@proxy.example.com:8080"

What's Next

  • Sync vs Async — When to use each mode, and how the async polling flow works
  • Advanced Options — Wait strategies, header forwarding, resource blocking, and timeout configuration
  • API Reference — Every parameter in one table, plus error codes

On this page