Skip to content

ScrapeNest Documentation

ScrapeNest is a scraping API for teams that need reliable web data collection at scale. Submit a job, choose the right execution tier, and get back artifacts: rendered HTML, screenshots, extracted JSON, network traces, and execution metadata.

The platform handles the hard parts of production scraping: fast HTTP collection, browser rendering, fingerprint control, proxy routing, retries, webhooks, retention, and auditability.

What You Can Build

  • High-volume HTTP scraping with TLS/HTTP impersonation for APIs, static pages, and catalog pages.
  • Rendered browser scraping for JavaScript apps, dashboards, dynamic listings, and pages that require interactions.
  • Advanced anti-blocking workflows with managed proxies, browser fingerprint controls, OS profiles, extensions, and session stickiness.
  • Structured extraction pipelines that return JSON directly from CSS selectors, regular expressions, or JSONPath.
  • Production integrations with API keys, scopes, idempotency, webhooks, rate limits, artifacts, retention, and observability.

Scrape a page in five lines

from scrapenest import ScrapeNestClient

client = ScrapeNestClient(api_key="sn_live_...", base_url="https://api.scrapenest.com")
result = client.scrape(job_type="light", target_url="https://example.com")

print(result.status, result.artifact_count)

pip install scrapenest-sdk and you're ready. Prefer raw HTTP? The guides show equivalent curl payloads.

Start Here

  1. Quickstart - submit a job, wait for completion, and download the result.
  2. Worker Tiers - choose light, standard, or stealth.
  3. Extract structured data - return JSON instead of parsing HTML yourself.
  4. Anti-blocking guide - tune protected-target jobs with Stealth, proxies, and fingerprints.
  5. API Reference - every endpoint, parameter, and response schema.

Production Topics