🗺️

Start Crawl Job

Start an asynchronous multi-page crawl job

POST 3 credits /v1/scrape/crawl
curl -X POST "https://scrape.toolkitapi.io/v1/scrape/crawl" \
  -H "Content-Type: application/json" \
  -H "X-API-Key: YOUR_KEY" \
  -d '{"url":"https://toolkitapi.io","max_pages":25}'
import httpx

resp = httpx.post(
    "https://scrape.toolkitapi.io/v1/scrape/crawl",
    json={"url":"https://toolkitapi.io","max_pages":25},
)
print(resp.json())
const resp = await fetch("https://scrape.toolkitapi.io/v1/scrape/crawl", {
  method: "POST",
  headers: {
    "Content-Type": "application/json",
  },
  body: JSON.stringify({"url":"https://toolkitapi.io","max_pages":25}),
});
const data = await resp.json();
console.log(data);
# See curl example
Response 200 OK
{
  "job_id": "crawl_abc123",
  "status": "queued"
}

Try It Live

Live Demo

Description

Start an asynchronous multi-page crawl job

How to Use

1

1. POST crawl settings to `/v1/scrape/crawl`. 2. Poll crawl status using the returned `job_id`.

About This Tool

Queues a crawl and returns a job identifier for progress polling.

Start using Start Crawl Job now

Get your free API key and make your first request in under a minute.