Start Crawl Job
Start an asynchronous multi-page crawl job
POST
3 credits
/v1/scrape/crawl
curl -X POST "https://scrape.toolkitapi.io/v1/scrape/crawl" \
-H "Content-Type: application/json" \
-H "X-API-Key: YOUR_KEY" \
-d '{"url":"https://toolkitapi.io","max_pages":25}'
import httpx
resp = httpx.post(
"https://scrape.toolkitapi.io/v1/scrape/crawl",
json={"url":"https://toolkitapi.io","max_pages":25},
)
print(resp.json())
const resp = await fetch("https://scrape.toolkitapi.io/v1/scrape/crawl", {
method: "POST",
headers: {
"Content-Type": "application/json",
},
body: JSON.stringify({"url":"https://toolkitapi.io","max_pages":25}),
});
const data = await resp.json();
console.log(data);
# See curl example
Response
200 OK
{
"job_id": "crawl_abc123",
"status": "queued"
}
Try It Live
Live Demo
Response
Description
Start an asynchronous multi-page crawl job
How to Use
1
1. POST crawl settings to `/v1/scrape/crawl`. 2. Poll crawl status using the returned `job_id`.
About This Tool
Queues a crawl and returns a job identifier for progress polling.
Start using Start Crawl Job now
Get your free API key and make your first request in under a minute.