Sitemap Parser
Fetch and parse sitemap XML using the current scrape sitemap endpoint
GET
/v1/scrape/sitemap
Description
Fetch and parse sitemap XML using the current scrape sitemap endpoint
Parameters
| Name | Type | Required | Description |
|---|---|---|---|
| url | string | required | The sitemap.xml URL |
| limit | integer | optional | Max URLs to return |
| discover_links | boolean | optional | Also scrape landing page for links |
| x-api-key | string | optional |
How to Use
1
1. Pass the sitemap URL in the `url` query parameter. 2. Optionally set `limit` to cap the number of returned entries. 3. Use `discover_links=true` if you want the endpoint to also check the landing page for same-domain links.
About This Tool
Use the sitemap endpoint to discover URLs from a sitemap or sitemap index without scraping page bodies individually.
This is a useful starting point for crawlers, audits, migration projects, and content inventories.
Why Use This Tool
- Crawl seeding — Build a URL inventory quickly
- SEO diagnostics — Inspect published sitemap coverage
- Migration work — Export structured site URL lists
- Change monitoring — Watch `lastmod` values over time
Frequently Asked Questions
Does it support sitemap index files?
Yes — child sitemap references are included in the response when present.
Is this a page scraper?
No. This endpoint is focused on sitemap discovery and parsing rather than content extraction.
Can I use the results with crawl jobs?
Yes. Sitemap results pair well with the crawl endpoint or the unified scrape endpoint for follow-up processing.
Start using Sitemap Parser now
Get your free API key and make your first request in under a minute.