Sitemap Explorer

The Sitemap Explorer discovers the URLs a site publishes in its sitemaps — up to 50,000 of them — so you can select exactly the pages you want and hand them to the Page Extractor, or export them as a CSV.

📸The sitemap tree with URL groups expanded and checkboxes selectedScreenshot coming soon

How discovery works

The scan runs entirely locally, inside your active tab, using your own browser session — which helps get past bot protection, and means nothing leaves your machine.

1. It finds the site's sitemaps automatically, checking the common places sites publish them. You can also paste a known sitemap URL from the same site.
2. Sitemap indexes are walked recursively (up to 5 levels deep), and compressed .gz sitemaps are decompressed on the fly.
3. URLs are deduplicated, normalized, and organized into a tree grouped by URL path — so /collections/shoes pages become their own branch you can select in one click.

Switching to a different site in your browser automatically rescans the new site.

Selecting URLs

• Tri-state checkboxes let you select a whole group or subtree, then carve out branches you don't want.
• Search across the tree (multi-word), with matches auto-expanded; "Select all", "Select matches", and "Clear" shortcuts; a live count of selected URLs.
• Stop early, keep results. You can stop a scan at any point and work with what's been found so far.

Limits

A single scan collects up to 50,000 URLs (results beyond that are marked "capped"). Sitemap indexes are followed several levels deep, so large multi-sitemap sites are covered in one pass.

What to do with the results

• Continue hands the selected URLs directly to the Page Extractor to extract data from each page.
• Export CSV downloads the selected URLs as a one-column CSV — useful for any other workflow.

Related