CRAWL DISCOVERY

Robots.txt & Sitemap Finder

Find a site robots.txt file, extract declared sitemap URLs and check common sitemap locations.

FreeNo signupTransparent results
01

Enter the details

The tool only uses the information needed for this check.

02
RESULT

Review the result

Enter the details, then run the check.

Ready.

WHAT IT CHECKS

Check crawl discovery files

The server requests /robots.txt and a small set of common sitemap locations, then extracts Sitemap directives from robots.txt.

LIMITS

What the result does not prove

A sitemap being present does not prove every URL is canonical, indexable or indexed. Some sites use nonstandard sitemap paths or dynamically generated discovery.

Use the result in context

No single SEO or performance metric decides rankings. Use the output to identify a specific technical or content issue, then verify the deployed page and Search Console data where relevant.

Privacy and requests

Text-only tools run in your browser. Live URL tools send the public URL you enter to this website's read-only diagnostic endpoint so the server can fetch public data that browsers often cannot access directly.