Build a robots.txt draft with sitemap and crawl exclusions.
Use the example inputs or enter your own values.
Your input is processed in this browser.
Build a robots.txt draft with sitemap and crawl exclusions. Creates a User-agent group, Disallow lines and an absolute Sitemap reference. Enter sitemap url, disallowed paths, one per line. Update the result, inspect it, then copy or download the output.
Creates a User-agent group, Disallow lines and an absolute Sitemap reference.
Enter sitemap url, disallowed paths, one per line. Update the result, inspect it, then copy or download the output. Reset restores the example inputs so you can start a new calculation.
Example inputs: Sitemap URL: https://example.com/sitemap.xml.
Robots.txt controls crawling, not privacy or guaranteed deindexing. A blocked URL can still appear in search. Review before replacing a live file.
No. This tool works in a modern browser with JavaScript enabled. Your inputs are not submitted to a server by the tool.
Use Copy for the textual result or Download for a local file. Image tools download a generated image when one is available.
No. It produces a result for you to review. Production changes remain a separate step.
Explore related tools for the next part of your website task, or discuss a project if you need help applying the result.
Discuss a project
