SEO Developer Tools

Practical SEO utilities for developers and website owners: robots.txt generation, XML sitemap checks, headers and redirect debugging.

All Tools Search Hub
SEO robots.txt Generator

Generate a clean robots.txt file for crawlers, staging blocks, sitemap discovery, and simple SEO crawl control.

Open tool Sitemap Sitemap Checker

Check pasted XML sitemaps for basic structure, URL counts, loc values, lastmod format and common SEO mistakes.

Open tool

SEO Tools FAQ

Can robots.txt remove pages from search results?

No. robots.txt controls crawling, not indexing. Use noindex or URL removal workflows for deindexing.

What should a sitemap contain?

Canonical, indexable URLs that return successful responses and are not blocked by robots.txt.

Should redirects be checked before launch?

Yes. Verify status code, Location header, canonical host and redirect chains with curl.