Enter a domain — we show what is closed to Yandex and Google, whether the sitemap is declared, and whether the site allows AI crawlers: ChatGPT, Claude, Perplexity and the rest.
A domain is enough. We match rules the way search engines do. Nothing is stored.
What does the check show?
Which sections are closed to robots, whether the sitemap is declared, which robots are named explicitly and — in a separate block — whether the site allows AI search crawlers: GPTBot, OAI-SearchBot, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended and CCBot.
How is this different from reading the file myself?
Rules are matched the way search engines match them: a group naming the robot wins over the wildcard group, and among rules the longest matching path wins. Because of that, a “Disallow: /” in the file does not always mean a robot is blocked — and the reverse is also true.
Should I allow AI crawlers?
That is the owner's decision, not a rule. Allowing them means the site can appear in ChatGPT, Claude and Perplexity answers, but also that the text may be used for training. Blocking means the opposite. We show the fact rather than judge it.
What if there is no robots.txt at all?
Formally that is not an error: without the file the site is fully open. But there is nowhere to declare the sitemap and nothing to close service sections like the cart or the account area with.
Open access only helps if the site has material on the topics people search for. SEO Writer looks at what you have already written and suggests what is missing — an accepted topic becomes an article.