AI Crawler Access Checker
We fetch your live robots.txt and check it against the crawlers behind ChatGPT, Claude, Perplexity, Gemini, and a dozen other AI platforms, so you know in seconds whether any of them are blocked, including a blanket wildcard rule that quietly blocks all of them at once.
Free, no signup, and everything runs in your browser.
Being crawlable is not the same as being cited.
InkSTR tracks whether ChatGPT, Perplexity, Gemini, and Claude are actually mentioning your business by name once they can reach your pages, not just whether the door is technically open.
Common questions
About the AI Crawler Access Checker.
Most robots.txt files only have a wildcard block: User-agent: * followed by Disallow rules. Every crawler that has no rule of its own, including AI crawlers you never thought about, falls back to that wildcard. A blanket Disallow written years ago for an unrelated reason can end up blocking GPTBot and ClaudeBot along with everything else.
GPTBot crawls to gather training data for future models. OAI-SearchBot and ChatGPT-User are the crawlers behind ChatGPT's live search and browsing features, the ones that fetch a page in response to a real question. You can block one and allow the other, and a business that wants to be cited by ChatGPT should generally leave OAI-SearchBot and ChatGPT-User open even if it blocks GPTBot.
No. We read the plain-text robots.txt file the same way any crawler does before it decides whether to proceed further, nothing more. Your pages themselves are never fetched or rendered by this tool.
No, and that distinction is deliberate. Allowing a crawler only removes the technical block. Whether an assistant actually cites you still depends on your content answering the question directly, being structured clearly enough to quote, and, for some engines, simply being indexed by Google in the first place.
Then every crawler, AI crawlers included, is allowed by default; there is no file to block them. That is not automatically bad, but it also means you have made no deliberate decision about it either way. Adding a robots.txt with explicit rules turns an accident into a choice.
More free tools
No signup on any of them.
Stop doing this by hand every week.
InkSTR researches the keywords, writes the articles, and publishes them to your site on a schedule.
3-day free trial · your first 3 articles included · nothing charged during the trial
We read your live robots.txt the way each of these bots does before deciding whether to proceed. Takes a few seconds.
We only fetch and parse the plain-text robots.txt file, the same file every crawler reads first — nothing about your site is stored beyond this check.