Free check
AI crawler check: can the AI engines read your site?
Enter your domain. We read your robots.txt, your home page and your sitemap the way a crawler does, then tell you which AI engines can read your site and what to fix first.
What does the check read?
What a crawler reads before it reaches your page's text.
robots.txt
We read its rules the way Google does, for every search and training crawler by name, and quote the line that blocks.The home page without JavaScript
We ask for it the way a crawler that runs no JavaScript does, check that its text is there, and read its noindex and nosnippet tags.The sitemap
We check that robots.txt names it and that it opens, since it points crawlers to your pages.llms.txt
We only check that it exists. It is optional documentation, not a route to being cited.
What the check does not tell you
- A crawler reading your site is a condition for an engine to cite it, not a guarantee: the choice after that is the engine's.
- We read your site as our own crawler, TasadrBot. A firewall or CDN may treat the engines' crawlers differently.
- We check the home page only. Your other pages may carry different tags.
- We keep a result for up to six hours, then read the site again.
- xAI publishes no crawler name for Grok, so it cannot be checked.
Being read is the first step. Do you lead the answers?
Try Tasadr free for 7 days: add your site, write up to 10 questions your customers ask, and see who leads the ChatGPT and Gemini answers today. No credit card needed.