Test whether a URL is allowed or blocked for Googlebot, AI crawlers and others.
Technical SEO tools
Test crawler rules and review the tags search engines and social sites read from a page.
Review a page's title, description, canonical, robots and social sharing tags.
Validate sitemap XML, location fields, duplicates and date syntax.
Checks to run before blaming the algorithm
Can crawlers reach the page?
A single Disallow line can hide a whole section of a site from search engines. The Robots.txt Tester shows whether Googlebot, Bingbot and the main AI crawlers may fetch a URL, and which line decides it. You can also paste a draft file to test it before publishing.
Are the tags right?
A noindex tag left over from a staging site, a canonical pointing at the wrong page or a missing title can all keep a page out of results. The Meta Tag Checker reads them from the live page and shows roughly how it looks in search and when shared.
Does the URL answer properly?
Search engines only index pages that return 200. Check status codes and redirects with the HTTP Status Checker, especially for URLs in your sitemap.