Technical SEO5 min read· Updated

A page is crawlable but not indexed: what to check

Crawling, indexing and ranking are separate decisions. A robots.txt rule that permits a URL does not guarantee that a search engine has fetched it or chosen to index it.

Read the tags sent for the pageCheck noindex, canonical and the server HTML before requesting another crawl.
Open Meta Tag Checker
On this page

    1. Check the exact page response

    Use HTTP Status Checker to confirm the page's final URL and status. An HTML error message returned with 200 can still be treated as a soft error; a response code alone is not a content-quality verdict.

    2. Separate robots.txt from noindex

    Robots.txt Tester checks a crawler's permission for the path. Meta Tag Checker reads noindex and canonical directives in the server response. If robots.txt blocks fetching the page, Google cannot read its noindex instruction. Keep truly private content authenticated rather than relying on either directive for privacy.

    3. Review the chosen URL and discovery

    Check whether the canonical points to the intended page, whether internal links reach it and whether a relevant sitemap lists it. Use XML Sitemap Validator for structure; it does not establish the status of every listed URL or a search engine's selected canonical.

    4. Consult search-engine evidence

    In your verified search-console account, inspect the URL's recorded crawl, selected canonical, indexing reason and rendered view. NosHost reads server HTML and cannot establish a search engine's current index. Request recrawling after a material repair, then monitor the reported result. Submission does not guarantee indexing or a deadline.

    Sources

    Reviewed by NosHost on 26 October 2026. Google noindex requirements · Recrawl requests · Sitemap protocol.

    Use the linked tools to confirm each change, then repeat the original test. Review server or DNS changes before applying them to a live site.

    Spotted something out of date? Email [email protected].

    More guides

    Email5 min read

    Set up email DNS

    Separate receiving records from sending authentication and verify every legitimate sender.

    Network5 min read

    Why a port check says closed

    Trace the connection path without disabling the firewall or treating a TCP result as a UDP test.

    Redirects7 min read

    Fix ERR_TOO_MANY_REDIRECTS

    The usual causes are a CDN in Flexible SSL mode, a wrong site address in your CMS or two rules that disagree about www.

    Email9 min read

    Emails going to spam

    Read receiving-server headers, check authentication and alignment, then investigate reputation and recipient signals.

    DNS6 min read

    DNS change not showing up

    Compare authoritative records and resolver caches to investigate a DNS change that has not appeared.

    Server config6 min read

    Cron job not running

    Check paths, environment variables, permissions, logging and time zones in a cron job that is not running.

    ↑ ↓ moveEnter openEsc close

    Expanded view