Unique page inventory
Group normalized URL variants into the canonical pages that need review.
Site-wide analysis
Crawl and inspect a website
Site Crawl discovers linked pages, groups equivalent URL variants, records internal relationships and checks public site files. Deep mode then runs the full audit engine across the selected unique pages, with page-level reports and aggregated findings.
Internal link structure
See how pages connect, which routes have weak discovery and where links originate.
External link checks
Review bounded status checks for external destinations referenced by the site.
Site directives
Inspect robots.txt, XML sitemaps and supported AI-discovery files together.
Read every crawl within its limits
A crawl reports the public pages reached from its starting URL within the configured page, depth and runtime limits. It does not prove that every page on a domain was discovered, and it cannot inspect authenticated or private-network content.
Choose the right scope
Choose surface or deep analysis
Use a surface crawl for inventory, URL variants, internal relationships and site-wide file checks from initial HTML. A deep site audit renders pages to discover JavaScript-generated links. It then applies metadata, content, accessibility, structured data, security and performance analysis to every selected unique page.
Interpret the evidence
Discovery is not the same as coverage
A missing page may be unlinked, blocked, outside the configured depth or available only through an authenticated flow. Review the processed URL count, unique pages, variants, blocked addresses and active crawl limits together. Resolve shared templates and navigation problems first, then rerun the crawl to confirm that the reachable structure changed.