RankKitFree Website Crawler & Site Audit
Crawl up to 100 pages: score every page, find duplicate titles, broken links, redirect chains, orphan pages and get internal link suggestions.
About this tool
The crawler follows your internal links (and your XML sitemap) just like Googlebot, collects data from each page and reports site-wide problems that single-page tools cannot see: duplicate titles and descriptions, broken internal links, redirect chains, noindex pages, thin content and orphan pages.
How to use the Site Crawler
- Enter your homepage URL.
- Choose how many pages to crawl (10–100).
- Start the crawl and watch pages appear live.
- Review issues, export CSV, or build a sitemap.xml from the crawl.
Frequently asked questions
Why is the crawl limited to 100 pages?
The crawl runs from your browser through a free server, so we cap it to keep the tool free and fast for everyone.
Does it respect robots.txt?
Yes, by default. You can switch that off to see what is blocked.
What is an orphan page?
A page listed in your sitemap that no other page links to. Google may treat it as unimportant.