Website Crawler is a cloud-based SEO tool that you can use to analyze up to 100 pages of a website for free in real-time. You can run the crawler as many times as you want. Website Crawler supports Android, Windows, iOS, and Linux devices. It is robust and fast.
Broken Links: Website Crawler makes you aware of unreachable internal and external links on your site.
Page speed: The Website Crawler tool displays the loading time of the pages on your site. As you can filter the list of pages by their loading time, you can find pages that are slow and fast with this tool.
Duplicate titles, meta tags: Multiple title, meta description tags can confuse search bots. With Website Crawler, you can easily find the pages of websites that are having multiple title or meta tags.
Missing Alt Tags: Search bots index images displayed on the website pages and displays them in their image search tools. If the image URL doesn't have an alt tag, they won't rank for search keywords. Website Crawler has a missing alt tag reports which can use to find pages having images without alt tag.
XML Sitemap: WebsiteCrawler can generate an XML sitemap for your website with a click of a button. You can exclude URLs from the sitemap or add priority or specify "changefrequency"" for the URLs [New feature]. If you're using a CMS or a custom-built site that doesn't have a sitemap, use this feature.
Export data: You can export the data displayed in the reports section to a PDF, CSV, or a spreadsheet file with a few clicks of a button. There's also an option to export the entire website data to a file.
Canonical Link issues: One of the major reasons why sites suffer from algorithm penalties is improper canonical links. Website Crawler finds invalid canonical links on the pages of your site and displays it.
Pages with/without heading tags: Want to know which pages on your site lack heading tags h1 to h5? Want to find the pages on your site that have small headings or headings containing a specific word? With Website Crawler, it is easy to analyze the h1 to h5 HTML tags used on the pages of websites.
The number of internal/external links: Website Crawler, the On Page SEO checker displays the number of internal and external links that pages on a website have. You can filter the list by the URL count.
Thin pages: Ranking of websites can tank after an algorithm update if it has a lot of pages with thin content. Finding thin content on a website is a breeze with our Website Crawler tool.
Log files: You can see useful data from the access log files with Website Crawler's log file analyzer [beta].
This tool has been designed and built for: