Websites can be very large having tens of thousands of pages or a user may own dozens of large websites and for such websites and users, we have introduced the Enterprise plan.
What features does Enterprise plan unlock?
Up to a million pages: WebsiteCrawler can crawl the entire site irrespective of the number of pages. Just enter a number of URLs, site link and wait for the crawling task to finish. Enterprise plan of WebsiteCrawler.org supports up to 1,000,000 pages i.e if you have created 50 projects, up to a million pages of 50 websites (combined) will be crawled.
Faster crawling speed: Enterprise plan users can configure WebsiteCrawler to crawl pages faster than our other plans. The target website’s infrastructure should be strong as dozens of threads will send hundreds of HTTP requests every minute to the target website. If speed matters, you can switch to HTML crawler which is blazing fast. If you switch to HTML crawler, reports such as Render Blocking Resources, Screenshots, and Code Coverage won’t be available.
1 minute uptime checks: WebsiteCrawler will monitor every website each minute and will send an email alert if any of your sites are not reachable. Our Starter and Growth plan support 5 and 3 minutes uptime monitoring.
Unlimited users: The Enterprise plan gives you the freedom to add unlimited users to your account. Each user can manage a different project and can have permission to change miscellaneous settings, crawl setting, run crawls, etc.