Website Crawler Plans and Pricing
Cloud crawler for professionals. Extract data or audit/monitor your sites 24/7. Trusted by 3,000+ pros.
For trying our platform
- Core features:
- ✔ Manage up to 1 project
- ✔ Advanced On Page SEO reports
- ✔ API Access
- ✔ Export to JSON, CSV, Markdown
- ✔ JavaScript rendering
- ✔ Visual site structure and crawl history
For small and growing websites
- Everything in Basic, plus:
- ✔ Manage up to 10 projects
- ✔Add & manage up to 2 users
- ✔ Crawl Scheduling
- ✔ Crawl Blacklist configuration
- ✔ Core Web Vitals analysis
- ✔ 16 months GSC data
- ✔ Uptime monitoring (5-minute) interval
For medium size websites and agencies
- Everything in Silver, plus
- ✔ Manage up to 50 projects
- ✔Add & manage up to 4 users
- ✔ 6x more crawl credits
- ✔Crawl delay selection
- ✔Customizable crawl speed [Up to 100 urls per minute]
- ✔ Crawler type selection [Chrome or HTML]
- ✔ Uptime monitoring (3-minute) interval
For large websites and agencies
- Everything in Gold, plus
- ✔ Manage up to 100 projects
- ✔ Add & manage up to 8 users
- ✔ 17x more crawl credits
- ✔Fastest crawling speed [Up to 200 urls per minute]
- ✔ Uptime monitoring (1-minute) interval
Plan details
| Basic | Silver | Gold | Platinum | |
|---|---|---|---|---|
| Subscription fee in USD per month | N/A | 9.99 | 49.99 | 79.99 |
| Total number of URLs/pages of all sites that will be crawled, scraped and analyzed | 25 / day | 30000 / month | 200000 / month | 500000 / month |
| Number of websites/projects you can manage at a time | 1 | 10 | 50 | 100 |
| Group projects | ❌ | ✔ | ✔ | ✔ |
| Number of users/team members you can add | 0 | 2 | 4 | 8 |
| Export data to CSV file or LLM ready JSON, or Markdown file | ✔ | ✔ | ✔ | ✔ |
| SSL expiry email alerts | ❌ | ✔ | ✔ | ✔ |
| Uptime monitoring and downtime email alerts | ❌ | ✔ [ 5-minutes interval ] | ✔ [ 3-minutes interval ] | ✔ [ 1-minute interval ] |
| Crawl blacklist [Directives to not crawl] | ❌ | ✔ | ✔ | ✔ |
| Core Web Vitals analysis [Analyze LCP, FCP, TBT, etc of pages] | ❌ | ✔ | ✔ | ✔ |
| Crawl Scheduling | ❌ | ✔ | ✔ | ✔ |
| Custom crawl delay [Slow down crawling for certain sites] | ❌ | ❌ | ✔ | ✔ |
| Crawl Comparison | ✔ [Demo] | ✔ | ✔ | ✔ |
| Crawl History [See historical data of our crawls] | ✔ [Demo] | ✔ | ✔ | ✔ |
| Google Search Console search data | ✔ [Demo] | ✔16 months data | ✔16 months data | ✔ 16 months data |
| Structured data [JSON schema] extraction and validation | ✔ [Demo] | ✔ | ✔ | ✔ |
| Spelling checks [English Only] | ✔ [Demo] | ✔ | ✔ | ✔ |
| Readability Score report | ✔ [Demo] | ✔ | ✔ | ✔ |
| Duplicate Content report | ✔ [Demo] | ✔ | ✔ | ✔ |
| Heading hierarchy analysis | ✔ [Demo] | ✔ | ✔ | ✔ |
| Visual site structure [Crawl graph] | ✔ | ✔ | ✔ | ✔ |
| Title tag checks | ✔ | ✔ | ✔ | ✔ |
| Meta Description report | ✔ | ✔ | ✔ | ✔ |
| Canonical link checks | ✔ | ✔ | ✔ | ✔ |
| Page Size report | ✔ | ✔ | ✔ | ✔ |
| Content length checks | ✔ | ✔ | ✔ | ✔ |
| Image size checks | ✔ | ✔ | ✔ | ✔ |
| Robots.txt URL filtering | ✔ | ✔ | ✔ | ✔ |
| HTTP status code checks | ✔ | ✔ | ✔ | ✔ |
| Nofollow links report | ✔ | ✔ | ✔ | ✔ |
| Hreflang tags check | ✔ | ✔ | ✔ | ✔ |
| Redirect chain detection for internal links | ✔ | ✔ | ✔ | ✔ |
| Internal links reports | ✔ | ✔ | ✔ | ✔ |
| External links report | ✔ | ✔ | ✔ | ✔ |
| Page load time checks | ✔ | ✔ | ✔ | ✔ |
| Images alt tag checks | ✔ | ✔ | ✔ | ✔ |
| Meta robots tag report | ✔ | ✔ | ✔ | ✔ |
| H1 to H5 tags reports | ✔ | ✔ | ✔ | ✔ |
| XML sitemap generation | ✔ | ✔ | ✔ | ✔ |
| Pie chart view of data | ✔ | ✔ | ✔ | ✔ |
| Daily SEO issues detection and comparison | ✔ | ✔ | ✔ | ✔ |
| JavaScript rendering | ✔ | ✔ | ✔ | ✔ |
| API Access [Data retrieval speed depends on the plan] | ✔ | ✔ | ✔ | ✔ |
| Custom tags [Extract custom data from web pages] | ✔ | ✔ | ✔ | ✔ |
| Sign up |
FAQs
What is our refund policy?
If for some reason, you don't want to continue using WebsiteCrawler, you can write to us within 24 hours of buying the plan. Please mention the reason why you don't want to use our platform. If our platform fails to deliver its intended functionality or if you provide a valid reason in your refund request email, we will initiate a refund of your payment within 3 working days. Start using WebsiteCrawler for free and upgrade any time.
Can you cancel your plan?
The monthly plans support monthly payment only. The plan will be auto-renewed every month unless you cancel it. You can cancel the active plan from the settings page. The annual plans support yearly payment. Like monthly plans, they will be auto renewed at the end of the year unless you cancel it. Once you buy a plan, you have to continue using it as long as the plan is valid. If you cancel the plan, the subscription won't be auto-renewed and your subscription will be downgraded from paid to basic on the expiry date of the plan which is 30 days from the day of subscription activation.
What are crawl credits?
The paid plans are assigned up to 500000 URL credits and the free plan is assigned 25 URL credits. URL credits are nothing but the total number of pages of all sites combined you can scrape/crawl/analyze every month. The credits expire at the end of each month. For example, if you purchase the Gold plan, your account will be assigned 200000 crawl credits. Gold plan allows you to manage up to 50 projects at a time. Hence, Website Crawler will process a total of 200000 pages across all sites in your dashboard. You can see the remaining, and consumed credits in the settings page of WebsiteCrawler.
What is crawl speed?
WebsiteCrawler supports two crawl modes - Chrome and HTML. Chrome -> Renders the page including the JavaScript before processing. HTML -> Works on raw HTML only. The crawling speed depends on two factors - your chosen crawler type and the response time/loading time of the page. If the page is slow and your chosen crawler type is Chrome, our platform will wait for the full page to load (including JS content) to make sure that no page is skipped. HTML based crawler fetches raw HTML only. HTML mode is much faster than Chrome as it skips JS content.
What are the demo restrictions for free plans?
Features marked as demo give users access to data of 5 URLs only on the project page and 5 records in the settings page. For unrestricted access to the data, users should buy one of our 3 paid plans.
How do subscriptions on WebsiteCrawler work?
Your subscription will be activated once you purchase one of our plans. You can see the subscription status and manage the subscription in the settings page. You can cancel the subscription anytime. You will receive an renewal email one week before your plan is about to get automatically renewed. Once the plan is cancelled, the subscription won't be auto-renewed.
What payment methods we support?
We accept credit/debit cards and PayPal. We're using a highly secure payment gateway to process your payments.