April 1, 2025
Header Magic - Automatic AI SEO Meta Tags for Wordpress
Stop guessing, and start knowing with our in-depth SEO crawler.
We provide you with in-depth analysis of your website, identifying areas for improvement and opportunities for growth.
Our tool gives you the data you need to outrank your competiton. Sign up for your free trial and take control of your SEO today.
No credit card necessary
Say goodbye to complicated installations and software updates with The Crawl Tool. Our platform is entirely web-based, meaning you can access powerful website crawling and SEO reporting features directly from your browser. No need to download or run any programs on your computer.
Our platform allows you to assign statuses to issues, making it easy to track progress and prioritize tasks. With multi-user support, team members can work together seamlessly, sharing insights and updates.
Discover the full potential of The Crawl Tool with our generous free trial, allowing you to crawl up to 1,000 URLs at no cost. This trial gives you a firsthand experience of our seo crawl tool's capabilities, enabling you to identify and fix issues, optimize your site, and see the benefits.
We use credits to charge for service usage. One credit crawls one url. We charge credits in batches of a minimum of 100. In the future it will also be possible to use credits for additional services. The credit allowance for monthly plans is generous, but if you run short then you can always buy more credits for that month.
Most users will only have one sort of credit on their account. In the case of the free plan the credits will expire after 3 months. If you want to crawl sites after then, you'd need to consider a paid plan. Pay As You Go credits expire after one year. You should plan to use them up by then, after a year you will need to buy more if you want to crawl. A monthly plan gives credits each month. They don't roll over to the next month, so credits from the previous month expire when you get your allocation of credits for the next month.
After running a crawl, the tool generates reports that take up space on our servers. Each plan comes with a data retention timeframe. If the last crawl of a project/site is longer than this time frame then we reserve the right to delete the reports after that timeframe if we feel it will help enhance performance for other users. You can always download the reports as xlsx files beforehand.
For each site you want to crawl, you start a project. This project will house the crawl data/reports and (apart from the Free version) allow you to manage employee or third party access to a project's reports. Depending on your plan, you may have a different number of projects. You can always download the data and delete projects if you need to make space for new ones.
The tool works as a system that has one account. This account and setup projects and request crawls. You might want co-workers or third parties to look at an access those reports though. For this reason we allow you to create access keys. Each access key can be given a name and set to which projects/sites it can access. By giving appending the access key to the report url and sending it to the other party, they can access the reports and action it (such as changing statuses).
In order to preserve your credits balance and to protect unexpected large usage, we cap each individual crawl to a maximum of 50000 urls. This will cover nearly all sites, but get in touch to discuss your requirements if you need more.