How to Crawl the Site For Broken Links

crawl site for broken links

The first step is to crawl the site for broken links. You can use different crawl tools to find the broken links on a website. The Geekflare Broken Link API can scan 300 pages of a website in just minutes. The result is a report that you can download in Excel or CSV format. If you’re not comfortable entering data into Excel, you can also create a report manually. This will save you time and energy.

Broken links can be classified as internal or external links. Internal links can repeat in the referring URL and target URL. Any page can have incoming links from multiple URLs. Inlinks can also filter broken links. This way, you can see which pages contain broken links. Once you have your list of broken links, you can filter it by status. For example, 404 broken links will have the status 410. The data will be displayed in a chart.

You can also check for penalties with SEOptimer. You can use it to check if your site is penalized by Google. This tool also provides a free PDF report in nine languages. Once you’ve downloaded the software, scan it for broken links. If you find any, replace them with a redirect. The SEOptimer crawler will find and flag all broken links, but it can be a bit confusing, so you may want to use a paid tool to get more detailed results.