SEO Spider Tutorials

Getting Started Guide

Our beginners guide to getting started using the SEO Spider. Including initial set-up, crawling, and viewing reports and issues discovered.

How To Find Broken Links Using The SEO Spider

Learn how to crawl your website and find broken links (404 errors), view which pages link to them, the link text, and export in bulk.

Site Architecture & Crawl Visualisations Guide

Visualise site architecture and internal linking to help communicate ideas and reveal underlying patterns that are harder to uncover in data, and spreadsheets.

How To Compare Crawls

Compare crawls to see how data, issues and opportunities have changed over time to track progress and monitor site health.

How To Crawl JavaScript Websites

Render web pages using the integrated Chromium WRS to crawl dynamic, JavaScript rich websites and frameworks, such as Angular, React and Vue.js.

How To Crawl Large Websites

Crawl large websites by switching to database storage mode, increasing memory and by configuring the crawl to extract the data you need.

How To Crawl A Staging Website

Find out how to crawl a staging or development website, considering robots.txt, authentication, and the SEO Spider configuration.

How To Automate Crawl Reports In Data Studio

Learn how to set-up fully automated Google Data Studio crawl reports to monitor site health, detect issues, & track performance.

How To Audit Core Web Vitals

Analyse which pages pass or fail Google's Core Web Vitals assessment using field data from CrUX to improve page speed.

How To Check For Duplicate Content

Minimise duplicate content by identifying exact duplicate pages, and near-duplicate content where some text matches between pages on a website.

How To Test & Validate Structured Data

Audit and validate structured data against Schema.org specifications, and Google’s search feature requirements to enable special search result features.