Moreover, the program can connect to the Google Analytics API and fetch user data, such as sessions or bounce rate and conversions, goals, transactions, and revenue for landing pages against the crawl.

If there are no directives, it will crawl your site like Googlebot. The program presents the data in tabs by type and allows you to filter for common SEO issues, or slice and dice the data as you see fit by exporting and importing into Excel.Īs default, the SEO Spider crawls sites like Googlebot (it obeys allow, disallow directives and wildcard support like Googlebot), but presents its own user-agent ‘Screaming Frog SEO Spider’, which it will obey specific directives for in robots.txt. You can view, analyze and filter the crawl data as it’s gathered and updated continuously in the program’s user interface. It allows you to quickly crawl websites’ URLs, resources (links, images, CSS, scripts) and fetch key onsite elements (URL, page title, meta descriptions, headings) to evaluate onsite SEO. Screaming Frog SEO Spider is an advanced desktop SEO auditing tool and website crawler, built by real SEOs with thousands of users worldwide.

Screaming Frog SEO Spider 19.2 download