Screamingfrog SEO Spider

Free Website Crawler

The Screaming Frog SEO Spider is a desktop program (PC or Mac) which crawls websites’ links, images, CSS, script and apps from an SEO perspective

PRICING

Free tier available. Paid accounts start from £149 per year

Visit Site
white arrow

Key Features

  • SEO Spider is a website crawler and highlights key onsite elements to analyse onsite SEO

Great for

  • Crawl a website instantly and find broken links (404s) and server errors
  • Analyse page titles and meta descriptions during a crawl and identify those that are too long, short, missing, or duplicated across your site
  • Quickly create XML Sitemaps and Image XML Sitemaps, with advanced configuration over URLs to include, last modified, priority and change frequency
  • Find temporary and permanent redirects, identify redirect chains and loops, or upload a list of URLs to audit in a site migration
  • Discover exact duplicate URLs with an md5 algorithmic check, partially duplicated elements such as page titles, descriptions or headings and find low content pages
  • Connect to the Google Analytics API and fetch user data, such as sessions or bounce rate and conversions, goals, transactions and revenue for landing pages against the crawl
  • View URLs blocked by robots.txt, meta robots or X-Robots-Tag directives such as ‘noindex’ or ‘nofollow’, as well as canonicals and rel=“next” and rel=“prev”

Be aware that

  • The free tier is limited to 500 URL crawls
Visit Site
white arrow