Hi, I'm Eric.

I’m an avid world traveler, photographer, software developer, and digital storyteller.

I help implement the Content Authenticity Initiative at Adobe.

Search Results

Free Website Crawler & Site Audit Tool — SiteOne Crawler

Found on 4 October 2024 via Mastodon 548

via Alexis Jacomy (@jacomyal@vis.social): Just found out about SiteOne Crawler: https://crawler.siteone.io

SiteOne Crawler is a single dependency-free binary that deep-crawls any site and produces an interactive audit report covering SEO, security headers, accessibility, performance, and broken links. It can also mirror a site for offline use, generate sitemaps, or convert pages to clean Markdown / llms.txt for feeding to an LLM. Available as a desktop GUI or a CLI with roughly 200 options, so it slots nicely into a CI/CD quality gate.

Free Website Crawler & Site Audit Tool — SiteOne Crawler

If you’ve enjoyed this …

Subscribe to my free and occasional (never more than weekly) e-mail newsletter with my latest travel and other stories:

Or follow me on one or more of the socials: