mySoftwareGuide

Safe & trusted downloads

The best software, verified by experts

Icon of program: Robots Disallow Checker

Robots Disallow Checker for Chrome

Efficient Robots Disallow Checker for Chrome

  • Free
  • 4.4
  • V 1.0.1

Efficient Robots Disallow Checker for Chrome

Robots Disallow Checker is a Chrome extension designed to analyze the robots.txt file of websites, specifically focusing on paths that Googlebot is instructed not to crawl. This tool effectively identifies how many of those disallowed URLs remain indexed by Google, providing insights into potential SEO issues. By clicking the extension icon on any site, users can quickly fetch the site's robots.txt, extract applicable Disallow rules, and generate Google site: queries for each rule. The results display the number of indexed URLs under each disallowed pattern, making it a valuable resource for webmasters and SEO professionals.

The extension excels in handling a variety of robots.txt patterns, including plain prefixes, wildcards, and filetype suffixes. It features a local caching system for quick re-audits, a sortable results table, and options for exporting data in TSV or Markdown formats. Additionally, the tool ensures user privacy by avoiding any data collection or telemetry, and all operations are conducted locally on the user's device.

Icon of program: Robots Disallow Checker

Robots Disallow Checker for Chrome

  • Free
  • 4.4
  • V 1.0.1