gau ☆
« Back to VersTracker
Description:
Open Threat Exchange, Wayback Machine, and Common Crawl URL fetcher
Type: Formula  |  Tracked Since: Dec 28, 2025
Links: Homepage  |  formulae.brew.sh
Category: Security
Tags: reconnaissance osint pentesting url-fetcher security
Install: brew install gau
About:
Gau is a command-line tool designed for security researchers and penetration testers to retrieve known URLs for specific domains. It fetches data from multiple sources, including the Wayback Machine, Common Crawl, and Open Threat Exchange, aggregating historical and publicly available web data. This tool streamlines the reconnaissance phase by providing a comprehensive list of potential endpoints and parameters for further analysis.
Key Features:
  • Fetches URLs from Wayback Machine, Common Crawl, and Open Threat Exchange
  • Supports concurrent requests for fast data retrieval
  • Filters results by date and blacklists specific extensions
  • Simple CLI interface for easy integration into workflows
Use Cases:
  • Performing reconnaissance to discover hidden or historical endpoints on a target domain
  • Gathering URLs for vulnerability scanning and bug bounty hunting
  • Compiling a comprehensive list of assets for external attack surface mapping
Alternatives:
  • waybackurls – waybackurls focuses solely on the Wayback Machine, whereas gau aggregates from multiple sources including Common Crawl and OTE.
  • gospider – gospider actively crawls websites to find links, while gau retrieves known URLs from passive historical and public data sources.
Version History
Detected Version Rev Change Commit
Oct 9, 2025 8:07pm 0 VERSION_BUMP 3c0d7e06
Oct 28, 2024 9:22pm 0 VERSION_BUMP 52bb9baf
Oct 28, 2024 3:12pm 0 VERSION_BUMP eca975b9
Sep 13, 2024 8:13am 0 VERSION_BUMP 7422fde2
« Back to VersTracker  |  Browse Packages  |  About