sitefetch ☆

« Back to VersTracker

Description:
Fetch an entire site and save it as a text file

Type: Formula | Tracked Since: Dec 28, 2025

Links: Homepage | @egoist | formulae.brew.sh

Category: Developer tools

Tags: web-scraping cli productivity text-processing

Install: brew install sitefetch

About:
Sitefetch is a command-line tool that recursively crawls a website and captures its content. It then compiles the gathered data into a single, readable plain text file. This utility is ideal for creating offline snapshots or training data for LLMs.

Key Features:

Recursive crawling of websites
Outputs to a single plain text file
CLI-based for easy automation
Lightweight and fast

Use Cases:

Creating offline backups of documentation sites
Generating datasets for AI/LLM training
Quickly analyzing site content structure

Alternatives:

wget – Wget downloads files to a directory structure, whereas Sitefetch aggregates content into a single text file.
curl – Curl fetches single resources; Sitefetch handles recursive crawling and formatting automatically.

Version History

Detected	Version	Rev	Change	Commit