This CLI tool converts GitHub repositories into single text files, ideal for LLM training, analysis, or documentation. It targets developers and researchers needing to process codebases efficiently, offering automatic binary exclusion and configurable file size limits.

How It Works

The tool recursively downloads a specified GitHub repository, excluding binary files and those exceeding a configurable size threshold (default 100KB). It then concatenates the content of eligible files into a single text file, clearly marking each file's path and size before its content. This approach simplifies large-scale code processing for AI models.

Quick Start & Requirements

• Primary install: npm install -g git2txt
• Prerequisites: Node.js and npm.
• Usage: git2txt username/repository or git2txt https://github.com/username/repository.
• Options: --output, --threshold, --include-all, --debug.
• Examples and detailed usage are available in the README.

Highlighted Details

• Supports HTTPS, short format, and SSH GitHub repository URLs.
• Automatically excludes binary files and .git directories.
• Configurable file size threshold to manage output size.
• Cross-platform compatibility (Windows, macOS, Linux).

Maintenance & Community

The project is open for contributions, with a guide available for interested parties.

Licensing & Compatibility

• License: MIT.
• Compatibility: Permissive MIT license allows for commercial use and integration into closed-source projects.

Limitations & Caveats

By default, files larger than 100KB and binary files are excluded, which might require using the --include-all flag for comprehensive processing.