This project addresses the inefficiency and high cost of LLM context windows when processing numerous scattered knowledge files or codebases. It compiles these sources into a topic-based wiki, drastically reducing token usage (~90%) and providing AI agents with a synthesized understanding of any project, implementing Andrej Karpathy's LLM Knowledge Base pattern.

How It Works

The core approach leverages an LLM to compile raw markdown files or entire code repositories into a structured, topic-based wiki. This synthesized knowledge base replaces the need for LLMs to re-read hundreds of individual files per session. The system prioritizes efficiency and knowledge consolidation, allowing agents to query concise articles instead of extensive raw data, thereby reducing context costs and improving response times.

Quick Start & Requirements

• Installation: Install as a Claude Code plugin (claude plugin install llm-wiki-compiler) or a local Codex plugin.
• Prerequisites: Node.js 20+ and Chrome (for X bookmark syncing).
• Setup: Clone the repo. For Claude Code, run /wiki-init to set up, /wiki-compile to generate the wiki (5-10 min first run), and /wiki-visualize for a knowledge graph. Codex users invoke similar workflows via prompts.
• Docs: README serves as primary documentation; commands like /wiki-init guide setup.

Highlighted Details

• Codebase Mode: Compiles wikis from code repositories, integrating documentation, API contracts, decision records, and operational knowledge.
• Knowledge Graph Visualization: Interactive graph via /wiki-visualize aids navigation and understanding of topic relationships.
• External Source Integration: Fetches content from services like X (Twitter) via /fetch-bookmarks, with scheduled syncing options.
• Time-Decay Awareness: Explicitly handles information staleness by flagging older content and prioritizing newer sources.
• Coverage Indicators: Sections tagged [coverage: high/medium/low] guide LLM fallback to raw files, balancing speed and accuracy.
• Obsidian Compatibility: Generates plain markdown with Obsidian-style [[wikilinks]].

Maintenance & Community

The provided README does not detail specific contributors, sponsorships, partnerships, or community channels.

Licensing & Compatibility

• License: MIT.
• Compatibility: Permissive MIT license for commercial use and integration.

Limitations & Caveats

Requires Node.js 20+ and Chrome for certain features (e.g., X bookmark syncing). While reducing LLM context costs, initial compilation and updates incur LLM token expenses. /wiki-compile remains a manual user-initiated process.