ace  by ace-agent

Framework for self-improving language agents via evolving contexts

Created 7 months ago
1,199 stars

Top 31.9% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

ACE (Agentic Context Engineering) is a framework enabling LLMs to self-improve by evolving contextual "playbooks," addressing context collapse and brevity bias. It preserves domain-specific knowledge via structured, incremental updates, offering scalability. ACE targets engineers and researchers seeking efficient, cost-effective LLM agent enhancement.

How It Works

ACE uses a Generator, Reflector, and Curator architecture. The Generator creates reasoning trajectories, the Reflector evaluates insights, and the Curator translates them into "delta updates"—localized edits preserving prior knowledge. This "grow-and-refine" mechanism prevents context collapse by avoiding full rewrites and managing context expansion via deterministic merging/pruning.

Quick Start & Requirements

Installation: git clone https://github.com/ace-agent/ace.git, pip install -r requirements.txt. Requires API keys for providers like OpenAI, Sambanova, or Together. Defaults to DeepSeek-V3.1 models. Basic usage involves initializing ACE and running adaptation ('offline', 'online', 'eval_only') with configurations.

Highlighted Details

ACE achieves +10.6% on agent tasks (AppWorld) and +8.6% on financial benchmarks (FiNER + XBRL Formula). Efficiency gains include average 86.9% adaptation latency reduction. Offline AppWorld shows -82.3% latency, -75.1% rollouts; online FiNER shows -91.5% latency, -83.6% token cost reduction. It matches/surpasses GPT-4.1 on agent tasks using smaller open-source models.

Maintenance & Community

Contribution guidelines are provided with a "[TODO]" placeholder. Community engagement is via GitHub Discussions. Author contact details are available through the linked arXiv paper.

Licensing & Compatibility

The README omits the software license, requiring further investigation for commercial use. Supports multiple API providers (Sambanova, Together, OpenAI) for deployment flexibility.

Limitations & Caveats

No explicit limitations or known bugs are detailed. As a framework for evolving LLM contexts, it is under active development. While extensible, documented examples focus on agent tasks and financial analysis. The lack of licensing information is a primary adoption caveat.

Health Check
Last Commit

1 month ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
54 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.