ace  by ace-agent

Framework for self-improving language agents via evolving contexts

Created 1 month ago
491 stars

Top 63.0% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

ACE (Agentic Context Engineering) is a framework enabling LLMs to self-improve by evolving contextual "playbooks," addressing context collapse and brevity bias. It preserves domain-specific knowledge via structured, incremental updates, offering scalability. ACE targets engineers and researchers seeking efficient, cost-effective LLM agent enhancement.

How It Works

ACE uses a Generator, Reflector, and Curator architecture. The Generator creates reasoning trajectories, the Reflector evaluates insights, and the Curator translates them into "delta updates"—localized edits preserving prior knowledge. This "grow-and-refine" mechanism prevents context collapse by avoiding full rewrites and managing context expansion via deterministic merging/pruning.

Quick Start & Requirements

Installation: git clone https://github.com/ace-agent/ace.git, pip install -r requirements.txt. Requires API keys for providers like OpenAI, Sambanova, or Together. Defaults to DeepSeek-V3.1 models. Basic usage involves initializing ACE and running adaptation ('offline', 'online', 'eval_only') with configurations.

Highlighted Details

ACE achieves +10.6% on agent tasks (AppWorld) and +8.6% on financial benchmarks (FiNER + XBRL Formula). Efficiency gains include average 86.9% adaptation latency reduction. Offline AppWorld shows -82.3% latency, -75.1% rollouts; online FiNER shows -91.5% latency, -83.6% token cost reduction. It matches/surpasses GPT-4.1 on agent tasks using smaller open-source models.

Maintenance & Community

Contribution guidelines are provided with a "[TODO]" placeholder. Community engagement is via GitHub Discussions. Author contact details are available through the linked arXiv paper.

Licensing & Compatibility

The README omits the software license, requiring further investigation for commercial use. Supports multiple API providers (Sambanova, Together, OpenAI) for deployment flexibility.

Limitations & Caveats

No explicit limitations or known bugs are detailed. As a framework for evolving LLM contexts, it is under active development. While extensible, documented examples focus on agent tasks and financial analysis. The lack of licensing information is a primary adoption caveat.

Health Check
Last Commit

1 month ago

Responsiveness

Inactive

Pull Requests (30d)
6
Issues (30d)
1
Star History
109 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Shizhe Diao Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), and
4 more.

agents by aiwaves-cn

0.1%
6k
Open-source framework for self-evolving, data-centric autonomous language agents
Created 2 years ago
Updated 1 year ago
Feedback? Help us improve.