Alita  by CharlesQ9

Agent for scalable agentic reasoning

created 3 months ago
763 stars

Top 46.7% on sourcepulse

GitHubView on GitHub
Project Summary

Alita is a generalist AI agent designed for scalable agentic reasoning, aiming to overcome the limitations of manually predefined tools and workflows in existing agents. It targets researchers and developers building advanced AI assistants, offering superior performance on benchmarks like GAIA by prioritizing minimal predefinition and maximal self-evolution.

How It Works

Alita's core innovation lies in its "Maximal Self-Evolution" principle, enabling it to autonomously create, refine, and reuse external capabilities through Model Context Protocols (MCPs). Instead of relying on static, predefined tools, Alita dynamically generates and adapts MCPs based on task demands. This approach, termed "Auto MCP Creation," is presented as a more flexible and scalable alternative to traditional tool creation, facilitating better reusability and easier environment management.

Quick Start & Requirements

The project plans to release code in approximately one month. Specific installation or execution commands are not yet available.

Highlighted Details

  • Achieved 75.15% pass@1 and 87.27% pass@3 on the GAIA validation leaderboard, outperforming OpenAI Deep Research and Manus.
  • Auto-generated MCPs can be reused for agent distillation, enabling stronger agents to teach weaker ones or agents with smaller LLMs.
  • The MCP creation component reportedly provides a ~15% increase in pass@1 on the GAIA test dataset compared to Alita without it.
  • Demonstrates potential for task-specific MCP creation, such as generating a video understanding module that analyzes video frames rather than relying solely on transcripts.

Maintenance & Community

The project is led by CharlesQ9, with contributions from undergraduate research assistants. Further details and updates are promised.

Licensing & Compatibility

The README does not specify a license.

Limitations & Caveats

The GAIA validation dataset is noted to contain inaccuracies, and there's a performance gap between the validation and test datasets, with the test set emphasizing web browsing more. The project acknowledges that the web agent is simple and requires further upgrades. There's also a concern that auto-generated MCPs might overfit specific datasets if abstraction levels are not carefully managed.

Health Check
Last commit

2 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
2
Star History
773 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.