MARBLE  by ulab-uiuc

Evaluating LLM agent collaboration and competition

Created 1 year ago
257 stars

Top 98.3% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

MARBLE (Multi-Agent Coordination Backbone with LLM Engine) is an open-source framework designed for developing, testing, and evaluating multi-agent systems powered by Large Language Models (LLMs). It addresses the complexity of modeling collaborative and competitive interactions between AI agents in simulated environments. The framework targets researchers and engineers building sophisticated LLM-driven multi-agent applications, offering a structured and extensible platform to accelerate experimentation and performance assessment.

How It Works

MARBLE employs a modular architecture, allowing seamless extension or replacement of core components such as agents, environments, and LLM integrations. Agents interact within flexible simulated environments, leveraging LLMs for cognitive functions and communication. The design supports both hierarchical and cooperative execution modes, facilitating complex multi-agent dynamics. A unified API simplifies integration with various LLM providers, while a shared memory mechanism enables effective agent communication and collaboration.

Quick Start & Requirements

Installation involves setting up a Python 3.10 Conda environment, installing Poetry, and configuring environment variables (e.g., OPENAI_API_KEY) via a .env file. Key commands include poetry install for dependencies and bash run_simulation.sh to execute examples. Code quality is maintained through poetry run pytest for dynamic typing and poetry run mypy for static typing checks. Docker support is available for consistent deployment.

Highlighted Details

  • Modular Design: Facilitates easy customization of agents, environments, and LLM backends.
  • Multi-Agent Support: Models complex interactions with hierarchical or cooperative execution.
  • LLM Integration: Unified API for diverse LLM providers (e.g., OpenAI).
  • Shared Memory: Enables robust agent communication and data sharing.
  • Flexible Environments: Supports various simulated task environments, including web-based scenarios.
  • Evaluation Metrics: Integrated tools for assessing agent performance.
  • Docker Support: Streamlines deployment and experimentation.

Maintenance & Community

Information regarding notable contributors, sponsorships, community channels (e.g., Discord, Slack), or a public roadmap is not detailed in the provided documentation.

Licensing & Compatibility

The specific license under which MARBLE is distributed is not explicitly stated in the provided documentation. This requires further clarification for assessing commercial use or closed-source integration compatibility.

Limitations & Caveats

No specific limitations, known bugs, or alpha status are detailed in the provided README snippet.

Health Check
Last Commit

7 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
6 stars in the last 30 days

Explore Similar Projects

Starred by Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera), Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and
4 more.

chatarena by Farama-Foundation

0.1%
2k
Multi-agent environment for LLM research
Created 3 years ago
Updated 9 months ago
Starred by Andrew Ng Andrew Ng(Founder of DeepLearning.AI; Cofounder of Coursera; Professor at Stanford), Jack Lukic Jack Lukic(Author of Semantic UI), and
5 more.

ag2 by ag2ai

0.6%
5k
AgentOS for building AI agents and facilitating multi-agent cooperation
Created 1 year ago
Updated 21 hours ago
Feedback? Help us improve.