kaos  by axsaucedo

Kubernetes-native orchestration for distributed AI agent systems

Created 4 months ago
251 stars

Top 99.8% on SourcePulse

GitHubView on GitHub
Project Summary

Summary KAOS is a Kubernetes-native framework for deploying, managing, and orchestrating AI agents in large-scale distributed multi-agent systems. It simplifies coordinating agents, integrating tools, and managing LLM interactions within Kubernetes, benefiting engineers and researchers building sophisticated AI applications.

How It Works KAOS defines agent networks as Kubernetes resources ("Agentic Graphs") and integrates tools via Model Context Protocol (MCP) primitives. It supports hierarchical multi-agent systems with automatic delegation and exposes an OpenAI-compatible /v1/chat/completions API for simplified LLM interaction. Agents run on the Pydantic AI Server (PAIS), adding distributed memory, delegation, and instrumentation. This approach leverages Kubernetes for scalability and resilience while standardizing agent communication.

Quick Start & Requirements

  • Prerequisites: Kubernetes cluster, kubectl, helm.
  • Installation: Via CLI (pip install kaos-cli, kaos system install) or Helm charts (helm repo add kaos https://axsaucedo.github.io/kaos/charts, helm install kaos kaos/kaos-operator -n kaos-system --create-namespace).
  • Resources: Full Docs: axsaucedo.github.io/kaos. Web UI: axsaucedo.github.io/kaos-ui.

Highlighted Details

  • Agentic Graphs: Deploy distributed agent networks as Kubernetes resources.
  • MCP Primitives: Standardized tool integration.
  • Multi-Agent Support: Hierarchical systems with automatic delegation.
  • OpenAI-Compatible API: Agents expose /v1/chat/completions.
  • KAOS CLI & Visual Dashboard: Management tools and UI for monitoring/debugging.
  • PAIS Runtime: Enhances Pydantic AI agents with enterprise features.

Maintenance & Community The project appears primarily maintained under axsaucedo. Specific community channels, contributors, sponsorships, or a public roadmap are not detailed in the README.

Licensing & Compatibility Licensed under the permissive Apache 2.0 license, generally allowing commercial use and integration into closed-source projects.

Limitations & Caveats Custom Resource Definitions (CRDs) use the v1alpha1 API version, indicating an experimental and potentially unstable API subject to change.

Health Check
Last Commit

4 days ago

Responsiveness

Inactive

Pull Requests (30d)
46
Issues (30d)
1
Star History
10 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.