axonhub  by looplj

Unified AI gateway and development platform

Created 1 year ago
5,205 stars

Top 9.7% on SourcePulse

GitHubView on GitHub
Project Summary

All-in-one AI Development Platform AxonHub provides a unified API gateway, abstracting OpenAI, Anthropic, and AI SDK-compatible APIs into a single interface. It targets developers and enterprises seeking to streamline AI development workflows, offering simplified API management, enhanced observability through tracing, and robust access controls, thereby reducing vendor lock-in and accelerating prototyping.

How It Works

The platform functions as a transformer pipeline, accepting requests in OpenAI or Anthropic formats and routing them to various AI providers. Its core innovation lies in its unified API layer, automatic request translation, and thread-aware tracing that captures end-to-end request timelines without requiring SDK modifications. This design facilitates deep observability and simplifies debugging across diverse AI model integrations.

Quick Start & Requirements

  • Installation: Offers 1-click deployment to Render, local PC execution via downloaded binaries, server deployment scripts (install.sh, start.sh), and Docker Compose.
  • Prerequisites: Supports multiple databases including TiDB, Neon DB, PostgreSQL (15+), MySQL (8.0+), and SQLite (3.0+). Docker is required for Compose deployments.
  • Links: Demo instance available, official documentation at https://deepwiki.com/looplj/axonhub.

Highlighted Details

  • Unified API Gateway: Supports OpenAI Chat Completions and Anthropic Messages formats, enabling seamless switching between providers.
  • Automatic API Translation: Handles format conversion between OpenAI and Anthropic APIs transparently.
  • Thread-Aware Tracing: Records full request timelines, linking requests into threads for detailed debugging and observability.
  • RBAC Permissions: Implements Role-Based Access Control for fine-grained governance of access and data segregation.
  • Multi-Provider Integration: Facilitates automatic failover and load balancing across different AI service channels.

Maintenance & Community

The project acknowledges inspiration from several open-source libraries. No explicit community channels (e.g., Discord, Slack) or a public roadmap are detailed in the README.

Licensing & Compatibility

  • License: MIT License.
  • Compatibility: Permissive for commercial use and integration into closed-source projects.

Limitations & Caveats

Features such as Rerank, Embedding, Realtime APIs, and full AI SDK compatibility are marked as "Todo" or "Partial." Image generation is also partially supported. Tracing requires specific headers (AH-Trace-Id) for complete request stitching.

Health Check
Last Commit

1 day ago

Responsiveness

Inactive

Pull Requests (30d)
169
Issues (30d)
95
Star History
22 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.