axonhub  by looplj

Unified AI gateway and development platform

Created 2 months ago
546 stars

Top 58.4% on SourcePulse

GitHubView on GitHub
Project Summary

All-in-one AI Development Platform AxonHub provides a unified API gateway, abstracting OpenAI, Anthropic, and AI SDK-compatible APIs into a single interface. It targets developers and enterprises seeking to streamline AI development workflows, offering simplified API management, enhanced observability through tracing, and robust access controls, thereby reducing vendor lock-in and accelerating prototyping.

How It Works

The platform functions as a transformer pipeline, accepting requests in OpenAI or Anthropic formats and routing them to various AI providers. Its core innovation lies in its unified API layer, automatic request translation, and thread-aware tracing that captures end-to-end request timelines without requiring SDK modifications. This design facilitates deep observability and simplifies debugging across diverse AI model integrations.

Quick Start & Requirements

  • Installation: Offers 1-click deployment to Render, local PC execution via downloaded binaries, server deployment scripts (install.sh, start.sh), and Docker Compose.
  • Prerequisites: Supports multiple databases including TiDB, Neon DB, PostgreSQL (15+), MySQL (8.0+), and SQLite (3.0+). Docker is required for Compose deployments.
  • Links: Demo instance available, official documentation at https://deepwiki.com/looplj/axonhub.

Highlighted Details

  • Unified API Gateway: Supports OpenAI Chat Completions and Anthropic Messages formats, enabling seamless switching between providers.
  • Automatic API Translation: Handles format conversion between OpenAI and Anthropic APIs transparently.
  • Thread-Aware Tracing: Records full request timelines, linking requests into threads for detailed debugging and observability.
  • RBAC Permissions: Implements Role-Based Access Control for fine-grained governance of access and data segregation.
  • Multi-Provider Integration: Facilitates automatic failover and load balancing across different AI service channels.

Maintenance & Community

The project acknowledges inspiration from several open-source libraries. No explicit community channels (e.g., Discord, Slack) or a public roadmap are detailed in the README.

Licensing & Compatibility

  • License: MIT License.
  • Compatibility: Permissive for commercial use and integration into closed-source projects.

Limitations & Caveats

Features such as Rerank, Embedding, Realtime APIs, and full AI SDK compatibility are marked as "Todo" or "Partial." Image generation is also partially supported. Tracing requires specific headers (AH-Trace-Id) for complete request stitching.

Health Check
Last Commit

1 day ago

Responsiveness

Inactive

Pull Requests (30d)
80
Issues (30d)
10
Star History
352 stars in the last 30 days

Explore Similar Projects

Starred by Travis Fischer Travis Fischer(Founder of Agentic), Dax Dax(Core Contributor to opencode, SST), and
1 more.

opencontrol by sst

0%
700
AI gateway for infrastructure control
Created 9 months ago
Updated 6 months ago
Starred by Tobi Lutke Tobi Lutke(Cofounder of Shopify), Andrej Karpathy Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and
27 more.

open-webui by open-webui

0.5%
117k
Self-hosted AI platform for local LLM deployment
Created 2 years ago
Updated 23 hours ago
Feedback? Help us improve.