ccNexus  by lich0821

Smart API gateway for LLM endpoint management

Created 2 months ago
622 stars

Top 53.1% on SourcePulse

GitHubView on GitHub
Project Summary

Summary

ccNexus is a smart API gateway for Claude Code, enabling automatic endpoint rotation, usage monitoring, and seamless integration with OpenAI, Gemini, and other LLM platforms. It targets users managing multiple API keys, seeking high availability, and aiming for cost optimization. The core benefit is a robust, flexible, and secure proxy for diverse LLM API interactions without client-side changes.

How It Works

Operating as a local HTTP proxy (default localhost:3000), ccNexus routes requests from Claude Code to configured API endpoints sequentially. It features automatic failover to the next available endpoint upon failure and includes a smart retry mechanism. A key capability is its format conversion between Claude, OpenAI, and Gemini APIs, allowing interchangeable use of different LLM backends.

Quick Start & Requirements

Pre-built binaries are available for Windows, macOS, and Linux. Installation involves downloading, extracting, and running the executable. Development requires Go 1.22+ and Node.js 18+; Linux needs GTK3. Setup entails adding API endpoints (URL, key, transformer, model) via the UI and configuring Claude Code to point to the local proxy.

Highlighted Details

  • Auto Endpoint Rotation: Failover to the next available endpoint.
  • Multi-Format Support: Converts between Claude, OpenAI, and Gemini API formats.
  • Smart Retry: Automatic retries for failed requests.
  • Real-time Monitoring: Tracks requests, errors, and token usage with SQLite historical data.
  • Cross-Platform GUI: User-friendly desktop app on Windows, macOS, Linux with themes and bilingual support.
  • WebDAV Sync: Synchronizes configurations and statistics across devices.

Maintenance & Community

Maintained by "Chuck" under the MIT license. Community channels (Discord/Slack), detailed contributor information, or a public roadmap are not specified in the README. Users are directed to a group for feedback, but a direct link is absent.

Licensing & Compatibility

Licensed under the MIT License, ccNexus is highly permissive for commercial use and integration into closed-source applications.

Limitations & Caveats

Users may encounter security warnings for unsigned binaries on macOS/Windows, requiring manual overrides. Token statistics are estimates. Linux users must ensure GTK3 is installed.

Health Check
Last Commit

18 hours ago

Responsiveness

Inactive

Pull Requests (30d)
21
Issues (30d)
18
Star History
230 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems") and David Cramer David Cramer(Cofounder of Sentry).

llmgateway by theopenco

1.6%
791
LLM API gateway for unified provider access
Created 9 months ago
Updated 1 day ago
Feedback? Help us improve.