Summary

CrossLink offers a unified LLM API gateway, abstracting diverse AI providers. It presents a single endpoint supporting OpenAI and Anthropic formats, eliminating vendor lock-in and simplifying integration. The gateway enhances resilience and manageability via intelligent routing and failover.

How It Works

This universal adapter exposes dual OpenAI/Anthropic endpoints, routing requests to providers like OpenAI, Anthropic, DeepSeek, and Ollama using six strategies (e.g., least latency, least cost). It features bidirectional protocol translation (SSE, tool use), automatic failover with circuit breakers, and Redis-based caching for robust multi-provider LLM orchestration.

Quick Start & Requirements

• Primary Install: Recommended: docker compose -f deployments/docker-compose.dev.yaml up --build. China network: docker compose -f deployments/docker-compose.cn.yaml up --build.
• Build from Source: Requires Go 1.22+, PostgreSQL 14+, Redis 7+. Clone repo, configure configs/config.yaml, then make build and run ./bin/crosslink.
• Prerequisites: Go 1.22+, PostgreSQL 14+, Redis 7+, Docker Compose.
• Links: Get Started, Features, API Docs, CONTRIBUTING.md.

Highlighted Details

• Dual Protocol: Supports OpenAI /v1/chat/completions and Anthropic /v1/messages with bidirectional translation.
• Multi-Provider Routing: Integrates OpenAI, Anthropic, Azure, DeepSeek, Qwen, Ollama, etc., using 6 routing strategies.
• Resilience: Automatic failover, circuit breakers, configurable retries, and error classification.
• Security & Control: Per-key rate limiting, RBAC, budget management, content safety framework.
• MCP Gateway: Implements Model Context Protocol for tool discovery and permissions.
• Admin Dashboard: Built-in Vue 3 UI for managing resources.
• Cryptography: Supports standard or Chinese national cryptography (SM3/SM2/SM4).

Maintenance & Community

Provides clear contribution (CONTRIBUTING.md) and security (SECURITY.md) guidelines. No direct community links (Discord/Slack) are listed, but the structure suggests active development.

Licensing & Compatibility

Licensed under Apache License 2.0, permissive for commercial use and closed-source applications.

Limitations & Caveats

Requires specific Go, PostgreSQL, and Redis versions. A dedicated GM (Chinese National Cryptography) deployment is available, implying potential setup nuances. No explicit mention of alpha status, known bugs, or unsupported platforms found.