Proxify is an open-source, lightweight, self-hosted reverse proxy gateway simplifying access to AI APIs. It tackles regional restrictions and multi-service complexity, offering a unified entry point optimized for LLM streaming responses. Ideal for users needing a secure, efficient, and easily deployable solution for AI API integrations.

How It Works

Built in Go with Gin, Proxify is a high-performance reverse proxy. Its key innovation is deep optimization for LLM streaming: stream smoothing for a "typing effect," heartbeat keepalive to prevent idle timeouts, and tail acceleration for reduced latency. It consolidates access to multiple upstream AI services (e.g., OpenAI, Gemini) via path prefixes defined in routes.json, enabling efficient routing.

Quick Start & Requirements

• Install: Docker is recommended. Pull the latest image (docker pull poixeai/proxify:latest) and run with mounted config files (.env, routes.json). Manual build options exist.
• Prerequisites: Manual builds require Go (1.20+) and Node.js (18+) with pnpm. Docker requires Docker.
• Configuration: .env for environment variables (port, auth); routes.json for upstream API routes (path, target).
• Resource Footprint: Minimal memory usage, runs on servers with as little as 0.5 GB RAM.
• Links: README points to Live Demo, Quick Start, Deployment Guide, Supported Endpoints.

Highlighted Details

• LLM Stream Optimization: Smooth streaming, heartbeat keepalive, tail acceleration.
• Unified API Gateway: Consolidates AI providers via configurable path prefixes.
• Self-Hosted Security: Full control over data, no third-party risks.
• High Performance: Go-based, minimal memory, high concurrency.
• Simplified Integration: Update BaseURL; no code changes needed.

Maintenance & Community

Maintained by an experienced AI team; community contributions (issues, PRs) are welcomed.

Licensing & Compatibility

MIT License: Permissive, suitable for commercial use and closed-source applications.

Limitations & Caveats

Accessible routes depend entirely on user-defined routes.json configuration. Extensibility to arbitrary HTTP APIs requires manual configuration.