NyaProxy is a universal API proxy designed to manage, secure, and optimize access to various online services, particularly AI and image generation APIs. It targets developers and teams needing to efficiently utilize multiple API keys, offering load balancing, failover, rate limiting, and security enhancements. The primary benefit is increased reliability and cost-effectiveness in API integrations.

How It Works

NyaProxy acts as an intermediary, routing client requests to backend API providers. It employs sophisticated strategies like round-robin, least-request, and fastest-response for load balancing across multiple API keys. Failover mechanisms ensure continuous service by automatically switching to healthy keys if one fails. Advanced features include dynamic header substitution, request body transformation using JMESPath, and simulated streaming for improved user experience.

Quick Start & Requirements

• Install: pip install nya-proxy
• Run: nyaproxy
• Prerequisites: Python 3.11+
• Demo: Access http://localhost:8080/config to add API keys.
• Docs: Docker Deployment Guide, PIP Installation Guide

Highlighted Details

• Supports 5 load balancing strategies: Round Robin, Random, Least Request, Fastest Response, Weighted.
• Features granular rate limiting per endpoint and key with smart queuing.
• Enables dynamic header and JSON request body substitution using templating and JMESPath.
• Provides a real-time metrics dashboard for monitoring API traffic and system health.

Maintenance & Community

• Contact: k3scat@gmail.com
• Community: Nya Foundation Discord

Licensing & Compatibility

• License: MIT License.
• Compatibility: Permissive license suitable for commercial and closed-source applications.

Limitations & Caveats

The project is actively developed with a roadmap for Q1/Q2 2025 including documentation enhancements and a plugin system. Security notes emphasize setting a strong master API key for production environments to prevent unauthorized access to sensitive interfaces.