Discover and explore top open-source AI tools and projects—updated daily.
helloyangyProxy LLM APIs for seamless, continuous access
Top 91.4% on SourcePulse
This project offers CLIProxyAPI, a reverse proxy solution designed to simplify and enhance access to large language model (LLM) APIs. It addresses the need for a compatible and user-friendly intermediary, enabling developers and power users to integrate LLM services more efficiently. The primary benefit is a streamlined approach to managing API calls, abstracting provider-specific complexities and facilitating rapid deployment, particularly for continuous or centralized LLM usage.
How It Works
CLIProxyAPI acts as an intermediary service, intercepting requests and forwarding them to configured LLM APIs. It utilizes a YAML configuration file (config.yaml) to manage API endpoints, authentication credentials, and proxy settings, supporting a range of "mainstream LLM providers." This design allows for a unified API interface (http://localhost:8317/v1), simplifying application integration and potentially enabling centralized control over LLM access. The approach prioritizes broad compatibility and ease of setup.
Quick Start & Requirements
config.example.yaml to config.yaml and modify allow-remote to true and set a secret-key.cli-proxy-api.exe executable from the project directory.http://localhost:8317/management.html using the configured secret key.https://t.me/wzxylh.Highlighted Details
http://localhost:8317/v1) for proxied LLM services.qwen3-coder-plus model.Maintenance & Community
https://t.me/wzxylh.Licensing & Compatibility
Limitations & Caveats
2 months ago
Inactive
PrefectHQ
BerriAI