Discover and explore top open-source AI tools and projects—updated daily.
Rishurajgautam24Free LLM proxy for terminal and VSCode
Top 55.0% on SourcePulse
<2-3 sentences summarising what the project addresses and solves, the target audience, and the benefit.> This project provides a proxy server enabling free access to Claude-like models via NVIDIA NIM, OpenRouter, or local LM Studio, bypassing the need for Anthropic API keys. It targets developers and power users seeking cost-effective and flexible LLM integration for terminal, VSCode, or Discord applications. The primary benefit is significant cost savings and the ability to leverage a wide array of models.
How It Works
This project implements a lightweight proxy server that intercepts standard Anthropic API calls from clients like the Claude Code CLI or VSCode extension. It routes these requests to configured external LLM providers (NVIDIA NIM, OpenRouter, LM Studio), which often expose OpenAI-compatible endpoints. The proxy translates between Anthropic's SSE format and the provider's format, while also performing optimizations like intercepting trivial API calls (e.g., quota probes, title generation) to conserve API quota and reduce latency. It also supports parsing Claude-specific tags like <think>.
Quick Start & Requirements
Installation involves cloning the repository, copying .env.example to .env, and configuring API keys or local endpoints within the .env file. The proxy server is started using uv run uvicorn server:app --host 0.0.0.0 --port 8082. Clients (CLI, VSCode) are then configured to point to http://localhost:8082 with a specific auth token (freecc). Prerequisites include uv (Rust-based Python package installer), Python, and potentially fzf for the interactive model picker (claude-pick). API keys for NVIDIA NIM or OpenRouter are required unless using LM Studio locally, which must be running separately. Links to provider setup: NVIDIA NIM, OpenRouter, LM Studio.
Highlighted Details
claude-pick command (requires fzf) for dynamically choosing models from the configured provider at runtime.Maintenance & Community
The project follows standard GitHub contribution workflows for bug reports, feature suggestions, and pull requests. While it integrates Discord and Telegram bots for autonomous agent functionality, direct links to community servers or active developer channels are not provided in the README.
Licensing & Compatibility
This project is licensed under the MIT License, permitting commercial use and modification.
Limitations & Caveats
Docker integration is explicitly not supported at this time. Users must manage API keys for external providers or run LM Studio locally. The project's Python 3.14 badge may indicate a future target or a typo, as this version is not yet released.
3 months ago
Inactive