This project provides a basic proxy to enable using Kimi K2 models via the Groq API, specifically targeting users of Claude Code. It simplifies integrating advanced AI models into existing workflows by abstracting API differences.

How It Works

The proxy acts as an intermediary, forwarding requests made to a local endpoint (simulating the Anthropic API) to the Groq API. This allows applications configured to use Anthropic's API to seamlessly interact with Kimi K2 models through Groq's infrastructure, leveraging Groq's speed and efficiency.

Quick Start & Requirements

• Install: brew install astral-sh/uv/uv or pipx install uv.
• Project Setup:

  uv venv .venv
  source .venv/bin/activate
  uv pip install -e .
  

• Environment Variables:
  • GROQ_API_KEY=YOUR_GROQ_API_KEY
  • ANTHROPIC_BASE_URL=http://localhost:7187
  • ANTHROPIC_API_KEY=NOT_NEEDED
• Run: python proxy.py
• Prerequisites: Groq API Key.

Highlighted Details

• Enables Kimi K2 model access through Groq.
• Mimics Anthropic API for compatibility.
• Leverages Groq's low-latency inference.

Maintenance & Community

The project is a personal effort, with a request for users to share their experiences via GitHub Issues.

Licensing & Compatibility

Licensed under the MIT License, permitting commercial use and integration with closed-source applications.

Limitations & Caveats

This is described as a "basic proxy" and may not support all features or edge cases of the Anthropic API or the underlying Kimi K2 models. User feedback is encouraged to identify and address limitations.