qwen-free-api  by LLM-Red-Team

Free API for Qwen 2.5 LLM

created 1 year ago
991 stars

Top 38.2% on sourcepulse

GitHubView on GitHub
Project Summary

This project provides a reverse-engineered API for Alibaba's Qwen 2.5 LLM, targeting developers and researchers who need to integrate its advanced capabilities into their applications. It offers a free, self-hostable alternative to official APIs, enabling features like high-speed streaming, watermark-free image generation, long document analysis, image interpretation, and web search, all with a ChatGPT-compatible interface.

How It Works

The API acts as a proxy, leveraging user-provided authentication tokens (SSO tickets) obtained from the official Qwen web interface. It then forwards requests to the Qwen backend, processing responses and returning them in a format compatible with OpenAI's API. This approach bypasses the need for official API keys, allowing for free access to the model's functionalities.

Quick Start & Requirements

  • Install/Run: Docker is the recommended deployment method.
    docker run -it -d --init --name qwen-free-api -p 8000:8000 -e TZ=Asia/Shanghai vinlic/qwen-free-api:latest
    
  • Prerequisites: A server with a public IP address and port 8000 open. User authentication tokens (tongyi_sso_ticket or login_aliyunid_ticket) are required.
  • Setup: Minimal setup time if Docker is available.
  • Docs: Qwen AI Free Service

Highlighted Details

  • Fully compatible with OpenAI's API endpoints (/v1/chat/completions, /v1/images/generations).
  • Supports multi-account access by concatenating tokens.
  • Includes specific Nginx configurations for optimizing streaming output.
  • Offers demos for various functionalities like multi-turn conversation, image generation, and document analysis.

Maintenance & Community

The project is part of a larger initiative by "LLM-Red-Team" to provide free APIs for various LLMs. Links to other similar projects are provided. Community support channels are not explicitly mentioned.

Licensing & Compatibility

The project is explicitly stated as "for testing only" and "not for commercial use." It is intended for personal research and learning. The README strongly advises using the official Alibaba Cloud platform for commercial applications to avoid potential service disruptions or account bans.

Limitations & Caveats

This is a reverse-engineered API, making it inherently unstable and subject to changes by the official Qwen service. The project disclaims responsibility for any risks associated with its use, including potential account bans or service interruptions. Token validity is not guaranteed, and frequent checks are discouraged.

Health Check
Last commit

2 months ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
115 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.