This repository serves as a comprehensive, community-driven catalog of tools, projects, and vendors across the entire Large Language Model (LLM) application stack. It aims to provide a more exhaustive list than initial curated articles, covering everything from data pipelines and embedding models to LLM APIs and cloud hosting platforms, benefiting developers and researchers building LLM-powered applications.

How It Works

The project is structured as a curated list of categorized resources, presented in Markdown tables. Each entry includes the tool's name, a brief description, its GitHub repository link (if available), and PyPI installation command. The maintainers use a combination of manual curation and automated assistance (via Perplexity prompts) to populate and maintain the list, encouraging community contributions via pull requests to ensure comprehensiveness.

Quick Start & Requirements

This repository is a reference list, not a runnable application. No installation or specific requirements are needed to view or contribute to the list. Links to official documentation or GitHub repositories for individual tools are provided within the tables.

Highlighted Details

• Categorizes a wide array of LLM stack components, including data pipelines, embedding models, vector databases, orchestrators, LLM APIs (proprietary and open-source), and hosting platforms.
• Includes specific tools for LLM caching, logging, monitoring, evaluation, and validation, such as Langchain, LlamaIndex, Guardrails AI, and promptfoo.
• Features both commercial and open-source solutions, offering a broad overview of the LLM ecosystem.
• Provides insights into community-driven curation and formatting assistance tools like Perplexity and Cursor.

Maintenance & Community

The project is actively maintained through community contributions via GitHub pull requests. It encourages users to suggest missing projects or corrections.

Licensing & Compatibility

The repository itself is licensed under an unspecified license, but it lists and links to various tools with their own licenses. Users must consult the individual licenses of the tools mentioned for compatibility and usage restrictions.

Limitations & Caveats

While aiming for comprehensiveness, the repository acknowledges that some important projects may still be missing. The accuracy and completeness of information for each listed tool depend on community contributions and the availability of public data.