This repository is a curated list of open-source Artificial Intelligence resources, focusing on inference engines, language models, and tools that adhere to the Open Source Initiative definition. It serves AI researchers, developers, and power users seeking high-quality, permissively licensed AI components.

How It Works

The list categorizes resources across various AI domains, including inference engines (e.g., koboldcpp, llama.cpp, Ollama), language models (e.g., DeepSeek-R1, Granite 3.1, Qwen 2.5), embedding models, image, audio, and video models, and supporting tools. It highlights models and engines known for specific strengths like reasoning, low-end hardware deployment, or long context windows, often referencing benchmark performance and compatibility with other tools.

Highlighted Details

• Inference engines like Ollama offer OpenAI-compatible API servers for ease of use.
• Language models such as Qwen 2.5 and its variants excel in benchmarks for math and coding, with some supporting up to 1M token context lengths.
• InternVL 2.5 is noted for vision-related tasks, outperforming competitors on benchmarks.
• Tools include scripts for LLM finetuning and synthetic dataset generation, alongside user interfaces like Open WebUI.

Maintenance & Community

This is a curated list, and maintenance status or community activity for individual linked projects is not detailed here.

Licensing & Compatibility

The list prioritizes resources meeting the Open Source Initiative (OSI) definition. However, specific licensing details and compatibility for commercial use or closed-source linking depend on each individual linked project, with some models having specific non-open-source variants or components noted.

Limitations & Caveats

The list is a directory and does not provide direct access to the AI resources themselves. Some listed models have specific components or variants that are not open-source, requiring careful review of each project's licensing. Several categories (Image, Audio STT, Video) are marked as "Coming soon."