compressed-tensors by vllm-project

Benchmarking language agents for diverse, long-horizon tool use

Starred 1 month ago by

Elie Bursztein(Cybersecurity Lead at Google DeepMind). Also starred by

Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA).

Toolathlon by hkust-nlp

477

Evaluates agents on 600+ real-world tools across realistic, complex, long-horizon tasks.
Utilizes Dockerized environments and decoupled loops for flexible agent scaffold integration.
Supports multiple agent frameworks including OpenAI SDK and OpenHands compatibility.
Provides a public evaluation service and trajectory visualization for analysis.

Created 10 months ago

Updated 2 weeks ago

Starred 1 month ago by

Pawel Garbacki(Cofounder of Fireworks AI).

awesome-ai-leaderboard by SAILResearch

382

Curated list of foundation model leaderboards

Comprehensive list of leaderboards for text, image, code, video, audio, etc.
Includes tools for leaderboard deployment, management, and result scraping.
Covers challenges, rankings, and evaluation organizations.

Created 2 years ago

Updated 1 week ago

Starred 1 month ago by

Yaowei Zheng(Author of LLaMA-Factory). Also starred by

Jeremy Howard(Cofounder of fast.ai).

claude-code-docs by ericbuess

979

Local Claude documentation access

Provides fast, local access to Claude documentation, bypassing web fetches.
Integrates with Claude for enhanced documentation exploration and querying.
Features automatic updates and a changelog for tracking documentation changes.
Supports macOS and Linux, with ongoing efforts for Windows compatibility.

Open-source database of AI model specifications

Starred 1 month ago by

Tim J. Baek(Founder of Open WebUI). Also starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Shawn Wang(Editor of Latent Space),

Simon Willison(Coauthor of Django), and

6 more.

models.dev by anomalyco

0.1%

Catalog AI models with details on pricing, capabilities, and modalities
Supports text, image, audio, video, and PDF inputs
Tracks reasoning, tool calling, and file attachment support
Community-driven data collection via TOML files and pull requests

Starred 1 month ago by

Didier Lopes(Founder of OpenBB). Also starred by

Eiso Kant(Cofounder of Poolside AI),

Jeff Hammerbacher(Cofounder of Cloudera),

Andrey Vasnetsov(Cofounder of Qdrant), and

1 more.

cocoindex by cocoindex-io

Real-time data transformation framework for AI indexing

11k

Incremental index updates based on source changes, minimizing computation.
Supports custom transformation logic for data extraction and indexing.
Integrates with Postgres (pgvector) and Qdrant for vector storage.
Includes examples for text, code, PDF embedding, and knowledge graphs.

Updated 4 days ago

Starred 1 month ago by

Travis Fischer(Founder of Agentic). Also starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jeff Hammerbacher(Cofounder of Cloudera), and

Jeremy Howard(Cofounder of fast.ai).

moonshine by moonshine-ai

Speech-to-text models optimized for fast, accurate ASR on edge devices

11k

Enables real-time, on-device applications like live transcription and voice command recognition.
Outperforms similarly-sized Whisper models on OpenASR leaderboard datasets.
Offers Keras-based inference with Torch, TensorFlow, and JAX backends.
Supports ONNX runtime for SBCs like Raspberry Pi; HuggingFace Transformers integration.

Updated 4 days ago

Starred 1 month ago by

Jeff Hammerbacher(Cofounder of Cloudera). Also starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Meng Zhang(Cofounder of TabbyML), and

Travis Fischer(Founder of Agentic).

spider by spider-rs

High-performance web crawler and scraper

Concurrent, streaming web crawling for large-scale data curation and processing.
Flexible rendering via HTTP, Chrome DevTools Protocol, or WebDriver for dynamic content.
Multimodal AI agent for web automation, research synthesis, and LLM/search provider integration.
Production-ready features include anti-bot mitigation, caching, and distributed crawling.

Created 8 years ago

Starred 1 month ago by

Magnus Müller(Cofounder of Browser Use). Also starred by

Chaoyu Yang(Founder of Bento),

Luis Capelo(Cofounder of Lightning AI),

Patrick von Platen(Author of Hugging Face Diffusers; Research Engineer at Mistral), and

4 more.

ktransformers by kvcache-ai

Framework for LLM inference optimization experimentation

19k

Optimizes Transformers with kernel-level and parallelism strategies.
Supports OpenAI/Ollama-compliant REST APIs and ChatGPT-like web UI.
Focuses on local deployments with GPU/CPU offloading of quantized models.
Supports AMX-Int8, AMX-BF16, Qwen3MoE, LLaMA, unsloth weights, and FP8 GPU kernels.

Created 2 years ago

Updated 2 days ago

Starred 1 month ago by

Mckay Wrigley(Founder of Takeoff AI). Also starred by

Omar Sanseviero(DevRel at Google DeepMind),

Didier Lopes(Founder of OpenBB),

Jason Huggins(Creator of Selenium), and

18 more.

hermes-agent by NousResearch

0.1%

241k

Autonomous AI agent for persistent learning and task automation

Integrates across messaging platforms (Telegram, Discord, Slack, WhatsApp) with scheduled automations.
Supports diverse LLM providers, voice transcription/synthesis, and web browsing tools.
Offers robust sandboxing (Docker, SSH, Modal) and a skill-based knowledge system.
Research-ready for parallel batch processing and reinforcement learning model training.