Wei-Lin Chiang

Cofounder of LMArena

Starred Projects (117)

SkyRL by NovaSky-AI

RL training pipeline for multi-turn tool use LLMs, optimized for real-world tasks

zhyncs:

lewtun:

hiyouga:

WoosukKwon:

Created 11 months ago

Updated 1 day ago

bullshit-benchmark by petergpt

AI benchmark for critical response evaluation

alexanderatallah:

aangelopoulos:

Created 1 month ago

Updated 1 day ago

KernelBench by ScalingIntelligence

Benchmark for LLMs generating GPU kernels from PyTorch ops

luiscape:

xiezhq-hermann:

chiphuyen:

aksh-at:

Created 1 year ago

Updated 2 weeks ago

GamingAgent by lmgame-org

SDK for LLM/VLM gaming agents, enabling model evaluation via games

winglian:

hiyouga:

Created 1 year ago

Updated 4 months ago

PostTrainBench by aisa-group

Automating LLM post-training research and development

vincentweisser:

pgarbacki:

omarsar:

Created 4 months ago

Updated 5 days ago

pi-mono by badlogic

AI agent framework and LLM deployment tools

gaearon:

didierrlopes:

pgarbacki:

brendanfalk:

Created 8 months ago

Updated 1 day ago

open-lovable by firecrawl

Build React apps instantly with AI chat

chiphuyen:

torantulino:

hugs:

kerollmops:

Created 8 months ago

Updated 4 months ago

qwen-code by QwenLM

AI coding agent for complex codebases

developit:

JustinLin610:

chiphuyen:

victortaelin:

Created 9 months ago

Updated 14 hours ago

gemini-cli by google-gemini

AI agent for terminal workflows

ValentaTomas:

MagMueller:

lucidrains:

khou22:

Created 1 year ago

Updated 1 day ago

ai by vercel

AI SDK for building AI-powered applications and agents

rauchg:

jaredpalmer:

didierrlopes:

smthomas:

Created 2 years ago

Updated 1 day ago

p2l by lmarena

Prompt-to-Leaderboard for LLM evaluation

zjasper666:

simonw:

aangelopoulos:

Created 1 year ago

Updated 11 months ago

browser-use by browser-use

SDK for AI agent browser control

tjbck:

gregpr07:

shimmyshimmer:

khou22:

Created 1 year ago

Updated 23 hours ago

llm-leaderboard by JonathanChavezTamales

LLM benchmark and pricing data repository

thomwolf:

Created 1 year ago

Updated 5 months ago

OpenHands by OpenHands

AI platform for software development agents

truell20:

pgarbacki:

khou22:

yiranwu0:

Created 2 years ago

Updated 21 hours ago

sglang by sgl-project

Fast serving framework for LLMs and vision language models

amin3141:

shimmyshimmer:

beyang:

samlambert:

Created 2 years ago

Updated 13 hours ago

open-webui by open-webui

Self-hosted AI platform for local LLM deployment

tobi:

karpathy:

wesm:

hammer:

Created 2 years ago

Updated 23 hours ago

cambrian by cambrian-mllm

Multimodal LLM research paper with vision-centric design

hammer:

hiyouga:

rwightman:

rstojnic:

Created 1 year ago

Updated 5 months ago

copilot-arena by lmarena

VS Code extension for paired LLM autocomplete to evaluate coding assistance

yiranwu0:

aangelopoulos:

Created 1 year ago

Updated 4 months ago

RouteLLM by lm-sys

Framework for LLM routing and cost reduction (research paper)

chiphuyen:

ebursztein:

hammer:

ogabrielluiz:

Created 1 year ago

Updated 1 year ago

llm.c by karpathy

LLM training in pure C/CUDA, no PyTorch needed

norvig:

alexey-milovidov:

didierrlopes:

hiyouga:

Created 2 years ago

Updated 9 months ago

arena-hard-auto by lmarena

Automatic LLM benchmark for instruction-tuned models, correlating with human preference

hiyouga:

pgarbacki:

mlabonne:

zhuohan123:

Created 2 years ago

Updated 9 months ago

BERTopic by MaartenGr

Topic modeling with transformers and c-TF-IDF

hammer:

shizhediao:

chiphuyen:

parano:

Created 5 years ago

Updated 1 month ago

llm-decontaminator by lm-sys

LLM contamination detector for quantifying rephrased samples

casper-hansen:

huybery:

merrymercy:

Ying1123:

Created 2 years ago

Updated 2 years ago

AgentBench by THUDM

Benchmark for evaluating LLMs as agents across diverse environments

omarsar:

vincentweisser:

chiphuyen:

victortaelin:

Created 2 years ago

Updated 2 months ago

grade-school-math by openai

Dataset for grade school math word problems

hiyouga:

omarsar:

Edward-Sun:

Created 4 years ago

Updated 2 years ago

gorilla by ShishirPatil

LLM tool-use framework for API invocation and function calling

lewtun:

gakonst:

chiphuyen:

parano:

Created 2 years ago

Updated 2 weeks ago

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

tobi:

clmnt:

tjbck:

chiphuyen:

Created 3 years ago

Updated 3 weeks ago

bitsandbytes by bitsandbytes-foundation

PyTorch library for k-bit quantization, enabling accessible LLMs

lysandrejik:

tjbck:

alexchen4ai:

danielhanchen:

Created 4 years ago

Updated 2 days ago

awesome-tensor-compilers by merrymercy

Curated list of tensor compiler projects and papers

chiphuyen:

Ying1123:

luiscape:

suquark:

Created 5 years ago

Updated 1 year ago

llm-vscode by huggingface

VSCode extension for LLM-powered code development

jaredpalmer:

vincentweisser:

lvwerra:

gregpr07:

Created 3 years ago

Updated 1 week ago

tinygrad by tinygrad

Minimalist deep learning framework for education and exploration

geohot:

ebursztein:

millionintegrals:

k06a:

Created 5 years ago

Updated 19 hours ago

Megatron-LM by NVIDIA

Framework for training transformer models at scale

chiphuyen:

jiamings:

gravicle:

alexchen4ai:

Created 7 years ago

Updated 1 day ago

gorilla-cli by gorilla-llm

CLI tool using LLMs to generate commands

luiscape:

merrymercy:

pirroh:

zhuohan123:

Created 2 years ago

Updated 1 year ago

vllm by vllm-project

LLM serving engine for high-throughput, memory-efficient inference

karpathy:

clmnt:

tobi:

willingc:

Created 3 years ago

Updated 14 hours ago

audiocraft by facebookresearch

PyTorch library for audio processing and generation research

hiyouga:

Jiayi-Pan:

jn2clark:

calvinfo:

Created 2 years ago

Updated 1 month ago

instruct-eval by declare-lab

Evaluation code for instruction-tuned LLMs

hiyouga:

Created 3 years ago

Updated 2 years ago

MineDojo by MineDojo

AI research framework for embodied agents in Minecraft

chenlin9:

huybery:

ageron:

Created 3 years ago

Updated 2 years ago

Voyager by MineDojo

Minecraft agent for open-ended embodied learning via LLMs

suquark:

atroyn:

omarsar:

eugeneyan:

Created 2 years ago

Updated 2 years ago

chain-of-thought-hub by FranxYao

LLM benchmark for complex reasoning via chain-of-thought prompting

jph00:

hammer:

transitive-bullshit:

JustinLin610:

Created 3 years ago

Updated 1 year ago

qlora by artidoro

Finetuning tool for quantized LLMs

tobi:

chiphuyen:

vincentweisser:

jph00:

Created 2 years ago

Updated 1 year ago

awesome-chatgpt-dataset by voidful

Dataset repo for LLM training

Ying1123:

Created 3 years ago

Updated 5 months ago

shap-e by openai

3D object generator conditioned on text or images

vincentweisser:

stammy:

shyamal-anadkat:

osanseviero:

Created 3 years ago

Updated 1 year ago

whisper by openai

Speech recognition model for multilingual transcription/translation

bcherny:

karpathy:

ekzhu:

gregpr07:

Created 3 years ago

Updated 2 weeks ago

guidance by guidance-ai

Guidance is a programming paradigm for steering LLMs

tobi:

ekzhu:

stas00:

Ying1123:

Created 3 years ago

Updated 2 days ago

evalplus by evalplus

LLM code evaluation framework for rigorous testing

shizhediao:

chiphuyen:

huybery:

wsxiaoys:

Created 3 years ago

Updated 6 months ago

open_llama by openlm-research

Open-source reproduction of LLaMA models

chiphuyen:

shizhediao:

ebursztein:

zhuohan123:

Created 2 years ago

Updated 2 years ago

mlc-llm by mlc-ai

Universal LLM deployment engine with ML compilation

tobi:

osanseviero:

zhiyuan8:

zhuohan123:

Created 2 years ago

Updated 2 days ago

LoRA by microsoft

PyTorch library for low-rank adaptation (LoRA) of LLMs

chiphuyen:

patrickvonplaten:

hammer:

zhiyuan8:

Created 4 years ago

Updated 1 year ago

bark by suno-ai

Generative audio model for realistic speech and sound effects

tobi:

jiamings:

pgarbacki:

chiphuyen:

Created 3 years ago

Updated 1 year ago

web-llm by mlc-ai

In-browser LLM inference engine using WebGPU for hardware acceleration

tobi:

didierrlopes:

doriandarko:

osanseviero:

Created 3 years ago

Updated 4 days ago

promptsource by bigscience-workshop

Toolkit for creating, sharing, and using natural language prompts

clmnt:

chiphuyen:

jph00:

teknium1:

Created 4 years ago

Updated 2 years ago

AutoGPT by Significant-Gravitas

AI agent platform for building, deploying, and running autonomous workflows

lilianweng:

chiphuyen:

julien-c:

deshraj:

Created 3 years ago

Updated 13 hours ago

evals by openai

Framework for evaluating LLMs and LLM systems, plus benchmark registry

aangelopoulos:

chiphuyen:

agola11:

taranjeet:

Created 3 years ago

Updated 6 days ago

EasyLM by young-geng

LLM training/finetuning framework in JAX/Flax

Jiayi-Pan:

chiphuyen:

shizhediao:

zhuohan123:

Created 3 years ago

Updated 1 year ago

GPT-4-LLM by Instruction-Tuning-with-GPT-4

GPT-4 data for instruction-tuning LLMs via supervised/RL

jph00:

gakonst:

marcklingen:

teknium1:

Created 3 years ago

Updated 2 years ago

tabby by TabbyML

Self-hosted AI coding assistant for on-prem code completion

tobi:

didierrlopes:

joewalnes:

wsxiaoys:

Created 3 years ago

Updated 1 month ago

Instructgpt-prompts by kevinamiri

Instruction-following prompts for ChatGPT, GPT-3.5, GPT-4

hiyouga:

Created 3 years ago

Updated 5 months ago

flash-attention by Dao-AILab

Fast, memory-efficient attention implementation

karpathy:

Jiayi-Pan:

zhiyuan8:

alexchen4ai:

Created 3 years ago

Updated 1 day ago

Prompt-Engineering-Guide by dair-ai

Prompt engineering resource for language model (LLM) applications

lilianweng:

tunguz:

rodrigosnader:

comaniac:

Created 3 years ago

Updated 1 month ago

FastChat by lm-sys

Open platform for training, serving, and evaluating LLM-based chatbots

zjasper666:

aangelopoulos:

osanseviero:

natolambert:

Created 3 years ago

Updated 10 months ago

iree by iree-org

MLIR-based compiler and runtime toolkit for machine learning models

zhyncs:

ogabrielluiz:

mfuntowicz:

parano:

Created 6 years ago

Updated 18 hours ago

clusterdata by alibaba

Production cluster traces for data center research

simon-mo:

Created 8 years ago

Updated 1 month ago

sparseml by neuralmagic

Sparsification toolkit for optimized neural networks

chiphuyen:

shawnlewis:

hammer:

stas00:

Created 5 years ago

Updated 10 months ago

deepsparse by neuralmagic

CPU inference runtime for sparse deep learning models

chiphuyen:

casper-hansen:

luiscape:

hammer:

Created 5 years ago

Updated 10 months ago

langchain by langchain-ai

Framework for building LLM-powered applications

karpathy:

MagMueller:

gregpr07:

willingc:

Created 3 years ago

Updated 14 hours ago

accelerate by huggingface

PyTorch training helper for distributed execution

clmnt:

chiphuyen:

eugeneyan:

pgarbacki:

Created 5 years ago

Updated 2 days ago

llama by meta-llama

Inference code for Llama 2 models (deprecated)

froystig:

xiezhq-hermann:

fabhed:

borzunov:

Created 3 years ago

Updated 1 year ago

mistral by stanford-crfm

Framework for large language model training

clmnt:

osanseviero:

parasj:

patrickvonplaten:

Created 5 years ago

Updated 1 month ago

FlexLLMGen by FMInference

High-throughput generation engine for LLMs with limited GPU memory

chiphuyen:

jrk:

jph00:

parano:

Created 3 years ago

Updated 1 year ago

picoGPT by jaymody

Minimal GPT-2 implementation in NumPy for demonstration

victortaelin:

eugeneyan:

transitive-bullshit:

omarsar:

Created 3 years ago

Updated 3 years ago

automatic_prompt_engineer by keirp

Automatic prompt engineer for LLM instruction generation

shyamal-anadkat:

transitive-bullshit:

Edward-Sun:

ekzhu:

Created 3 years ago

Updated 1 year ago

cleanrl by vwxyzjn

RL algorithms implementation with research-friendly features

sxyu:

john-b-yang:

lysandrejik:

natolambert:

Created 6 years ago

Updated 9 months ago

nanoGPT by karpathy

Minimalist repo for training/finetuning GPT models

tobi:

danielgross:

chiphuyen:

ankane:

Created 3 years ago

Updated 5 months ago

prompts.chat by f

Prompt collection for LLM tools

tjbck:

eugeneyan:

swyxio:

dguido:

Created 3 years ago

Updated 18 hours ago

mlflow by mlflow

ML lifecycle platform for managing experiments, models, and deployments

mateiz:

jn2clark:

thinkall:

eugeneyan:

Created 7 years ago

Updated 13 hours ago

metaflow by Netflix

Framework for building and managing AI/ML systems

omarsar:

winglian:

willingc:

hsbt:

Created 6 years ago

Updated 1 day ago

AzurePublicDataset by Azure

Public Azure traces for cloud workload research

simon-mo:

Created 8 years ago

Updated 4 months ago

open_clip by mlfoundations

OpenCLIP: open-source CLIP implementation for vision-language representation learning

ekzhang:

jeresig:

c4pt0r:

taranjeet:

Created 4 years ago

Updated 6 days ago

tpu-starter by ayaka14732

TPU guide for JAX-based ML workflows on Google Cloud

Jiayi-Pan:

philschmid:

osanseviero:

Created 4 years ago

Updated 1 year ago

ludwig by ludwig-ai

Low-code framework for custom AI models (LLMs, neural networks)

aravindsrinivas:

winglian:

w4nderlust:

wesm:

Created 7 years ago

Updated 13 hours ago

dalle-mini by borisdayma

Text-to-image model for generating images from text prompts

karpathy:

hardmaru:

codekansas:

casper-hansen:

Created 4 years ago

Updated 2 years ago

alpa by alpa-projects

Auto-parallelization framework for large-scale neural network training and serving

chiphuyen:

Jiayi-Pan:

transitive-bullshit:

soldni:

Created 5 years ago

Updated 2 years ago

skypilot by skypilot-org

Framework for cloud AI/batch jobs, unifying execution across diverse infrastructure

karpathy:

tobi:

amin3141:

luiscape:

Created 4 years ago

Updated 21 hours ago

D4RL by Farama-Foundation

Benchmark for offline reinforcement learning

Created 6 years ago

Updated 1 year ago

pixel2style2pixel by eladrich

Image-to-image translation framework using StyleGAN encoder

jn2clark:

tvst:

chuanli11:

agermanidis:

Created 5 years ago

Updated 3 years ago

BigGAN-PyTorch by ajbrock

PyTorch code for BigGAN image synthesis research paper

aravindsrinivas:

jn2clark:

shizhediao:

jiamings:

Created 7 years ago

Updated 2 years ago

StyleCLIP by orpatashnik

Text-driven StyleGAN imagery manipulation via CLIP models

luiscape:

borzunov:

bfirsh:

chenlin9:

Created 5 years ago

Updated 2 years ago

dgl by dmlc

Python package for deep learning on graphs

osanseviero:

jiamings:

xiezhq-hermann:

parasj:

Created 8 years ago

Updated 8 months ago

benchm-ml by szilard

ML benchmark for speed, scalability, accuracy of classification libraries

bcherny:

tholor:

eiso:

vnivargi:

Created 11 years ago

Updated 3 years ago

cloudml-samples by GoogleCloudPlatform

ML training and prediction samples for Google Cloud Platform

aravindsrinivas:

AntonOsika:

vnivargi:

Created 9 years ago

Updated 4 years ago

PaddleSpeech by PaddlePaddle

Speech toolkit for ASR, TTS, speaker verification, translation, and keyword spotting

chiphuyen:

PiotrDabkowski:

trishume:

Created 8 years ago

Updated 1 day ago

speech-to-text-wavenet by buriburisuri

Speech recognition using WaveNet in TensorFlow

parano:

cvalenzuela:

transitive-bullshit:

pathak22:

Created 9 years ago

Updated 4 years ago

baselines by openai

RL algorithm implementations for research

aravindsrinivas:

lilianweng:

JohannesHa:

jspahrsummers:

Created 9 years ago

Updated 1 year ago

horovod by horovod

Distributed training framework for TF, Keras, PyTorch, and MXNet

aravindsrinivas:

fchollet:

winglian:

transitive-bullshit:

Created 8 years ago

Updated 4 months ago

SynapseML by microsoft

Distributed ML library for large-scale data processing

hammer:

AntonOsika:

lantiga:

deshraj:

Created 8 years ago

Updated 2 days ago

tvm by apache

Compiler stack for deep learning systems

aravindsrinivas:

transitive-bullshit:

guberti:

wesm:

Created 9 years ago

Updated 16 hours ago

ray by ray-project

AI compute engine for scaling Python and AI applications

didierrlopes:

beyang:

hsbt:

gregpr07:

Created 9 years ago

Updated 19 hours ago

ELF by facebookresearch

Game research platform for real-time strategy (RTS) games

jrk:

nottombrown:

AntonOsika:

deshraj:

Created 8 years ago

Updated 4 years ago

fairseq-lua by facebookresearch

Lua-based toolkit for sequence-to-sequence learning

bcherny:

generall:

thomwolf:

vincentweisser:

Created 9 years ago

Updated 4 years ago

evolution-strategies-starter by openai

Research paper code for distributed evolution strategies

aravindsrinivas:

junxiaosong:

jekbradbury:

codekansas:

Created 9 years ago

Updated 6 years ago

netdata by netdata

AI-powered observability platform for full-stack monitoring

tobi:

ebursztein:

ValentaTomas:

chuanli11:

Created 13 years ago

Updated 21 hours ago

DeepSpeech by mozilla

Open-source speech-to-text engine for on-device inference

joewalnes:

omarsar:

simonw:

maxbrunsfeld:

Created 10 years ago

Updated 9 months ago

rtb-papers by wnzhang

Paper collection for real-time bidding (RTB) display advertising techniques

bcherny:

Created 10 years ago

Updated 1 year ago

ipex-llm by intel

LLM acceleration library for Intel XPU (GPU, NPU, CPU)

transitive-bullshit:

didierrlopes:

luiscape:

chiphuyen:

Created 9 years ago

Updated 2 months ago

lectures by oxford-cs-deepnlp-2017

NLP course (lecture slides) for deep learning approaches to language

bcherny:

stas00:

eddyxu:

simonw:

Created 9 years ago

Updated 2 years ago

universe-starter-agent by openai

Starter agent for solving Universe environments using A3C

aravindsrinivas:

apsdehal:

agermanidis:

pathak22:

Created 9 years ago

Updated 8 years ago

OpenBLAS by OpenMathLib

Optimized BLAS library for linear algebra subprograms

kerollmops:

jiamings:

jcjohnson:

hammer:

Created 15 years ago

Updated 1 day ago

Paddle by PaddlePaddle

Deep learning framework for industrial practice

bcherny:

osanseviero:

chiphuyen:

luiscape:

Created 9 years ago

Updated 1 day ago

awesome-courses by prakhar1989

Awesome CS courses with free online materials

aravindsrinivas:

xiezhq-hermann:

john-b-yang:

sb2nov:

Created 11 years ago

Updated 2 years ago

research by commaai

Dataset and code for driving simulator research paper

fchollet:

geohot:

bcherny:

thomwolf:

Created 9 years ago

Updated 3 years ago

rllab by rll

Framework for reinforcement learning algorithm development and evaluation

aravindsrinivas:

gdb:

apsdehal:

parano:

Created 10 years ago

Updated 2 years ago

CNTK by microsoft

Deep-learning toolkit for neural networks as directed computational graphs

bcherny:

tiangolo:

luiscape:

parano:

Created 10 years ago

Updated 3 years ago

awesome-deep-learning-papers by terryum

Curated list of seminal deep learning papers (2012-2016)

lilianweng:

ShengjiaZhao:

bcherny:

chenlin9:

Created 10 years ago

Updated 2 years ago

awesome-rl by aikorea

Curated list of reinforcement learning resources

spartee:

carlosejimenez:

evhub:

junxiaosong:

Created 10 years ago

Updated 2 years ago

gym by openai

RL toolkit for reinforcement learning algorithm development

aravindsrinivas:

fchollet:

bcherny:

ValentaTomas:

Created 10 years ago

Updated 2 weeks ago

awesome-machine-learning by josephmisiti

Curated list of ML frameworks, libraries, and software

bcherny:

vincentweisser:

generall:

parano:

Created 11 years ago

Updated 21 hours ago

tensorflow by tensorflow

Open-source ML framework

norvig:

aravindsrinivas:

karpathy:

bcherny:

Created 10 years ago

Updated 16 hours ago

Feedback? Help us improve.