Yineng Zhang

Inference Lead at SGLang; Research Scientist at Together AI

Starred Projects (108)

DeepSeek-Math-V2 by deepseek-ai

LLM for self-verifiable mathematical reasoning

omarsar:

simonw:

Created 4 days ago

Updated 3 days ago

open-instruct by allenai

Training codebase for instruction-following language models

vincentweisser:

RJT1990:

pgarbacki:

jn2clark:

Created 2 years ago

Updated 1 day ago

pplx-garden by perplexityai

High-performance LLM inference engine

Created 3 weeks ago

Updated 1 week ago

tunix by google

JAX-native library for efficient LLM post-training

ekzhang:

hiyouga:

ebursztein:

hammer:

Created 8 months ago

Updated 3 days ago

kimi-cli by MoonshotAI

AI agent enhancing terminal operations and software development workflows

omarsar:

Created 1 month ago

Updated 2 days ago

DeepSeek-OCR by deepseek-ai

Context-aware OCR model for visual-text compression

pgarbacki:

omarsar:

MagMueller:

shizhediao:

Created 1 month ago

Updated 1 month ago

modular by modular

AI toolchain unifying fragmented AI deployment workflows

lattner:

tobi:

flaque:

AlexCheema:

Created 2 years ago

Updated 1 day ago

FastVideo by hao-ai-lab

Framework for accelerated video generation

hiyouga:

luiscape:

Created 1 year ago

Updated 2 days ago

ThunderKittens by HazyResearch

CUDA kernel framework for fast deep learning primitives

karpathy:

vincentweisser:

gakonst:

luiscape:

Created 1 year ago

Updated 2 days ago

tinker-cookbook by thinking-machines-lab

Advanced LLM fine-tuning SDK and example cookbook

JohannesHa:

gakonst:

lewtun:

WoosukKwon:

Created 4 months ago

Updated 6 days ago

DeepSeek-V3.2-Exp by deepseek-ai

Experimental LLM boosting long-context efficiency

merrymercy:

Created 2 months ago

Updated 1 week ago

K2-Vendor-Verifier by MoonshotAI

Verifying Kimi K2 API vendor toolcall precision and reliability

Created 2 months ago

Updated 1 week ago

checkpoint-engine by MoonshotAI

Middleware for efficient LLM weight updates during inference

pgarbacki:

zhuohan123:

luiscape:

didierrlopes:

Created 2 months ago

Updated 6 days ago

batch_invariant_ops by thinking-machines-lab

Enhance LLM inference determinism

Edward-Sun:

ekzhang:

willccbb:

zhuohan123:

Created 2 months ago

Updated 3 weeks ago

xtuner by InternLM

LLM fine-tuning toolkit for research

casper-hansen:

winglian:

lysandrejik:

JustinLin610:

Created 2 years ago

Updated 2 days ago

agents.md by openai

A format for guiding coding agents

gregpr07:

transitive-bullshit:

romainhuet:

Created 3 months ago

Updated 1 month ago

axolotl by axolotl-ai-cloud

CLI tool for streamlined post-training of AI models

tobi:

beyang:

patrickvonplaten:

amiruci:

Created 2 years ago

Updated 1 day ago

DiffSynth-Studio by modelscope

Open-source project for diffusion model exploration

rodrigosnader:

doriandarko:

Created 2 years ago

Updated 1 day ago

coze-studio by coze-dev

AI agent development platform with visual tools

Created 5 months ago

Updated 1 week ago

Step3 by stepfun-ai

Multimodal reasoning model for efficient vision-language tasks

Created 4 months ago

Updated 3 months ago

SpecForge by sgl-project

Train speculative decoding models for faster inference

merrymercy:

xiezhq-hermann:

Ying1123:

Created 5 months ago

Updated 2 days ago

LightX2V by ModelTC

Video generation inference framework for efficient synthesis

jiamings:

Created 8 months ago

Updated 2 days ago

chatterbox by resemble-ai

Open-source TTS model

gakonst:

dguido:

joewalnes:

abidlabs:

Created 7 months ago

Updated 2 months ago

Kimi-K2 by MoonshotAI

State-of-the-art MoE language model

krisr:

lucidrains:

merrymercy:

shizhediao:

Created 5 months ago

Updated 3 weeks ago

gemini-cli by google-gemini

AI agent for terminal workflows

MagMueller:

lucidrains:

khou22:

koraykv:

Created 7 months ago

Updated 1 day ago

trae-agent by bytedance

LLM-powered CLI for software engineering tasks

hiyouga:

yiranwu0:

syrusakbary:

transitive-bullshit:

Created 5 months ago

Updated 2 months ago

Math-Verify by huggingface

Math evaluator for LLM outputs in mathematical tasks

shizhediao:

thomwolf:

hiyouga:

lewtun:

Created 10 months ago

Updated 5 months ago

Skills by NVIDIA-NeMo

LLM skill-improvement pipelines for synthetic data generation, training, and evaluation

winglian:

Created 1 year ago

Updated 1 day ago

RL-Factory by Simple-Efficient

RL post-training framework for agentic learning

Created 6 months ago

Updated 2 weeks ago

minions by HazyResearch

Communication protocol for cost-efficient LLM collaboration

JohannesHa:

w4nderlust:

jmorganca:

mchiang0610:

Created 10 months ago

Updated 1 day ago

slime by THUDM

LLM post-training framework for RL scaling

jiamings:

hammer:

pgarbacki:

pcmoritz:

Created 5 months ago

Updated 1 day ago

Hunyuan3D-2.1 by Tencent-Hunyuan

Image to 3D asset generation with PBR materials

zhuohan123:

Created 5 months ago

Updated 1 month ago

dots.llm1 by rednote-hilab

MoE model for research

Created 6 months ago

Updated 3 months ago

ROLL by alibaba

RL library for large language models

winglian:

yiranwu0:

pcmoritz:

Created 6 months ago

Updated 1 day ago

cosmos-reason1 by nvidia-cosmos

Multimodal LLMs for physical common sense and embodied decisions

Created 9 months ago

Updated 2 weeks ago

torchtune by meta-pytorch

PyTorch library for LLM post-training and experimentation

lewtun:

patrickvonplaten:

JustinLin610:

shizhediao:

Created 2 years ago

Updated 6 days ago

ome by sgl-project

Kubernetes operator for LLM serving

merrymercy:

Ying1123:

Created 6 months ago

Updated 1 day ago

unsloth by unslothai

Finetuning tool for LLMs, targeting speed and memory efficiency

tobi:

karpathy:

alexchen4ai:

danielhanchen:

Created 2 years ago

Updated 1 day ago

RL by NVIDIA-NeMo

Scalable toolkit for efficient model reinforcement learning

vincentweisser:

hammer:

wangshangsam:

pcmoritz:

Created 8 months ago

Updated 22 hours ago

VeOmni by ByteDance-Seed

Framework for scaling multimodal model training across accelerators

hiyouga:

JustinLin610:

Created 8 months ago

Updated 1 day ago

MiMo by XiaomiMiMo

LLM for reasoning, pre-trained and post-trained for math/code tasks

alexchen4ai:

WoosukKwon:

omarsar:

Created 7 months ago

Updated 5 months ago

dia by nari-labs

TTS model for ultra-realistic dialogue generation

shimmyshimmer:

alexchen4ai:

omarsar:

codekansas:

Created 7 months ago

Updated 1 week ago

SpargeAttn by thu-ml

Training-free sparse attention for model inference acceleration

Created 9 months ago

Updated 1 week ago

profile-data by deepseek-ai

Profiling data for computation-communication overlap analysis

Created 9 months ago

Updated 8 months ago

multi-swe-bench by multi-swe-bench

Multilingual benchmark for LLM-powered code issue resolution

Created 9 months ago

Updated 6 days ago

aider by Aider-AI

AI pair programming in your terminal

bcherny:

nat:

ekzhu:

hugs:

Created 2 years ago

Updated 1 week ago

Triton-distributed by ByteDance-Seed

Distributed compiler for computation-communication overlapping, based on Triton

antiagainst:

Created 8 months ago

Updated 1 week ago

AReaL by inclusionAI

Distributed RL system for LLM reasoning

yiranwu0:

casper-hansen:

merrymercy:

Created 9 months ago

Updated 1 day ago

dynamo by ai-dynamo

Inference framework for distributed generative AI model serving

vincentweisser:

willingc:

chiphuyen:

luiscape:

Created 9 months ago

Updated 23 hours ago

QwQ by QwenLM

Reasoning model for complex problem-solving, based on Qwen2.5

shimmyshimmer:

huybery:

JustinLin610:

Created 8 months ago

Updated 8 months ago

3FS by deepseek-ai

Distributed file system for AI training/inference workloads

joewalnes:

wesm:

alexey-milovidov:

flaque:

Created 9 months ago

Updated 1 month ago

EPLB by deepseek-ai

Load balancer for expert-parallel MoE models

parano:

comaniac:

Created 9 months ago

Updated 8 months ago

DualPipe by deepseek-ai

Pipeline parallelism algorithm for training large models

luiscape:

JohannesHa:

Created 9 months ago

Updated 8 months ago

DeepGEMM by deepseek-ai

CUDA library for efficient FP8 GEMM kernels with fine-grained scaling

natolambert:

patrickvonplaten:

parano:

shyamal-anadkat:

Created 9 months ago

Updated 5 days ago

DeepEP by deepseek-ai

Expert-parallel communication library for MoE, targeting high-throughput and low-latency

parano:

JustinLin610:

CodeCreator:

calvinfo:

Created 9 months ago

Updated 6 days ago

FlashMLA by deepseek-ai

Efficient CUDA kernels for MLA decoding

hammer:

jmorganca:

shizhediao:

suquark:

Created 9 months ago

Updated 2 months ago

Moonlight by MoonshotAI

MoE model and optimizer tech report

jph00:

lucidrains:

Created 9 months ago

Updated 4 months ago

open-infra-index by deepseek-ai

AI infrastructure tools for efficient AGI development

lattner:

vincentweisser:

hammer:

pankajroark:

Created 9 months ago

Updated 6 months ago

ktransformers by kvcache-ai

Framework for LLM inference optimization experimentation

luiscape:

patrickvonplaten:

JustinLin610:

shimmyshimmer:

Created 1 year ago

Updated 1 day ago

skypilot by skypilot-org

Framework for cloud AI/batch jobs, unifying execution across diverse infrastructure

karpathy:

tobi:

amin3141:

luiscape:

Created 4 years ago

Updated 2 days ago

ZhiLight by zhihu

LLM inference engine for Llama and variants, optimized for PCIe GPUs

hiyouga:

Created 11 months ago

Updated 4 months ago

Janus by deepseek-ai

Unified multimodal model research paper for understanding and generation

jiamings:

omarsar:

taranjeet:

xiaofan-luan:

Created 1 year ago

Updated 10 months ago

UI-TARS by bytedance

Multimodal agent for GUI interaction in virtual worlds (research paper)

jiamings:

hugs:

jmorganca:

omarsar:

Created 10 months ago

Updated 2 weeks ago

rtp-llm by alibaba

LLM inference engine for diverse applications

Created 1 year ago

Updated 22 hours ago

tilelang by tile-ai

DSL for high-performance GPU/CPU kernel development (GEMM, attention, etc.)

hiyouga:

JustinLin610:

luiscape:

zhuohan123:

Created 1 year ago

Updated 23 hours ago

DeepSeek-R1 by deepseek-ai

Reasoning models research paper

shimmyshimmer:

rasbt:

transitive-bullshit:

omarsar:

Created 10 months ago

Updated 5 months ago

MInference by microsoft

Framework for long-context LLM inference speedup via sparse attention

pgarbacki:

Created 1 year ago

Updated 2 months ago

flash-linear-attention by fla-org

Efficient Torch/Triton implementations for linear attention models

hiyouga:

xiezhq-hermann:

yang-song:

winglian:

Created 1 year ago

Updated 1 day ago

MiniMax-01 by MiniMax-AI

Large language & vision-language models based on linear attention

sxyu:

transitive-bullshit:

omarsar:

hiyouga:

Created 10 months ago

Updated 4 months ago

dash-infer by modelscope

LLM inference engine for optimized performance across diverse hardware

Created 1 year ago

Updated 3 months ago

smoothquant by mit-han-lab

Post-training quantization research paper for large language models

zhiyuan8:

gakonst:

forresti:

Edward-Sun:

Created 3 years ago

Updated 1 year ago

picotron by huggingface

Minimalist distributed training framework for educational use

karpathy:

transitive-bullshit:

srush:

pgarbacki:

Created 1 year ago

Updated 3 months ago

hqq by dropbox

Model quantizer for fast, accurate post-training quantization, skipping calibration

danielhanchen:

winglian:

hiyouga:

osanseviero:

Created 2 years ago

Updated 1 month ago

torchtitan by pytorch

PyTorch platform for generative AI model training research

karpathy:

pgarbacki:

lewtun:

zhuohan123:

Created 1 year ago

Updated 1 day ago

LightLLM by ModelTC

Python framework for LLM inference and serving

chiphuyen:

pgarbacki:

JustinLin610:

winglian:

Created 2 years ago

Updated 2 days ago

cline by cline

VS Code extension for autonomous coding agent

didierrlopes:

swyxio:

snowzurfer:

ishaan-jaff:

Created 1 year ago

Updated 23 hours ago

DeepSeek-V3 by deepseek-ai

MoE language model research paper with 671B total parameters

tobi:

shimmyshimmer:

jiamings:

syrusakbary:

Created 11 months ago

Updated 3 months ago

infinity by michaelfeil

REST API for high-throughput, low-latency embedding and reranking

luiscape:

ishaan-jaff:

ankane:

jn2clark:

Created 2 years ago

Updated 6 days ago

Star-Attention by NVIDIA

PyTorch code for efficient LLM inference on long sequences

Created 1 year ago

Updated 5 months ago

Qwen3-Coder by QwenLM

Code LLM for code completion, generation, and assistant use cases

hugs:

victortaelin:

luiscape:

cournape:

Created 1 year ago

Updated 4 months ago

xgrammar by mlc-ai

Library for efficient structured generation

merrymercy:

ogabrielluiz:

youkaichao:

simonw:

Created 1 year ago

Updated 2 days ago

prompt-lookup-decoding by apoorvumang

Decoding method for faster LLM generation

stas00:

jph00:

casper-hansen:

ggerganov:

Created 2 years ago

Updated 1 year ago

verl by volcengine

RL training library for LLMs

WoosukKwon:

hammer:

yiranwu0:

luiscape:

Created 1 year ago

Updated 1 day ago

duo-attention by mit-han-lab

Framework for efficient long-context LLM inference

Created 1 year ago

Updated 9 months ago

corenet by apple

DNN toolkit for training standard and novel models

transitive-bullshit:

omarsar:

t3dotgg:

hammer:

Created 1 year ago

Updated 1 month ago

tensorrtllm_backend by triton-inference-server

Triton backend for serving TensorRT-LLM models

NikolaBorisov:

guberti:

Ying1123:

tuhins:

Created 2 years ago

Updated 3 days ago

Pai-Megatron-Patch by alibaba

Training toolkit for LLMs & VLMs using Megatron

Jiayi-Pan:

Created 2 years ago

Updated 2 weeks ago

whisper by openai

Speech recognition model for multilingual transcription/translation

bcherny:

karpathy:

ogabrielluiz:

swyxio:

Created 3 years ago

Updated 2 months ago

TensorRT-LLM by NVIDIA

LLM inference optimization SDK for NVIDIA GPUs

beyang:

hammer:

shizhediao:

luiscape:

Created 2 years ago

Updated 23 hours ago

EAGLE by SafeAILab

Speculative decoding research paper for faster LLM inference

shizhediao:

philschmid:

pgarbacki:

JustinLin610:

Created 2 years ago

Updated 1 week ago

Nanoflow by efeslab

LLM serving framework for high throughput

WoosukKwon:

Ying1123:

zhuohan123:

Created 1 year ago

Updated 1 month ago

truss by basetenlabs

Model deployment tool for productionizing AI/ML models

apsdehal:

ogabrielluiz:

hammer:

pankajroark:

Created 3 years ago

Updated 2 days ago

mscclpp by microsoft

GPU-driven communication stack for scalable AI applications

jrk:

WoosukKwon:

Created 2 years ago

Updated 4 days ago

ao by pytorch

PyTorch library for quantization and sparsity in training/inference

danielhanchen:

shimmyshimmer:

parano:

willccbb:

Created 2 years ago

Updated 1 day ago

simple-evals by openai

Lightweight library for evaluating language models

patrickvonplaten:

simonw:

philschmid:

Ying1123:

Created 1 year ago

Updated 4 months ago

sglang by sgl-project

Fast serving framework for LLMs and vision language models

shimmyshimmer:

beyang:

samlambert:

ebursztein:

Created 1 year ago

Updated 22 hours ago

QuaRot by spcl

Code for a NeurIPS 2024 research paper on LLM quantization

jph00:

Created 1 year ago

Updated 1 year ago

FlagGems by flagos-ai

Operator library for LLM training/inference, implemented in Triton

Created 1 year ago

Updated 1 day ago

ring-attention-pytorch by lucidrains

Pytorch impl of Ring Attention for near-infinite context

sxyu:

vincentweisser:

Created 1 year ago

Updated 6 months ago

Mooncake by kvcache-ai

Research paper on a disaggregated architecture for LLM serving

jiamings:

luiscape:

merrymercy:

WoosukKwon:

Created 1 year ago

Updated 2 days ago

DeepSeek-V2 by deepseek-ai

MoE language model for research/API use

gakonst:

jiamings:

Jiayi-Pan:

Created 1 year ago

Updated 1 year ago

llama3 by meta-llama

*Deprecated* minimal example for loading and running Llama 3 models

tobi:

mckaywrigley:

osanseviero:

simonw:

Created 1 year ago

Updated 10 months ago

mlx by ml-explore

Array framework for machine learning on Apple silicon

geohot:

karpathy:

jmorganca:

chiphuyen:

Created 2 years ago

Updated 4 days ago

flashinfer by flashinfer-ai

Kernel library for LLM serving

hammer:

JustinLin610:

luiscape:

youkaichao:

Created 2 years ago

Updated 2 days ago

cutlass by NVIDIA

CUDA C++ and Python DSLs for high-performance linear algebra

tridao:

chiphuyen:

joker-eph:

mattjj:

Created 8 years ago

Updated 2 days ago

flash-attention by Dao-AILab

Fast, memory-efficient attention implementation

karpathy:

Jiayi-Pan:

zhiyuan8:

alexchen4ai:

Created 3 years ago

Updated 5 days ago

Medusa by FasterDecoding

Framework for accelerating LLM generation using multiple decoding heads

osanseviero:

parano:

luiscape:

chiphuyen:

Created 2 years ago

Updated 1 year ago

lmdeploy by InternLM

Toolkit for LLM compression, deployment, and serving

shimmyshimmer:

wsxiaoys:

luiscape:

jn2clark:

Created 2 years ago

Updated 1 day ago

Feedback? Help us improve.