Zhiqiang Xie

Coauthor of SGLang

Starred Projects (42)

SpecForge by sgl-project

Train speculative decoding models for faster inference

Ying1123:

zhyncs:

Created 3 months ago

Updated 2 days ago

MemOS by MemTensor

LLM operating system with long-term memory

luiscape:

xiaofan-luan:

Created 2 months ago

Updated 14 hours ago

KernelBench by ScalingIntelligence

Benchmark for LLMs generating GPU kernels from PyTorch ops

chiphuyen:

aksh-at:

Created 10 months ago

Updated 3 weeks ago

openevolve by codelion

Coding agent for scientific/algorithmic discovery, based on AlphaEvolve paper

taranjeet:

suquark:

WoosukKwon:

lucidrains:

Created 4 months ago

Updated 23 hours ago

letta by letta-ai

Agent framework for stateful agents with memory, reasoning, and context management

joewalnes:

c4pt0r:

sxyu:

willccbb:

Created 1 year ago

Updated 1 day ago

SkyRL by NovaSky-AI

RL training pipeline for multi-turn tool use LLMs, optimized for real-world tasks

JohannesHa:

willccbb:

calvinfo:

jeffchuber:

Created 4 months ago

Updated 19 hours ago

mem0 by mem0ai

AI agent memory layer for personalized interactions

amin3141:

gregpr07:

marcklingen:

joewalnes:

Created 2 years ago

Updated 1 day ago

tokasaurus by ScalingIntelligence

LLM inference engine for high-throughput workloads

willccbb:

ShishirPatil:

chiphuyen:

Created 3 months ago

Updated 3 weeks ago

dynamo by ai-dynamo

Inference framework for distributed generative AI model serving

willingc:

chiphuyen:

luiscape:

WoosukKwon:

Created 6 months ago

Updated 15 hours ago

3FS by deepseek-ai

Distributed file system for AI training/inference workloads

joewalnes:

wesm:

alexey-milovidov:

flaque:

Created 6 months ago

Updated 1 week ago

flash-linear-attention by fla-org

Efficient Torch/Triton implementations for linear attention models

hiyouga:

zhyncs:

yang-song:

winglian:

Created 1 year ago

Updated 2 days ago

Sana by NVlabs

Image synthesis research paper using a linear diffusion transformer

chiphuyen:

sxyu:

Created 11 months ago

Updated 5 days ago

Trace by microsoft

AutoDiff-like tool for end-to-end AI agent training with general feedback

ekzhu:

transitive-bullshit:

jaredpalmer:

yiranwu0:

Created 1 year ago

Updated 1 month ago

lectures by gpu-mode

Lecture series for GPU-accelerated computing

cournape:

stas00:

danielhanchen:

willccbb:

Created 1 year ago

Updated 4 days ago

swarm by openai

Multi-agent orchestration framework for lightweight agent coordination

vincentweisser:

rodrigosnader:

achowdhery:

huybery:

Created 1 year ago

Updated 6 months ago

ComfyUI by comfyanonymous

Visual AI engine for diffusion models, API, and backend

dguido:

shimmyshimmer:

tjbck:

victortaelin:

Created 2 years ago

Updated 1 day ago

distrifuser by mit-han-lab

Research paper for distributed parallel inference of high-resolution diffusion models

philschmid:

merrymercy:

Created 1 year ago

Updated 9 months ago

veScale by volcengine

PyTorch-native framework for LLM training

JustinLin610:

casper-hansen:

hiyouga:

stas00:

Created 1 year ago

Updated 6 days ago

flashinfer by flashinfer-ai

Kernel library for LLM serving

hammer:

JustinLin610:

luiscape:

youkaichao:

Created 2 years ago

Updated 23 hours ago

sglang by sgl-project

Fast serving framework for LLMs and vision language models

samlambert:

ebursztein:

philschmid:

pankajroark:

Created 1 year ago

Updated 14 hours ago

camel by camel-ai

Multi-agent framework for studying agent scaling laws

deshraj:

gregpr07:

didierrlopes:

hammer:

Created 2 years ago

Updated 14 hours ago

LLM-Agent-Paper-List by WooooDyy

Paper list for LLM-based agents

transitive-bullshit:

andreasjansson:

vincentweisser:

ogabrielluiz:

Created 2 years ago

Updated 6 days ago

guidance by guidance-ai

Guidance is a programming paradigm for steering LLMs

tobi:

ekzhu:

stas00:

Ying1123:

Created 2 years ago

Updated 1 day ago

scalene by plasma-umass

Python profiler with AI-powered optimization proposals

luiscape:

zhuohan123:

Ying1123:

trishume:

Created 5 years ago

Updated 1 week ago

generative_agents by joonspk-research

Research paper code for interactive human behavior simulation using generative agents

tobi:

sxyu:

chiphuyen:

rodrigosnader:

Created 2 years ago

Updated 1 year ago

rccl by ROCm

ROCm library for GPU collective communication routines

lysandrejik:

Created 7 years ago

Updated 15 hours ago

llama by meta-llama

Inference code for Llama 2 models (deprecated)

froystig:

fabhed:

borzunov:

quincylarson:

Created 2 years ago

Updated 7 months ago

madrona by shacklettbp

GPU-accelerated game engine for high-throughput batch simulation

Created 3 years ago

Updated 1 month ago

mistral-inference by mistralai

Inference library for Mistral models

vincentweisser:

parano:

transitive-bullshit:

JustinLin610:

Created 2 years ago

Updated 6 months ago

ai-town by a16z-infra

AI town starter kit for building a virtual world

tobi:

bcherny:

teknium1:

w4nderlust:

Created 2 years ago

Updated 7 months ago

milvus by milvus-io

Cloud-native vector database for scalable ANN search

luiscape:

xiaofan-luan:

jeresig:

ekzhu:

Created 6 years ago

Updated 16 hours ago

dspy by stanfordnlp

Framework for programming language models, not prompting

tobi:

mateiz:

vincentweisser:

pgarbacki:

Created 2 years ago

Updated 15 hours ago

dynolog by facebookincubator

Telemetry daemon for performance monitoring and tracing of heterogeneous CPU-GPU systems

Created 3 years ago

Updated 2 days ago

ChatGDB by pgosar

CLI tool for debugging with natural language via LLM

handotdev:

Ying1123:

Created 2 years ago

Updated 9 months ago

nanoGPT by karpathy

Minimalist repo for training/finetuning GPT models

tobi:

danielgross:

chiphuyen:

ankane:

Created 2 years ago

Updated 9 months ago

awesome-courses by prakhar1989

Awesome CS courses with free online materials

aravindsrinivas:

john-b-yang:

sb2nov:

infwinston:

Created 11 years ago

Updated 2 years ago

iree by iree-org

MLIR-based compiler and runtime toolkit for machine learning models

ogabrielluiz:

mfuntowicz:

parano:

infwinston:

Created 6 years ago

Updated 16 hours ago

antares by microsoft

Compiler solution for PyTorch operator optimization on diverse accelerators

parasj:

comaniac:

merrymercy:

Created 5 years ago

Updated 5 months ago

oneflow by Oneflow-Inc

Deep learning framework for user-friendly, scalable, efficient model development

omarsar:

parano:

ppwwyyxx:

Created 8 years ago

Updated 4 weeks ago

dgl by dmlc

Python package for deep learning on graphs

osanseviero:

jiamings:

parasj:

infwinston:

Created 7 years ago

Updated 1 month ago

AI-Infra-from-Zero-to-Hero by HuaizhengZhang

Curated list of machine learning systems resources

parasj:

simon-mo:

Created 6 years ago

Updated 1 month ago

tvm by apache

Compiler stack for deep learning systems

aravindsrinivas:

transitive-bullshit:

guberti:

wesm:

Created 9 years ago

Updated 2 days ago

Feedback? Help us improve.