Simon Mo

Core Maintainer of vLLM

Starred Projects (32)

recipes by vllm-project

LLM inference recipes

WoosukKwon:

Created 6 months ago

Updated 1 day ago

open-infra-index by deepseek-ai

AI infrastructure tools for efficient AGI development

lattner:

vincentweisser:

hammer:

pankajroark:

Created 11 months ago

Updated 8 months ago

xgrammar by mlc-ai

Library for efficient structured generation

merrymercy:

ogabrielluiz:

youkaichao:

simonw:

Created 1 year ago

Updated 1 week ago

lingua by facebookresearch

LLM research codebase for training and inference

theophilegervet:

binarybana:

stas00:

omarsar:

Created 1 year ago

Updated 6 months ago

llama3-from-scratch by naklecha

Llama3 implementation from scratch, one matrix multiplication at a time

torantulino:

AlexCheema:

vincentweisser:

omarsar:

Created 1 year ago

Updated 1 year ago

vllm by vllm-project

LLM serving engine for high-throughput, memory-efficient inference

karpathy:

clmnt:

tobi:

danielhanchen:

Created 3 years ago

Updated 1 day ago

mirage by mirage-project

Tool for fast GPU kernel generation via superoptimization

geohot:

zhuohan123:

binarybana:

Ying1123:

Created 1 year ago

Updated 2 days ago

mlx by ml-explore

Array framework for machine learning on Apple silicon

geohot:

karpathy:

ekzhang:

lysandrejik:

Created 2 years ago

Updated 1 day ago

flashinfer by flashinfer-ai

Kernel library for LLM serving

chiphuyen:

hammer:

JustinLin610:

luiscape:

Created 2 years ago

Updated 1 day ago

search_with_lepton by leptonai

Conversational search engine demo

chiphuyen:

zhiyuan8:

soumith:

khou22:

Created 2 years ago

Updated 1 month ago

tensorizer by coreweave

Module for fast model serialization/deserialization

vanpelt:

stas00:

luiscape:

binarybana:

Created 3 years ago

Updated 5 months ago

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

tobi:

clmnt:

tjbck:

chiphuyen:

Created 3 years ago

Updated 2 weeks ago

LLM-Reading-List by evanmiller

LLM paper list focused on efficient inference and compression

codekansas:

transitive-bullshit:

simonw:

ggerganov:

Created 2 years ago

Updated 2 years ago

aqueduct by RunLLM

MLOps framework for cloud deployment of LLM/ML workloads

ShishirPatil:

hammer:

jheer:

spencerkimball:

Created 3 years ago

Updated 2 years ago

ray by ray-project

AI compute engine for scaling Python and AI applications

beyang:

hsbt:

gregpr07:

hiyouga:

Created 9 years ago

Updated 1 day ago

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

aravindsrinivas:

ValentaTomas:

winglian:

stas00:

Created 6 years ago

Updated 1 day ago

angle-grinder by rcoh

CLI tool for log analysis, parsing, and aggregation

sirupsen:

simonw:

trishume:

Created 8 years ago

Updated 3 weeks ago

milvus by milvus-io

Cloud-native vector database for scalable ANN search

luiscape:

xiaofan-luan:

jeresig:

ekzhu:

Created 6 years ago

Updated 1 day ago

scalene by plasma-umass

Python profiler with AI-powered optimization proposals

luiscape:

xiezhq-hermann:

zhuohan123:

Ying1123:

Created 6 years ago

Updated 2 days ago

terraform-aws-lambda by terraform-aws-modules

Terraform module for AWS Lambda resource management

Created 5 years ago

Updated 2 days ago

awesome-tensor-compilers by merrymercy

Curated list of tensor compiler projects and papers

chiphuyen:

infwinston:

Ying1123:

luiscape:

Created 5 years ago

Updated 1 year ago

BigDL by intel

AI scaling library for Spark/Flink/Ray, from laptop to cloud

Created 8 years ago

Updated 2 months ago

clusterdata by alibaba

Production cluster traces for data center research

infwinston:

Created 8 years ago

Updated 2 months ago

AzurePublicDataset by Azure

Public Azure traces for cloud workload research

infwinston:

Created 8 years ago

Updated 1 month ago

AI-Infra-from-Zero-to-Hero by HuaizhengZhang

Curated list of machine learning systems resources

parasj:

xiezhq-hermann:

Created 7 years ago

Updated 6 months ago

gpt-2-simple by minimaxir

Python package for GPT-2 text generation model fine-tuning

shizhediao:

vnivargi:

bryanhelmig:

swyxio:

Created 6 years ago

Updated 3 years ago

netron by lutzroeder

Model visualizer for neural networks, deep learning, and ML

casper-hansen:

hammer:

guberti:

soldni:

Created 15 years ago

Updated 1 day ago

tensorflow_cc by FloopCZ

C++ API for TensorFlow, built outside TensorFlow source

Created 8 years ago

Updated 1 year ago

connect by redpanda-data

Operationally mundane stream processing engine

hammer:

syrusakbary:

Created 9 years ago

Updated 4 days ago

multi-model-server by awslabs

CLI tool for serving deep learning models from any ML/DL framework

lantiga:

Created 8 years ago

Updated 1 year ago

architecture.of.internet-product by davideuler

Collection of Internet company tech architectures

geekan:

Created 7 years ago

Updated 1 year ago

db-readings by rxin

Curated list of database research papers

kelvich:

hammer:

sirupsen:

ekzhu:

Created 13 years ago

Updated 1 year ago

Feedback? Help us improve.