Simon Mo

@simon-mo

Core Maintainer of vLLM

View on GitHub

Starred Projects (28)

Starred by

Chris Lattner(Cofounder of Modular; Author of LLVM, Clang, Swift, Mojo, MLIR),

Vincent Weisser(Cofounder of Prime Intellect), and

14 more.

open-infra-index by deepseek-ai

0.1%

AI infrastructure tools for efficient AGI development

created 5 months ago

updated 3 months ago

Starred by

Lianmin Zheng(Author of SGLang),

youkaichao(Core Maintainer of vLLM), and

3 more.

xgrammar by mlc-ai

3.1%

Library for efficient structured generation

created 1 year ago

updated 1 day ago

Starred by

Jason Knight(Director AI Compilers at NVIDIA; Cofounder of OctoML),

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake), and

4 more.

lingua by facebookresearch

0.1%

LLM research codebase for training and inference

created 10 months ago

updated 4 weeks ago

Starred by

Toran Bruce Richards(Founder of AutoGPT),

Alex Cheema(Cofounder of EXO Labs), and

5 more.

llama3-from-scratch by naklecha

0.1%

15k

Llama3 implementation from scratch, one matrix multiplication at a time

created 1 year ago

updated 1 year ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Clement Delangue(Cofounder of Hugging Face), and

41 more.

vllm by vllm-project

1.4%

55k

LLM serving engine for high-throughput, memory-efficient inference

created 2 years ago

updated 19 hours ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Zhuohan Li(Author of vLLM), and

3 more.

mirage by mirage-project

0.8%

Tool for fast GPU kernel generation via superoptimization

created 1 year ago

updated 2 days ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

27 more.

mlx by ml-explore

0.3%

22k

Array framework for machine learning on Apple silicon

created 1 year ago

updated 1 day ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Junyang Lin(Core Maintainer of Alibaba Qwen), and

8 more.

flashinfer by flashinfer-ai

1.5%

Kernel library for LLM serving

created 2 years ago

updated 1 day ago

Starred by

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Zhiyuan Li(Cofounder of Nexa AI), and

8 more.

search_with_lepton by leptonai

Conversational search engine demo

created 1 year ago

updated 2 months ago

Starred by

Chris Van Pelt(Cofounder of Weights & Biases),

Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake), and

2 more.

tensorizer by coreweave

1.6%

255

Module for fast model serialization/deserialization

created 2 years ago

updated 2 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Clement Delangue(Cofounder of Hugging Face), and

25 more.

text-generation-inference by huggingface

0.2%

10k

Rust/Python/gRPC server for fast LLM text generation

created 2 years ago

updated 2 days ago

Starred by

Travis Fischer(Founder of Agentic),

Simon Willison(Author of Django), and

1 more.

LLM-Reading-List by evanmiller

0.1%

740

LLM paper list focused on efficient inference and compression

created 2 years ago

updated 1 year ago

Starred by

Shishir Patil(Author of BFCL, Gorilla),

Jeff Hammerbacher(Cofounder of Cloudera), and

3 more.

aqueduct by RunLLM

521

MLOps framework for cloud deployment of LLM/ML workloads

created 3 years ago

updated 2 years ago

Starred by

Hiroshi Shibata(Core Contributor to Ruby),

Yaowei Zheng(Author of LLaMA-Factory), and

41 more.

ray by ray-project

0.3%

38k

AI compute engine for scaling Python and AI applications

created 8 years ago

updated 19 hours ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Wing Lian(Founder of Axolotl AI), and

27 more.

DeepSpeed by deepspeedai

0.2%

40k

Deep learning optimization library for distributed training and inference

created 5 years ago

updated 22 hours ago

Starred by

Simon Horup Eskildsen(Cofounder of Turbopuffer),

Simon Willison(Author of Django), and

1 more.

angle-grinder by rcoh

0.2%

CLI tool for log analysis, parsing, and aggregation

created 7 years ago

updated 3 months ago

Starred by

James Luan(VP Engineering at Zilliz),

John Resig(Author of jQuery; Chief Software Architect at Khan Academy), and

11 more.

milvus by milvus-io

0.4%

37k

Cloud-native vector database for scalable ANN search

created 6 years ago

updated 23 hours ago

Starred by

Zhiqiang Xie(Author of SGLang),

Zhuohan Li(Author of vLLM), and

14 more.

scalene by plasma-umass

0.2%

13k

Python profiler with AI-powered optimization proposals

created 5 years ago

updated 1 day ago

terraform-aws-lambda by terraform-aws-modules

0.2%

Terraform module for AWS Lambda resource management

created 5 years ago

updated 1 month ago

BigDL by intel

0.0%

AI scaling library for Spark/Flink/Ray, from laptop to cloud

created 8 years ago

updated 1 week ago

Starred by

Wei-Lin Chiang(Cofounder of LMArena).

AzurePublicDataset by Azure

0.2%

973

Public Azure traces for cloud workload research

created 8 years ago

updated 5 months ago

Starred by

Zhiqiang Xie(Author of SGLang).

AI-Infra-from-Zero-to-Hero by HuaizhengZhang

0.6%

Curated list of machine learning systems resources

created 6 years ago

updated 3 weeks ago

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow),

Vaibhav Nivargi(Cofounder of Moveworks), and

5 more.

gpt-2-simple by minimaxir

Python package for GPT-2 text generation model fine-tuning

created 6 years ago

updated 2 years ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Gavin Uberti(Cofounder of Etched), and

16 more.

netron by lutzroeder

0.2%

31k

Model visualizer for neural networks, deep learning, and ML

created 14 years ago

updated 22 hours ago

tensorflow_cc by FloopCZ

765

C++ API for TensorFlow, built outside TensorFlow source

created 8 years ago

updated 1 year ago

Starred by

Luca Antiga(CTO of Lightning AI).

multi-model-server by awslabs

CLI tool for serving deep learning models from any ML/DL framework

created 7 years ago

updated 1 year ago

architecture.of.internet-product by davideuler

0.0%

20k

Collection of Internet company tech architectures

created 7 years ago

updated 1 year ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Simon Horup Eskildsen(Cofounder of Turbopuffer), and

6 more.

db-readings by rxin

0.0%

Curated list of database research papers

created 13 years ago

updated 11 months ago

Feedback? Help us improve.