Zhuohan Li

Image to 3D asset generation with PBR materials

Hunyuan3D-2.1 by Tencent-Hunyuan

4.2%

created 1 month ago

updated 2 days ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Alexander Wettig(Author of SWE-bench, SWE-agent), and

5 more.

torchtitan by pytorch

0.9%

PyTorch platform for generative AI model training research

DSL for high-performance GPU/CPU kernel development (GEMM, attention, etc.)

updated 15 hours ago

Starred by

Yang Song(Professor at Caltech; Research Scientist at OpenAI).

tilelang by tile-ai

1.1%

created 10 months ago

Starred by

Joe Walnes(Head of Experimental Projects at Stripe),

Wes McKinney(Author of Pandas), and

4 more.

3FS by deepseek-ai

Distributed file system for AI training/inference workloads

created 5 months ago

updated 5 days ago

Starred by

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers) and

Jeff Hammerbacher(Cofounder of Cloudera).

DeepGEMM by deepseek-ai

CUDA library for efficient FP8 GEMM kernels with fine-grained scaling

created 5 months ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Didier Lopes(Founder of OpenBB), and

5 more.

open-infra-index by deepseek-ai

AI infrastructure tools for efficient AGI development

created 5 months ago

Starred by

Evan Conrad(Cofounder of SF Compute).

mochi by genmoai

Transformers-compatible library for LLM compression, optimized for vLLM deployment

Video generation model

created 10 months ago

updated 6 months ago

Starred by

Woosuk Kwon(Author of vLLM).

llm-compressor by vllm-project

2.1%

LLM serving framework for high throughput

updated 16 hours ago

Starred by

Woosuk Kwon(Author of vLLM) and

Ying Sheng(Author of SGLang).

Nanoflow by efeslab

0.9%

856

created 11 months ago

updated 3 weeks ago

vattention by microsoft

0.5%

405

Memory manager for LLM serving systems

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Simon Willison(Author of Django), and

8 more.

lm-evaluation-harness by EleutherAI

Framework for few-shot language model evaluation

LLM inference engine for blazing fast performance

updated 14 hours ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Tim J. Baek(Founder of Open WebUI), and

7 more.

mistral.rs by EricLBuehler

1.0%

updated 13 hours ago

Starred by

Michael Truell(Cofounder of Cursor),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

16 more.

OpenHands by All-Hands-AI

AI platform for software development agents

61k

updated 8 hours ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

6 more.

ThunderKittens by HazyResearch

CUDA kernel framework for fast deep learning primitives

Automatic LLM benchmark for instruction-tuned models, correlating with human preference

updated 3 days ago

Starred by

Lianmin Zheng(Author of SGLang),

Lewis Tunstall(Researcher at Hugging Face), and

2 more.

arena-hard-auto by lmarena

0.9%

888

Starred by

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers),

Simon Willison(Author of Django), and

8 more.

simple-evals by openai

Lightweight library for evaluating language models

Single-GPU inference engine for rapid LLM prototyping

updated 3 weeks ago

calm by zeux

0.5%

599

Starred by

Tobi Lutke(Cofounder of Shopify),

Matei Zaharia(Cofounder of Databricks), and

27 more.

dspy by stanfordnlp

Framework for programming language models, not prompting

27k

Parallel decoder for efficient LLM inference

updated 23 hours ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Lianmin Zheng(Author of SGLang).

Consistency_LLM by hao-ai-lab

397

updated 8 months ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Fabian Hedin(Cofounder of Lovable), and

11 more.

grok-1 by xai-org

JAX example code for loading and running Grok-1 open-weights model

50k

Starred by

Tobi Lutke(Cofounder of Shopify),

Omar Sanseviero(DevRel at Google DeepMind), and

12 more.

mlc-llm by mlc-ai

Universal LLM deployment engine with ML compilation

21k

Kubernetes CRD for scalable ML model serving

updated 4 days ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems).

kserve by kserve

0.5%

Toolkit for finetuning and inference of large foundation models

updated 2 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Elie Bursztein(Cybersecurity Lead at Google DeepMind), and

5 more.

LMFlow by OptimalScale

0.0%

Library for Transformer model acceleration on NVIDIA GPUs

updated 3 weeks ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Amanpreet Singh(Cofounder of Contextual AI), and

2 more.

TransformerEngine by NVIDIA

0.8%

Multimodal autoregressive model for long-context video/text

updated 17 hours ago

Starred by

Matei Zaharia(Cofounder of Databricks),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

2 more.

LWM by LargeWorldModel

0.0%

updated 9 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Soumith Chintala(Author of PyTorch), and

4 more.

search_with_lepton by leptonai

Conversational search engine demo

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Anton Troynikov(Cofounder of Chroma), and

19 more.

llama_index by run-llama

Data framework for building LLM-powered agents

43k

updated 12 hours ago

Starred by

Jeremy Howard(Cofounder of fast.ai).

marlin by IST-DASLab

FP16xINT4 kernel for fast LLM inference

870

Fast serving framework for LLMs and vision language models

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind),

Philipp Schmid(DevRel at Google DeepMind), and

17 more.

sglang by sgl-project

1.1%

16k

updated 7 hours ago

Starred by

Travis Fischer(Founder of Agentic),

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), and

8 more.

LLaVA by haotian-liu

Multimodal assistant with GPT-4 level capabilities

23k

Starred by

Matei Zaharia(Cofounder of Databricks),

Alexander Wettig(Author of SWE-bench, SWE-agent), and

6 more.

megablocks by databricks

Lightweight library for mixture-of-experts (MoE) training

Kernel library for LLM serving

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Lianmin Zheng(Author of SGLang), and

3 more.

flashinfer by flashinfer-ai

1.4%

updated 9 hours ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Lianmin Zheng(Author of SGLang), and

12 more.

gpt-fast by pytorch-labs

PyTorch text generation for efficient transformer inference

updated 3 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Ying Sheng(Author of SGLang).

LookaheadDecoding by hao-ai-lab

Parallel decoding algorithm for faster LLM inference

Starred by

Tobi Lutke(Cofounder of Shopify),

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), and

12 more.

axolotl by axolotl-ai-cloud

CLI tool for streamlined post-training of AI models

updated 18 hours ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Omar Sanseviero(DevRel at Google DeepMind), and

4 more.

TensorRT-LLM by NVIDIA

LLM inference optimization SDK for NVIDIA GPUs

11k

Starred by

Zhiqiang Xie(Author of SGLang),

Joe Walnes(Head of Experimental Projects at Stripe), and

10 more.

letta by letta-ai

Agent framework for stateful agents with memory, reasoning, and context management

18k

updated 20 hours ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm) and

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems).

streaming-llm by mit-han-lab

Framework for efficient LLM streaming

Open-source engine for fine-tuning and serving LLMs

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Travis Fischer(Founder of Agentic), and

1 more.

llm-engine by scaleapi

808

updated 2 weeks ago

Starred by

Zhiqiang Xie(Author of SGLang),

Ying Sheng(Author of SGLang), and

8 more.

scalene by plasma-umass

Python profiler with AI-powered optimization proposals

13k

updated 2 weeks ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

2 more.

Medusa by FasterDecoding

Framework for accelerating LLM generation using multiple decoding heads

Starred by

Tobi Lutke(Cofounder of Shopify),

Clément Renault(Cofounder of Meilisearch), and

21 more.

outlines by dottxt-ai

SDK for structured LLM text generation

updated 8 hours ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeremy Howard(Cofounder of fast.ai), and

3 more.

llm-awq by mit-han-lab

Weight quantization research paper for LLM compression/acceleration

updated 2 weeks ago

Starred by

Didier Lopes(Founder of OpenBB),

Travis Fischer(Founder of Agentic), and

8 more.

llama-cookbook by meta-llama

Guide for building with Llama models

18k

updated 20 hours ago

Starred by

Philipp Schmid(DevRel at Google DeepMind),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

3 more.

openchat by imoneoi

Open-source LLM fine-tuned with C-RLFT, inspired by offline reinforcement learning

updated 10 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

15 more.

flash-attention by Dao-AILab

Fast, memory-efficient attention implementation

19k

created 3 years ago

Self-aligned language model research paper with minimal human supervision

Starred by

Lewis Tunstall(Researcher at Hugging Face).

Dromedary by IBM

Starred by

Travis Fischer(Founder of Agentic),

Ying Sheng(Author of SGLang), and

1 more.

LLMSurvey by RUCAIBox

Survey paper for large language models

LLM serving engine for high-throughput, memory-efficient inference

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Tobi Lutke(Cofounder of Shopify), and

26 more.

vllm by vllm-project

1.0%

54k

updated 7 hours ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Joe Walnes(Head of Experimental Projects at Stripe), and

8 more.

tabby by TabbyML

Self-hosted AI coding assistant for on-prem code completion

32k

Long-context LLM chatbot training and evaluation framework

Starred by

Ying Sheng(Author of SGLang) and

Lianmin Zheng(Author of SGLang).

LongChat by DachengLi1

524

Starred by

Lewis Tunstall(Researcher at Hugging Face),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

7 more.

gorilla by ShishirPatil

LLM tool-use framework for API invocation and function calling

updated 4 days ago

Starred by

Lianmin Zheng(Author of SGLang),

Michele Castata(President of Replit), and

1 more.

gorilla-cli by gorilla-llm

CLI tool using LLMs to generate commands

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Nat Friedman(Former CEO of GitHub), and

31 more.

llama.cpp by ggml-org

C/C++ library for local LLM inference

84k

LLM deployment framework on Ray (now upstreamed to Ray)

updated 7 hours ago

Starred by

Travis Fischer(Founder of Agentic),

Jeff Hammerbacher(Cofounder of Cloudera), and

1 more.

ray-llm by ray-project

Starred by

Tobi Lutke(Cofounder of Shopify),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

13 more.

peft by huggingface

Parameter-efficient fine-tuning (PEFT) library

19k

updated 23 hours ago

Starred by

Tim J. Baek(Founder of Open WebUI),

Daniel Han(Cofounder of Unsloth), and

14 more.

bitsandbytes by bitsandbytes-foundation

PyTorch library for k-bit quantization, enabling accessible LLMs

updated 3 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

6 more.

ctransformers by marella

Python bindings for fast Transformer model inference

Starred by

Lianmin Zheng(Author of SGLang),

Simon Willison(Author of Django), and

4 more.

CTranslate2 by OpenNMT

Fast inference engine for Transformer models

updated 3 months ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

5 more.

EasyLM by young-geng

LLM training/finetuning framework in JAX/Flax

Open-source reproduction of LLaMA models

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Elie Bursztein(Cybersecurity Lead at Google DeepMind), and

9 more.

open_llama by openlm-research

0.0%

Starred by

Tobi Lutke(Cofounder of Shopify),

Tim J. Baek(Founder of Open WebUI), and

19 more.

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

updated 1 week ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Carol Willing(Core Contributor to CPython, Jupyter), and

37 more.

langchain by langchain-ai

Framework for building LLM-powered applications

113k

updated 18 hours ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Didier Lopes(Founder of OpenBB), and

12 more.

web-llm by mlc-ai

In-browser LLM inference engine using WebGPU for hardware acceleration

16k

Starred by

Nat Friedman(Former CEO of GitHub),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

5 more.

FasterTransformer by NVIDIA

Optimized transformer library for inference

Starred by

Anastasios Angelopoulos(Cofounder of LMArena),

Omar Sanseviero(DevRel at Google DeepMind), and

20 more.

FastChat by lm-sys

Open platform for training, serving, and evaluating LLM-based chatbots

39k

Starred by

Zhiqiang Xie(Author of SGLang),

Fabian Hedin(Cofounder of Lovable), and

21 more.

llama by meta-llama

Inference code for Llama 2 models (deprecated)

59k

updated 6 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jonathan Ragan-Kelley(Professor at MIT), and

13 more.

FlexLLMGen by FMInference

High-throughput generation engine for LLMs with limited GPU memory

updated 9 months ago

Starred by

Yang Song(Professor at Caltech; Research Scientist at OpenAI),

Jeremy Howard(Cofounder of fast.ai), and

3 more.

PiPPy by pytorch

PyTorch tool for pipeline parallelism

775

created 3 years ago

Starred by

Woosuk Kwon(Author of vLLM) and

Lianmin Zheng(Author of SGLang).

compiler-and-arch by KnowingNothing

Compiler/architecture resources for emerging domains

474

updated 6 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Tobi Lutke(Cofounder of Shopify), and

14 more.

skypilot by skypilot-org

Framework for cloud AI/batch jobs, unifying execution across diverse infrastructure

Jax-based ML framework for large-scale model training and experimentation

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

paxml by google

1.2%

518

created 3 years ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

10 more.

alpa by alpa-projects

Auto-parallelization framework for large-scale neural network training and serving

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

11 more.

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

40k

updated 18 hours ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Jeff Hammerbacher(Cofounder of Cloudera), and

1 more.

DPR by facebookresearch

Dense Passage Retriever for open-domain Q&A research

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Yang Song(Professor at Caltech; Research Scientist at OpenAI), and

15 more.

pytorch-lightning by Lightning-AI

Deep learning framework for pretraining, finetuning, and deploying AI models

30k

updated 2 days ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Aravind Srinivas(Cofounder of Perplexity), and

21 more.

faiss by facebookresearch

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Travis Fischer(Founder of Agentic), and

8 more.

tvm by apache

Compiler stack for deep learning systems

NLP attack/analysis research paper (EMNLP 2019)

Starred by

Thomas Wolf(Cofounder of Hugging Face).

universal-triggers by Eric-Wallace

295

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

gdrcopy by NVIDIA

GPU memory copy library using GPUDirect RDMA

created 10 years ago

Starred by

Wei-Lin Chiang(Cofounder of LMArena),

Woosuk Kwon(Author of vLLM), and

8 more.

Megatron-LM by NVIDIA

Framework for training transformer models at scale

13k

updated 19 hours ago

Starred by

Woosuk Kwon(Author of vLLM),

Ben Firshman(Cofounder of Replicate), and

1 more.

DeepLearningExamples by NVIDIA

Deep learning examples for training and deployment

14k

created 7 years ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Simon Willison(Author of Django), and

9 more.

gpt-2 by openai

Code for research paper "Language Models are Unsupervised Multitask Learners"

24k

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Aravind Srinivas(Cofounder of Perplexity), and

17 more.

fairseq by facebookresearch

Sequence modeling toolkit for translation, language modeling, and text generation research

32k

PyTorch implementation of A3C for Atari games

Starred by

Soumith Chintala(Author of PyTorch).

rl_a3c_pytorch by dgriff777

570

Starred by

Hiroshi Shibata(Core Contributor to Ruby),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

26 more.

ray by ray-project

AI compute engine for scaling Python and AI applications

38k

updated 9 hours ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Lewis Tunstall(Researcher at Hugging Face), and

10 more.

bert by google-research

TensorFlow code and pre-trained models for BERT

39k

Starred by

Tim J. Baek(Founder of Open WebUI).

awesome-ai-residency by dangkhoasdc

Curated list of AI residency programs

created 7 years ago

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind) and

Jeff Huber(Cofounder of Chroma).

3D-Machine-Learning by timzhang642

Resource list for 3D machine learning

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Aravind Srinivas(Cofounder of Perplexity), and

10 more.

tensor2tensor by tensorflow

Deprecated library for deep learning models/datasets, successor to Trax

16k

Language model code for generating reviews and discovering sentiment

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Andrew Trask(AI Researcher at Google DeepMind), and

2 more.

generating-reviews-discovering-sentiment by openai

Starred by

Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google),

Aravind Srinivas(Cofounder of Perplexity), and

44 more.

tensorflow by tensorflow