Andrej Karpathy

@karpathy

Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n

View on GitHub

Authored Projects (10)

Starred by

Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google),

Didier Lopes(Founder of OpenBB), and

15 more.

llm.c by karpathy

0.2%

27k

LLM training in pure C/CUDA, no PyTorch needed

created 1 year ago

updated 1 month ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Daniel Gross(Cofounder of Safe Superintelligence), and

20 more.

nanoGPT by karpathy

0.4%

43k

Minimalist repo for training/finetuning GPT models

created 2 years ago

updated 7 months ago

Starred by

Didier Lopes(Founder of OpenBB),

Jeremy Howard(Cofounder of fast.ai), and

4 more.

nn-zero-to-hero by karpathy

0.9%

15k

Educational resource for neural network development, from basics to advanced models

created 2 years ago

updated 11 months ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Nat Friedman(Former CEO of GitHub), and

19 more.

minGPT by karpathy

0.2%

22k

Minimal PyTorch re-implementation for GPT training and inference

created 5 years ago

updated 11 months ago

Starred by

Carol Willing(Core Contributor to CPython, Jupyter) and

Eugene Yan(AI Scientist at AWS).

build-nanogpt by karpathy

0.4%

Educational resource for building nanoGPT from scratch

created 1 year ago

updated 11 months ago

Starred by

Simon Willison(Author of Django).

nano-llama31 by karpathy

0.2%

Minimal Llama 3.1 implementation for training, finetuning, and inference

created 1 year ago

updated 11 months ago

Starred by

Jared Palmer(Ex-VP of AI at Vercel; Founder of Turborepo; Author of Formik, TSDX),

Charlie Holtz(Founder of Melty), and

6 more.

LLM101n by karpathy

0.1%

34k

Educational resource for building a Storyteller AI LLM

created 1 year ago

updated 1 year ago

Starred by

Carol Willing(Core Contributor to CPython, Jupyter),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

7 more.

minbpe by karpathy

0.2%

10k

Minimal BPE encoder/decoder for LLM tokenization

created 1 year ago

updated 1 year ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Deshraj Yadav(Cofounder of Mem0), and

1 more.

makemore by karpathy

0.5%

Character-level language model for generating text

created 3 years ago

updated 1 year ago

deep-vector-quantization by karpathy

0.3%

581

Training code for VQ-VAEs with categorical latent bottlenecks

created 4 years ago

updated 3 years ago

Starred Projects (48)

Starred by

Travis Fischer(Founder of Agentic),

Lewis Tunstall(Researcher at Hugging Face), and

1 more.

picotron by huggingface

1.1%

Minimalist distributed training framework for educational use

created 10 months ago

updated 3 weeks ago

GRPO-Zero by policy-gradient

0.7%

Minimalist GRPO trainer for language models

created 3 months ago

updated 3 months ago

Starred by

Travis Fischer(Founder of Agentic).

AI_Diplomacy by EveryInc

1.3%

535

AI agents for turn-based strategy game Diplomacy

created 5 months ago

updated 2 days ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

4 more.

TinyZero by Jiayi-Pan

0.2%

12k

Minimal reproduction of DeepSeek R1 Zero for countdown/multiplication tasks

created 6 months ago

updated 3 months ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Alex Gajewski(Cofounder of San Francisco Compute Company), and

2 more.

modded-nanogpt by KellerJordan

2.6%

Language model training speedrun on 8x H100 GPUs

created 1 year ago

updated 2 weeks ago

Starred by

Zhuohan Li(Author of vLLM),

Alexander Wettig(Author of SWE-bench, SWE-agent), and

5 more.

torchtitan by pytorch

0.9%

PyTorch platform for generative AI model training research

created 1 year ago

updated 19 hours ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Woosuk Kwon(Author of vLLM), and

4 more.

Liger-Kernel by linkedin

0.6%

Triton kernels for efficient LLM training

created 1 year ago

updated 1 day ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Jared Palmer(Ex-VP of AI at Vercel; Founder of Turborepo; Author of Formik, TSDX), and

1 more.

mflux by filipstrand

0.7%

MLX port of FLUX for local image generation on Macs

created 11 months ago

updated 11 hours ago

Starred by

Eric Zhang(Founding Engineer at Modal),

Andreas Jansson(Cofounder of Replicate), and

4 more.

flux by black-forest-labs

0.4%

24k

Inference code for FLUX image generation & editing models

created 1 year ago

updated 2 days ago

Starred by

Travis Oliphant(Author of NumPy, SciPy, Anaconda).

torchchat by pytorch

0.1%

PyTorch-native SDK for local LLM inference across diverse platforms

created 1 year ago

updated 3 weeks ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Jonathan Ragan-Kelley(Professor at MIT), and

1 more.

gpu.cpp by AnswerDotAI

0.2%

C++ library for portable GPU computation using WebGPU

created 1 year ago

updated 2 weeks ago

unet.cu by clu0

0.2%

612

CUDA-based UNet diffusion model training implementation

created 1 year ago

updated 1 year ago

Samba by microsoft

0.3%

900

Language model research paper for efficient unlimited context

created 1 year ago

updated 3 months ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm).

mlx-gpt2 by pranavjad

0.5%

393

Minimal GPT-2 implementation for educational purposes

created 1 year ago

updated 1 year ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

12 more.

open-webui by open-webui

0.9%

105k

Self-hosted AI platform for local LLM deployment

created 1 year ago

updated 1 day ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Carlos E. Jimenez(Author of SWE-bench, SWE-agent), and

1 more.

matmulfreellm by ridgerchu

0.1%

MatMul-free language models

created 1 year ago

updated 1 week ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

14 more.

skypilot by skypilot-org

0.4%

Framework for cloud AI/batch jobs, unifying execution across diverse infrastructure

created 4 years ago

updated 15 hours ago

Starred by

Alex Cheema(Cofounder of EXO Labs),

Jeffrey Morgan(Cofounder of Ollama), and

2 more.

Perplexica by ItzCrazyKns

0.3%

23k

AI-powered search engine alternative

created 1 year ago

updated 1 day ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Woosuk Kwon(Author of vLLM), and

6 more.

ThunderKittens by HazyResearch

0.6%

CUDA kernel framework for fast deep learning primitives

created 1 year ago

updated 3 days ago

Starred by

Tim J. Baek(Founder of Open WebUI),

Omar Sanseviero(DevRel at Google DeepMind), and

4 more.

gemma.cpp by google

0.1%

C++ inference engine for Google's Gemma models

created 1 year ago

updated 23 hours ago

Starred by

Nat Friedman(Former CEO of GitHub),

Tobi Lutke(Cofounder of Shopify), and

31 more.

llama.cpp by ggml-org

0.4%

84k

C/C++ library for local LLM inference

created 2 years ago

updated 10 hours ago

Starred by

Anil Dash(Former CEO of Glitch),

Matt Holt(Author of Caddy), and

14 more.

llamafile by Mozilla-Ocho

0.2%

23k

Single-file LLM distribution and runtime via `llama.cpp` and Cosmopolitan Libc

created 1 year ago

updated 1 month ago

Starred by

Suale Hasif(Cofounder of Cursor) and

Jeremy Howard(Cofounder of fast.ai).

attorch by BobMcDear

0.3%

564

PyTorch nn module subset, implemented in Python using Triton

created 2 years ago

updated 2 days ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Omar Sanseviero(DevRel at Google DeepMind), and

1 more.

gemma_pytorch by google

0.1%

PyTorch implementation for Google's Gemma models

created 1 year ago

updated 2 months ago

Starred by

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers),

Simon Willison(Author of Django), and

3 more.

yet-another-applied-llm-benchmark by carlini

0.2%

LLM benchmark for evaluating models on previously asked programming questions

created 1 year ago

updated 3 months ago

Starred by

Travis Fischer(Founder of Agentic),

Victor Taelin(Author of Bend, Kind, HVM), and

2 more.

AlphaCodium by Codium-ai

0.2%

Code generation research paper implementation

created 1 year ago

updated 8 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Daniel Han(Cofounder of Unsloth), and

26 more.

vllm by vllm-project

1.0%

54k

LLM serving engine for high-throughput, memory-efficient inference

created 2 years ago

updated 10 hours ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

20 more.

mlx by ml-explore

0.5%

22k

Array framework for machine learning on Apple silicon

created 1 year ago

updated 16 hours ago

Starred by

John Yang(Author of SWE-bench, SWE-agent),

Omar Sanseviero(DevRel at Google DeepMind), and

12 more.

stanford_alpaca by tatsu-lab

0.1%

30k

Instruction-following LLaMA model training and data generation

created 2 years ago

updated 1 year ago

Starred by

Travis Fischer(Founder of Agentic) and

Jared Palmer(Ex-VP of AI at Vercel; Founder of Turborepo; Author of Formik, TSDX).

fine-tune-mistral by abacaj

0.3%

716

Fine-tuning script for Mistral-7B

created 1 year ago

updated 1 year ago

Starred by

Lianmin Zheng(Author of SGLang),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

12 more.

gpt-fast by pytorch-labs

0.1%

PyTorch text generation for efficient transformer inference

created 1 year ago

updated 3 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Jeff Huber(Cofounder of Chroma), and

17 more.

unsloth by unslothai

1.0%

43k

Finetuning tool for LLMs, targeting speed and memory efficiency

created 1 year ago

updated 4 days ago

inbox_cleaner by isafulf

0.2%

445

Python script for Gmail inbox management

created 1 year ago

updated 1 year ago

Starred by

Stefan van der Walt(Core Contributor to scientific Python ecosystem),

Sebastian Raschka(Author of Build a Large Language Model From Scratch), and

7 more.

litgpt by Lightning-AI

0.2%

13k

LLM SDK for pretraining, finetuning, and deploying 20+ high-performance LLMs

created 2 years ago

updated 1 week ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Tobi Lutke(Cofounder of Shopify), and

9 more.

TinyLlama by jzhang38

0.3%

Tiny pretraining project for a 1.1B Llama model

created 1 year ago

updated 1 year ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Travis Fischer(Founder of Agentic), and

1 more.

lit-llama by Lightning-AI

0.1%

LLaMA implementation for pretraining, finetuning, and inference

created 2 years ago

updated 1 month ago

Starred by

Carol Willing(Core Contributor to CPython, Jupyter),

Fabian Hedin(Cofounder of Lovable), and

37 more.

langchain by langchain-ai

0.4%

113k

Framework for building LLM-powered applications

created 2 years ago

updated 22 hours ago

Starred by

Anton Troynikov(Cofounder of Chroma),

Zhuohan Li(Author of vLLM), and

19 more.

llama_index by run-llama

0.3%

43k

Data framework for building LLM-powered agents

created 2 years ago

updated 15 hours ago

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Shawn Wang(Editor of Latent Space), and

18 more.

whisper by openai

0.4%

86k

Speech recognition model for multilingual transcription/translation

created 2 years ago

updated 1 month ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

20 more.

diffusers by huggingface

0.3%

30k

PyTorch/Flax library for diffusion model research and applications

created 3 years ago

updated 13 hours ago

Starred by

Wei-Lin Chiang(Cofounder of LMArena),

Lysandre Debut(Chief Open-Source Officer at Hugging Face), and

6 more.

dalle-mini by borisdayma

0.1%

15k

Text-to-image model for generating images from text prompts

created 4 years ago

updated 1 year ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

15 more.

flash-attention by Dao-AILab

0.7%

19k

Fast, memory-efficient attention implementation

created 3 years ago

updated 15 hours ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), and

3 more.

taming-transformers by CompVis

0.1%

Image synthesis research paper using transformers

created 4 years ago

updated 1 year ago

Starred by

Phil Wang(Prolific Research Paper Implementer),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

3 more.

vit-pytorch by lucidrains

0.2%

24k

PyTorch library for Vision Transformer variants and related techniques

created 4 years ago

updated 6 days ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Tim J. Baek(Founder of Open WebUI), and

41 more.

transformers by huggingface

0.2%

148k

ML library for pretrained model inference and training

created 6 years ago

updated 10 hours ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

11 more.

pytorch-image-models by huggingface

0.2%

35k

PyTorch image model collection with training, eval, and inference scripts

created 6 years ago

updated 16 hours ago

Starred by

Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google),

Aravind Srinivas(Cofounder of Perplexity), and

44 more.

tensorflow by tensorflow

0.1%

191k

Open-source ML framework

created 9 years ago

updated 10 hours ago

Starred by

Deshraj Yadav(Cofounder of Mem0) and

Jeff Hammerbacher(Cofounder of Cloudera).

rcnn by rbgirshick

Object detection system using CNNs and region proposals

created 11 years ago

updated 8 years ago

Feedback? Help us improve.