Phil Wang

@lucidrains

Prolific Research Paper Implementer

View on GitHub

Authored Projects (29)

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeff Hammerbacher(Cofounder of Cloudera), and

6 more.

x-transformers by lucidrains

0.2%

Transformer library with extensive experimental features

created 4 years ago

updated 3 days ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

3 more.

vit-pytorch by lucidrains

0.2%

24k

PyTorch library for Vision Transformer variants and related techniques

created 4 years ago

updated 6 days ago

rotary-embedding-torch by lucidrains

0.4%

717

PyTorch library for rotary embeddings in transformers

created 4 years ago

updated 6 days ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley) and

Yang Song(Professor at Caltech; Research Scientist at OpenAI).

vector-quantize-pytorch by lucidrains

0.4%

PyTorch library for vector quantization techniques

created 5 years ago

updated 1 week ago

transfusion-pytorch by lucidrains

0.3%

Pytorch implementation for multimodal model research

created 11 months ago

updated 1 month ago

native-sparse-attention-pytorch by lucidrains

3.8%

684

Sparse attention implementation from Deepseek's research paper

created 5 months ago

updated 1 month ago

titans-pytorch by lucidrains

0.3%

PyTorch module for memory-efficient Transformers, based on the Titans paper

created 6 months ago

updated 2 months ago

nGPT-pytorch by lucidrains

288

PyTorch implementation of nGPT, a normalized GPT learning on the hypersphere

created 9 months ago

updated 2 months ago

ring-attention-pytorch by lucidrains

532

Pytorch impl of Ring Attention for near-infinite context

created 1 year ago

updated 2 months ago

Starred by

Shawn Wang(Editor of Latent Space).

soundstorm-pytorch by lucidrains

0.2%

Pytorch implementation of SoundStorm for efficient parallel audio generation

created 2 years ago

updated 3 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Mckay Wrigley(Founder of Takeoff AI), and

1 more.

PaLM-rlhf-pytorch by lucidrains

0.0%

RLHF implementation on PaLM

created 2 years ago

updated 3 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

audiolm-pytorch by lucidrains

0.2%

PyTorch implementation of Google's AudioLM for audio generation

created 2 years ago

updated 6 months ago

Starred by

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers).

speculative-decoding by lucidrains

275

Speculative decoding explorations

created 1 year ago

updated 7 months ago

robotic-transformer-pytorch by lucidrains

437

PyTorch implementation of RT1 (Robotic Transformer) for robotic control

created 2 years ago

updated 9 months ago

voicebox-pytorch by lucidrains

658

Pytorch implementation of MetaAI's Voicebox text-to-speech model

created 2 years ago

updated 10 months ago

Starred by

Andreas Jansson(Cofounder of Replicate),

Max Howell(Author of Homebrew), and

1 more.

toolformer-pytorch by lucidrains

0.1%

Pytorch implementation of Toolformer for language models using external tools

created 2 years ago

updated 1 year ago

Starred by

Victor Taelin(Author of Bend, Kind, HVM),

Jane Manchun Wong(Security Researcher; Tech Blogger), and

2 more.

DALLE2-pytorch by lucidrains

0.0%

11k

PyTorch implementation of DALL-E 2, a text-to-image synthesis neural network

created 3 years ago

updated 1 year ago

Starred by

Chenlin Meng(Cofounder of Pika).

video-diffusion-pytorch by lucidrains

0.1%

PyTorch implementation of video diffusion models

created 3 years ago

updated 1 year ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Shawn Wang(Editor of Latent Space), and

2 more.

self-rewarding-lm-pytorch by lucidrains

Training framework for self-rewarding language models

created 1 year ago

updated 1 year ago

Starred by

Ben Firshman(Cofounder of Replicate),

Chenlin Meng(Cofounder of Pika), and

1 more.

DALLE-pytorch by lucidrains

0.1%

PyTorch implementation of DALL-E, OpenAI's text-to-image transformer

created 4 years ago

updated 1 year ago

spear-tts-pytorch by lucidrains

271

Pytorch implementation of a multi-speaker text-to-speech attention network

created 2 years ago

updated 1 year ago

Starred by

Philipp Schmid(DevRel at Google DeepMind).

RETRO-pytorch by lucidrains

870

PyTorch implementation of Deepmind's RETRO retrieval-augmented LM

created 3 years ago

updated 1 year ago

medical-chatgpt by lucidrains

0.3%

314

ChatGPT fine-tune for primary care medicine

created 2 years ago

updated 1 year ago

Starred by

Anastasios Angelopoulos(Cofounder of LMArena).

naturalspeech2-pytorch by lucidrains

PyTorch implementation of Natural Speech 2, a zero-shot speech/singing synthesizer

created 2 years ago

updated 1 year ago

Starred by

Chenlin Meng(Cofounder of Pika),

Haotian Liu(Research Scientist at xAI; Author of LLaVA), and

2 more.

reformer-pytorch by lucidrains

0.1%

PyTorch implementation of the Reformer, an efficient Transformer research paper

created 5 years ago

updated 2 years ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Anastasios Angelopoulos(Cofounder of LMArena).

alphafold2 by lucidrains

Pytorch implementation for protein structure prediction

created 4 years ago

updated 2 years ago

triton-transformer by lucidrains

273

Transformer implementation in Triton

created 3 years ago

updated 3 years ago

Starred by

Jane Manchun Wong(Security Researcher; Tech Blogger) and

Travis Fischer(Founder of Agentic).

deep-daze by lucidrains

CLI tool for text-to-image generation using CLIP and SIREN

created 4 years ago

updated 3 years ago

Starred by

Max Howell(Author of Homebrew) and

Andreas Jansson(Cofounder of Replicate).

big-sleep by lucidrains

CLI tool for text-to-image generation

created 4 years ago

updated 3 years ago

Starred Projects (57)

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

20 more.

mlx by ml-explore

0.5%

22k

Array framework for machine learning on Apple silicon

created 1 year ago

updated 16 hours ago

Starred by

Eugene Yan(AI Scientist at AWS),

Luca Antiga(CTO of Lightning AI), and

1 more.

symbolicai by ExtensityAI

0.7%

Compositional differentiable programming library for neuro-symbolic AI with LLMs

created 2 years ago

updated 1 day ago

Starred by

Taranjeet Singh(Cofounder of Mem0),

Zhiqiang Xie(Author of SGLang), and

1 more.

openevolve by codelion

2.4%

Coding agent for scientific/algorithmic discovery, based on AlphaEvolve paper

created 2 months ago

updated 2 days ago

Starred by

Dan Guido(Cofounder of Trail of Bits) and

Joe Walnes(Head of Experimental Projects at Stripe).

chatterbox by resemble-ai

1.6%

10k

Open-source TTS model

created 3 months ago

updated 1 day ago

Starred by

Michael Han(Cofounder of Unsloth),

Travis Fischer(Founder of Agentic), and

4 more.

dia by nari-labs

0.6%

18k

TTS model for ultra-realistic dialogue generation

created 3 months ago

updated 3 weeks ago

Starred by

Jeremy Howard(Cofounder of fast.ai).

Moonlight by MoonshotAI

1.5%

MoE model and optimizer tech report

created 5 months ago

updated 4 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Alex Cheema(Cofounder of EXO Labs).

recurrent-pretraining by seal-rg

0.1%

806

Pretraining code for depth-recurrent language model research

created 5 months ago

updated 2 weeks ago

titans-pytorch by lucidrains

0.3%

PyTorch module for memory-efficient Transformers, based on the Titans paper

created 6 months ago

updated 2 months ago

ScholarXIV by dagmawibabi

0.1%

904

Open-source app for searching, reading, and summarizing arXiv papers

created 1 year ago

updated 1 month ago

Cosmos-Tokenizer by NVIDIA

0.2%

Suite of neural tokenizers for image and video processing

created 9 months ago

updated 5 months ago

Awesome-Hyperbolic-Representation-and-Deep-Learning by marlin-codes

0.4%

499

Paper list for hyperbolic representation learning research

created 4 years ago

updated 1 month ago

transfusion-pytorch by lucidrains

0.3%

Pytorch implementation for multimodal model research

created 11 months ago

updated 1 month ago

system-2-research by open-thought

0.1%

848

Reasoning resources for AI systems, agents, and cognitive architectures

created 1 year ago

updated 4 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

3 more.

vit-pytorch by lucidrains

0.2%

24k

PyTorch library for Vision Transformer variants and related techniques

created 4 years ago

updated 6 days ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

6 more.

ThunderKittens by HazyResearch

0.6%

CUDA kernel framework for fast deep learning primitives

created 1 year ago

updated 3 days ago

OpenCRISPR by Profluent-AI

0.3%

AI-designed gene editing system

created 1 year ago

updated 1 year ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), and

3 more.

jaxtyping by patrick-kidger

0.6%

Typing library for array shapes/dtypes

created 3 years ago

updated 3 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Jeff Hammerbacher(Cofounder of Cloudera).

evo by evo-design

0.1%

DNA foundation model for long-context biological sequence modeling and design

created 1 year ago

updated 5 months ago

Starred by

Awni Hannun(Author of MLX),

Patrick Kidger(Core Contributor to JAX ecosystem), and

1 more.

einx by fferflo

1.3%

390

Tensor operation library using Einstein-inspired notation

created 2 years ago

updated 3 months ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

meditron by epfLLM

0.2%

Open-source medical LLMs adapted from Llama-2

created 1 year ago

updated 1 year ago

Starred by

Patrick Kidger(Core Contributor to JAX ecosystem).

optimistix by patrick-kidger

0.9%

450

JAX library for nonlinear solvers (root finding, least squares, etc.)

created 1 year ago

updated 2 weeks ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

grain by google

1.0%

486

Python library for ML training data pipelines

created 3 years ago

updated 21 hours ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

med-flamingo by snap-stanford

429

Code repo for the Med-Flamingo research paper

created 2 years ago

updated 1 year ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake).

tokenmonster by alasdairforsythe

0.7%

594

Subword tokenizer and vocabulary trainer for multiple languages

created 2 years ago

updated 1 year ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

1 more.

hyena-dna by HazyResearch

704

Genomic foundation model for long-range DNA sequence modeling

created 2 years ago

updated 3 months ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

2 more.

datacomp by mlfoundations

0.4%

728

Competition tooling for multimodal dataset curation to pre-train CLIP models

created 2 years ago

updated 3 months ago

Starred by

Anastasios Angelopoulos(Cofounder of LMArena),

Jeremy Howard(Cofounder of fast.ai), and

4 more.

img2dataset by rom1504

0.2%

CLI tool for creating large image datasets from URLs

created 4 years ago

updated 1 year ago

Starred by

Anastasios Angelopoulos(Cofounder of LMArena),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

16 more.

evals by openai

0.2%

17k

Framework for evaluating LLMs and LLM systems, plus benchmark registry

created 2 years ago

updated 7 months ago

Starred by

Jonathan Ragan-Kelley(Professor at MIT) and

Jeff Hammerbacher(Cofounder of Cloudera).

Arraymancer by mratsim

Nim tensor library for scientific computing and deep learning

created 8 years ago

updated 5 months ago

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind),

Jonathan Ragan-Kelley(Professor at MIT), and

1 more.

shumai by facebookresearch

Differentiable tensor library for TypeScript and JavaScript

created 3 years ago

updated 1 year ago

Starred by

Victor Taelin(Author of Bend, Kind, HVM),

Jane Manchun Wong(Security Researcher; Tech Blogger), and

2 more.

DALLE2-pytorch by lucidrains

0.0%

11k

PyTorch implementation of DALL-E 2, a text-to-image synthesis neural network

created 3 years ago

updated 1 year ago

Starred by

Dan Abramov(Core Contributor to React),

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), and

27 more.

stable-diffusion by CompVis

0.1%

71k

Latent text-to-image diffusion model

created 3 years ago

updated 1 year ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

15 more.

flash-attention by Dao-AILab

0.7%

19k

Fast, memory-efficient attention implementation

created 3 years ago

updated 15 hours ago

YaLM-100B by yandex

0.0%

GPT-like neural network for text generation/processing

created 3 years ago

updated 2 years ago

Starred by

Nat Friedman(Former CEO of GitHub),

Jeff Hammerbacher(Cofounder of Cloudera), and

4 more.

CodeGen by salesforce

0.1%

Open-source model family for program synthesis

created 3 years ago

updated 6 months ago

Starred by

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers) and

Patrick Kidger(Core Contributor to JAX ecosystem).

diffrax by patrick-kidger

0.3%

JAX library for numerical differential equation solvers

created 4 years ago

updated 2 days ago

Starred by

John Resig(Author of jQuery; Chief Software Architect at Khan Academy),

Chenlin Meng(Cofounder of Pika), and

3 more.

clip-retrieval by rom1504

0.3%

CLIP retrieval system for semantic search

created 4 years ago

updated 1 year ago

Starred by

Jeremy Howard(Cofounder of fast.ai),

Chenlin Meng(Cofounder of Pika), and

1 more.

v-diffusion-pytorch by crowsonkb

719

PyTorch code for v-objective diffusion model inference

created 3 years ago

updated 2 years ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind) and

Philipp Schmid(DevRel at Google DeepMind).

koila by rentruewang

0.2%

Tool to prevent CUDA out-of-memory errors in PyTorch

created 3 years ago

updated 2 months ago

Starred by

Jane Manchun Wong(Security Researcher; Tech Blogger) and

Travis Fischer(Founder of Agentic).

deep-daze by lucidrains

CLI tool for text-to-image generation using CLIP and SIREN

created 4 years ago

updated 3 years ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Daniel Gross(Cofounder of Safe Superintelligence), and

12 more.

RWKV-LM by BlinkDL

0.2%

14k

RNN for LLM, transformer-level performance, parallelizable training

created 4 years ago

updated 6 days ago

Starred by

Jeremy Howard(Cofounder of fast.ai),

Simon Willison(Author of Django), and

2 more.

autofaiss by criteo

867

Auto indexer for k-NN similarity search using Faiss

created 4 years ago

updated 1 year ago

Starred by

Lewis Tunstall(Researcher at Hugging Face) and

Thomas Wolf(Cofounder of Hugging Face).

pytorch_block_sparse by huggingface

548

PyTorch extension for block-sparse linear layers

created 5 years ago

updated 4 years ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Eugene Yan(AI Scientist at AWS), and

9 more.

accelerate by huggingface

0.2%

PyTorch training helper for distributed execution

created 4 years ago

updated 1 day ago

roformer by ZhuiyiTechnology

0.3%

997

MLM pre-trained language model using rotary position embedding (RoPE)

created 4 years ago

updated 3 years ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Paige Bailey(DevRel Lead at Google DeepMind), and

5 more.

mesh-transformer-jax by kingoflolz

0.0%

JAX library for model-parallel transformers

created 4 years ago

updated 2 years ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

5 more.

gpt-neox by EleutherAI

0.1%

Framework for training large-scale autoregressive language models

created 4 years ago

updated 1 week ago

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind),

Lysandre Debut(Chief Open-Source Officer at Hugging Face), and

4 more.

gpt-neo by EleutherAI

0.0%

GPT-2/3-style model implementation using mesh-tensorflow

created 5 years ago

updated 3 years ago

Starred by

Nathan Lambert(AI Researcher at AI2).

TD3 by sfujim

0.2%

PyTorch implementation of TD3 for OpenAI gym tasks

created 7 years ago

updated 2 years ago

PPO-PyTorch by nikhilbarhate99

0.1%

Minimal PPO implementation in PyTorch for OpenAI Gym environments

created 6 years ago

updated 1 year ago

awesome-fast-attention by Separius

List of efficient attention modules

created 5 years ago

updated 4 years ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

ProtTrans by agemagician

0.2%

Pre-trained protein language models for bioinformatics & COVID-19 research

created 5 years ago

updated 2 months ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

DeepPurpose by kexinhuang12345

0.1%

Deep learning toolkit for drug discovery & bioinformatics

created 5 years ago

updated 1 year ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

11 more.

DeepSpeed by deepspeedai

0.2%

40k

Deep learning optimization library for distributed training and inference

created 5 years ago

updated 21 hours ago

Starred by

Travis Fischer(Founder of Agentic),

Philipp Schmid(DevRel at Google DeepMind), and

9 more.

tokenizers by huggingface

0.2%

10k

Fast tokenizer library optimized for research and production

created 5 years ago

updated 4 days ago

Starred by

Tim J. Baek(Founder of Open WebUI),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

6 more.

pytorch-tutorial by yunjey

0.1%

32k

PyTorch tutorial for deep learning researchers

created 8 years ago

updated 1 year ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

shadcn(Author of shadcn/ui), and

11 more.

ML-From-Scratch by eriklindernoren

0.4%

27k

ML model implementations from scratch, focused on accessibility

created 8 years ago

updated 1 year ago

Feedback? Help us improve.