Albert Gu

@albertfgu

Cofounder of Cartesia; Professor at CMU

View on GitHub

Starred Projects (24)

Starred by

Shizhe Diao(Research Scientist at NVIDIA; Author of LMFlow) and

Tri Dao(Chief Scientist at Together AI).

hnet by goombalab

2.7%

654

Hierarchical sequence modeling with dynamic chunking

created 1 month ago

updated 2 weeks ago

Starred by

Jesse Clark(Cofounder of Marqo) and

Wing Lian(Founder of Axolotl AI).

Muon by KellerJordan

3.0%

Optimizer for neural network hidden layers

created 9 months ago

updated 1 month ago

Starred by

Jiayi Pan(Author of SWE-Gym; MTS at xAI),

Will Brown(Research Lead at Prime Intellect), and

9 more.

LLM-Training-Puzzles by srush

0.3%

Hands-on puzzles for large language model training

created 2 years ago

updated 1 year ago

Awesome-Mamba-Papers by yyyujintang

0.1%

Mamba papers collection

created 1 year ago

updated 10 months ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Daniel Gross(Cofounder of Safe Superintelligence), and

23 more.

RWKV-LM by BlinkDL

0.1%

14k

RNN for LLM, transformer-level performance, parallelizable training

created 4 years ago

updated 4 days ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

10 more.

ThunderKittens by HazyResearch

0.5%

CUDA kernel framework for fast deep learning primitives

created 1 year ago

updated 1 week ago

pytorch-transformer-ts by kashif

0.3%

308

PyTorch module collection for time series forecasting

created 3 years ago

updated 9 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai), and

16 more.

TinyLlama by jzhang38

0.1%

Tiny pretraining project for a 1.1B Llama model

created 1 year ago

updated 1 year ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Clement Delangue(Cofounder of Hugging Face), and

41 more.

vllm by vllm-project

1.4%

55k

LLM serving engine for high-throughput, memory-efficient inference

created 2 years ago

updated 19 hours ago

Starred by

Dan Guido(Cofounder of Trail of Bits),

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), and

7 more.

open-llms by eugeneyan

0.2%

12k

Curated list of commercially-usable open LLMs

created 2 years ago

updated 6 months ago

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Zhiqiang Xie(Author of SGLang), and

8 more.

flash-linear-attention by fla-org

0.6%

Efficient Torch/Triton implementations for linear attention models

created 1 year ago

updated 1 day ago

mamba.py by alxndrTL

0.3%

PyTorch/MLX library for Mamba sequence modeling

created 1 year ago

updated 8 months ago

awesome-ssm-ml by AvivBick

0.3%

316

Reading list for research topics in state-space models

created 1 year ago

updated 2 months ago

Starred by

Travis Oliphant(Author of NumPy, SciPy, Anaconda),

Victor Taelin(Author of Bend, Kind, HVM), and

1 more.

mamba-minimal by johnma2006

Minimal Mamba SSM implementation in one PyTorch file

created 1 year ago

updated 1 year ago

Starred by

Yaowei Zheng(Author of LLaMA-Factory),

Jesse Clark(Cofounder of Marqo), and

2 more.

m2 by HazyResearch

0.2%

557

Sub-quadratic architecture research paper

created 2 years ago

updated 7 months ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Zhiyuan Li(Cofounder of Nexa AI), and

18 more.

mamba by state-spaces

0.3%

16k

Mamba SSM architecture for sequence modeling

created 1 year ago

updated 4 weeks ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Omar Sanseviero(DevRel at Google DeepMind), and

19 more.

mlc-llm by mlc-ai

0.2%

21k

Universal LLM deployment engine with ML compilation

created 2 years ago

updated 1 day ago

Starred by

Dongxu Huang(Cofounder of PingCAP),

Patrick von Platen(Research Engineer at Mistral; Author of Hugging Face Diffusers), and

2 more.

copilot.lua by zbirenbaum

0.3%

Neovim plugin enhancing GitHub Copilot

created 3 years ago

updated 1 day ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

9 more.

wandb by wandb

0.2%

10k

AI developer platform for model training, fine-tuning, and management

created 8 years ago

updated 19 hours ago

Starred by

Elvis Saravia(Founder of DAIR.AI),

Ce Zhang(Cofounder of Together AI; Professor at UChicago), and

22 more.

pytorch-lightning by Lightning-AI

0.2%

30k

Deep learning framework for pretraining, finetuning, and deploying AI models

created 6 years ago

updated 21 hours ago

Starred by

Jiaming Song(Chief Scientist at Luma AI),

Victor Taelin(Author of Bend, Kind, HVM), and

2 more.

safari by HazyResearch

895

Research paper implementations for sequence modeling with convolutions

created 2 years ago

updated 1 year ago

Starred by

Ishaan Jaffer(Cofounder of LiteLLM),

Anastasios Angelopoulos(Cofounder of LMArena), and

2 more.

manifest by HazyResearch

444

SDK for prompt programming with foundation models

created 3 years ago

updated 1 year ago

Starred by

Eugene Yan(AI Scientist at AWS),

Travis Fischer(Founder of Agentic), and

3 more.

meerkat by HazyResearch

0.1%

844

Dataframe tool for interactive dataset views, especially unstructured data

created 4 years ago

updated 7 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; MTS at xAI), and

25 more.

flash-attention by Dao-AILab

0.7%

19k

Fast, memory-efficient attention implementation

created 3 years ago

updated 1 day ago

Feedback? Help us improve.