Albert Gu

Cofounder of Cartesia; Professor at CMU

Starred Projects (24)

hnet by goombalab

Hierarchical sequence modeling with dynamic chunking

shizhediao:

tridao:

Created 3 months ago

Updated 2 weeks ago

Muon by KellerJordan

Optimizer for neural network hidden layers

codekansas:

jn2clark:

winglian:

Created 11 months ago

Updated 3 months ago

LLM-Training-Puzzles by srush

Hands-on puzzles for large language model training

Jiayi-Pan:

willccbb:

hiyouga:

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

Awesome-Mamba-Papers by yyyujintang

Mamba papers collection

huybery:

Created 1 year ago

Updated 1 year ago

RWKV-LM by BlinkDL

RNN for LLM, transformer-level performance, parallelizable training

geohot:

danielgross:

nat:

sxyu:

Created 4 years ago

Updated 6 hours ago

ThunderKittens by HazyResearch

CUDA kernel framework for fast deep learning primitives

karpathy:

zhyncs:

gakonst:

luiscape:

Created 1 year ago

Updated 3 days ago

pytorch-transformer-ts by kashif

PyTorch module collection for time series forecasting

Created 3 years ago

Updated 11 months ago

TinyLlama by jzhang38

Tiny pretraining project for a 1.1B Llama model

karpathy:

geohot:

tobi:

chiphuyen:

Created 2 years ago

Updated 1 year ago

vllm by vllm-project

LLM serving engine for high-throughput, memory-efficient inference

karpathy:

clmnt:

tobi:

danielhanchen:

Created 2 years ago

Updated 5 hours ago

open-llms by eugeneyan

Curated list of commercially-usable open LLMs

dguido:

chiphuyen:

taranjeet:

transitive-bullshit:

Created 2 years ago

Updated 8 months ago

flash-linear-attention by fla-org

Efficient Torch/Triton implementations for linear attention models

hiyouga:

xiezhq-hermann:

zhyncs:

yang-song:

Created 1 year ago

Updated 7 hours ago

mamba.py by alxndrTL

PyTorch/MLX library for Mamba sequence modeling

Created 1 year ago

Updated 10 months ago

awesome-ssm-ml by AvivBick

Reading list for research topics in state-space models

Created 1 year ago

Updated 4 months ago

mamba-minimal by johnma2006

Minimal Mamba SSM implementation in one PyTorch file

teoliphant:

victortaelin:

mlabonne:

flaque:

Created 1 year ago

Updated 1 year ago

m2 by HazyResearch

Sub-quadratic architecture research paper

hiyouga:

pgarbacki:

jn2clark:

osanseviero:

Created 2 years ago

Updated 9 months ago

mamba by state-spaces

Mamba SSM architecture for sequence modeling

geohot:

alexchen4ai:

luiscape:

zhiyuan8:

Created 1 year ago

Updated 5 days ago

mlc-llm by mlc-ai

Universal LLM deployment engine with ML compilation

tobi:

osanseviero:

zhiyuan8:

zhuohan123:

Created 2 years ago

Updated 2 days ago

copilot.lua by zbirenbaum

Neovim plugin enhancing GitHub Copilot

c4pt0r:

patrickvonplaten:

gakonst:

sirupsen:

Created 3 years ago

Updated 1 day ago

wandb by wandb

AI developer platform for model training, fine-tuning, and management

aravindsrinivas:

gakonst:

transitive-bullshit:

ogabrielluiz:

Created 8 years ago

Updated 10 hours ago

pytorch-lightning by Lightning-AI

Deep learning framework for pretraining, finetuning, and deploying AI models

soldni:

omarsar:

zhangce:

JohannesHa:

Created 6 years ago

Updated 10 hours ago

safari by HazyResearch

Research paper implementations for sequence modeling with convolutions

tgaddair:

jiamings:

victortaelin:

winglian:

Created 2 years ago

Updated 1 year ago

manifest by HazyResearch

SDK for prompt programming with foundation models

ishaan-jaff:

aangelopoulos:

shizhediao:

parasj:

Created 3 years ago

Updated 1 year ago

meerkat by HazyResearch

Dataframe tool for interactive dataset views, especially unstructured data

eugeneyan:

transitive-bullshit:

jerryjliu:

hammer:

Created 4 years ago

Updated 9 months ago

flash-attention by Dao-AILab

Fast, memory-efficient attention implementation

karpathy:

Jiayi-Pan:

zhiyuan8:

alexchen4ai:

Created 3 years ago

Updated 17 hours ago

Feedback? Help us improve.