Tri Dao

@tridao

Chief Scientist at Together AI

View on GitHub

Starred Projects (9)

Starred by

Lianmin Zheng(Author of SGLang).

Kimi-K2 by MoonshotAI

4.4%

State-of-the-art MoE language model

created 1 month ago

updated 2 days ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Jeremy Howard(Cofounder of fast.ai), and

2 more.

metal-flash-attention by philipturner

0.2%

511

Metal port of FlashAttention for Apple silicon

created 2 years ago

updated 10 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

15 more.

flash-attention by Dao-AILab

0.7%

19k

Fast, memory-efficient attention implementation

created 3 years ago

updated 21 hours ago

Starred by

Soumith Chintala(Author of PyTorch),

Travis Fischer(Founder of Agentic), and

2 more.

speechbrain by speechbrain

0.3%

10k

PyTorch toolkit for speech and text processing research

created 5 years ago

updated 5 days ago

Starred by

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake) and

Philipp Schmid(DevRel at Google DeepMind).

oslo by tunib-ai

309

Framework for large-scale transformer optimization

created 3 years ago

updated 2 years ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley) and

Jeff Hammerbacher(Cofounder of Cloudera).

lightning-hydra-template by ashleve

0.2%

ML experimentation template using PyTorch Lightning + Hydra

created 4 years ago

updated 11 months ago

Starred by

Ben Firshman(Cofounder of Replicate),

Lukas Biewald(Cofounder of Weights & Biases), and

2 more.

caliban by google

501

CLI tool for reproducible research workflows, locally or in the cloud

created 5 years ago

updated 1 year ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Yang Song(Professor at Caltech; Research Scientist at OpenAI), and

15 more.

pytorch-lightning by Lightning-AI

0.1%

30k

Deep learning framework for pretraining, finetuning, and deploying AI models

created 6 years ago

updated 2 days ago

Starred by

Hiroshi Shibata(Core Contributor to Ruby),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

26 more.

ray by ray-project

0.3%

38k

AI compute engine for scaling Python and AI applications

created 8 years ago

updated 19 hours ago

Feedback? Help us improve.