Sasha Rush

Research Scientist at Cursor; Professor at Cornell Tech

Authored Projects (5)

Starred by

Wing Lian

Wing Lian(Founder of Axolotl AI),

Alex Cheema

Alex Cheema(Cofounder of EXO Labs),

Sebastian De Ro

Sebastian De Ro(Cofounder of Magic AI),

Alexander Borzunov

Alexander Borzunov(Research Scientist at OpenAI), and

1 more.

Triton-Puzzles by srush

Interactive puzzles for learning Triton

Teaches Triton programming for GPUs from first principles.
Focuses on memory loading/storage for accelerator speed.
Progresses to real algorithms like Flash Attention.
Uses a Triton interpreter; no GPU needed.

Created 1 year ago

Updated 11 months ago

Starred by

Jason Knight

Jason Knight(Director AI Compilers at NVIDIA; Cofounder of OctoML),

Tim J. Baek

Tim J. Baek(Founder of Open WebUI),

Johannes Hagemann

Johannes Hagemann(Cofounder of Prime Intellect),

Shizhe Diao

Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), and

4 more.

awesome-o1 by srush

Bibliography for OpenAI's o1 project

Focuses on chain-of-thought prompting for improved reasoning in LLMs.
Explores self-play, self-training, and expert iteration techniques.
Examines scaling laws, search algorithms (MCTS), and reward modeling.
Includes work on verifiable reasoning and process/outcome rewards.

Created 1 year ago

Updated 11 months ago

Starred by

Luca Soldaini

Luca Soldaini(Research Scientist at Ai2),

Yaowei Zheng

Yaowei Zheng(Author of LLaMA-Factory),

Lysandre Debut

Lysandre Debut(Chief Open-Source Officer at Hugging Face),

Jeremy Howard

Jeremy Howard(Cofounder of fast.ai), and

8 more.

MiniChain by srush

Tiny library for coding with large language models

Annotates Python functions that call language models with @prompt decorator.
Builds a graph of LLM calls for debugging and error handling.
Supports OpenAI, Hugging Face, Google Search, Python, Manifest-ML, Bash backends.
Includes prompt visualization system using Gradio for debugging prompt chains.

Created 2 years ago

Updated 1 year ago

Starred by

Jiayi Pan

Jiayi Pan(Author of SWE-Gym; MTS at xAI),

Albert Gu

Albert Gu(Cofounder of Cartesia; Professor at CMU),

Will Brown

Will Brown(Research Lead at Prime Intellect),

Yaowei Zheng

Yaowei Zheng(Author of LLaMA-Factory), and

9 more.

LLM-Training-Puzzles by srush

Hands-on puzzles for large language model training

Explores memory efficiency and compute pipelining.
Focuses on training on thousands of GPUs.
Uses Colab for hands-on experience.

Created 2 years ago

Updated 1 year ago

Starred by

Jeff Hammerbacher

Jeff Hammerbacher(Cofounder of Cloudera) and

Benjamin Bolte

Benjamin Bolte(Cofounder of K-Scale Labs).

llama2.rs by srush

Rust library for fast Llama2 inference on CPU

Supports 4-bit GPT-Q quantization for smaller model size.
Uses batched prefill, SIMD, and memory mapping for speed.
Includes a Python API for integration.
Supports Grouped Query Attention for large Llama models.

Created 2 years ago

Updated 1 year ago

Starred Projects (36)

scaling-book by jax-ml

LLM scaling guide on TPUs

froystig:

ekzhang:

mattjj:

Created 8 months ago

Updated 1 week ago

picotron by huggingface

Minimalist distributed training framework for educational use

karpathy:

transitive-bullshit:

pgarbacki:

lewtun:

Created 1 year ago

Updated 1 month ago

awesome-discrete-diffusion-models by kuleshov-group

Curated list of discrete diffusion model resources

Created 2 years ago

Updated 1 month ago

lm.rs by samuel-vitorino

Minimal LLM inference in Rust

kerollmops:

Created 1 year ago

Updated 11 months ago

zml by zml

AI inference stack for production

pgarbacki:

luiscape:

shykes:

eiso:

Created 1 year ago

Updated 1 day ago

flash-linear-attention by fla-org

Efficient Torch/Triton implementations for linear attention models

hiyouga:

xiezhq-hermann:

zhyncs:

yang-song:

Created 1 year ago

Updated 2 days ago

ThunderKittens by HazyResearch

CUDA kernel framework for fast deep learning primitives

karpathy:

zhyncs:

gakonst:

luiscape:

Created 1 year ago

Updated 3 days ago

attorch by BobMcDear

PyTorch nn module subset, implemented in Python using Triton

karpathy:

Edward-Sun:

sualehasif:

comaniac:

Created 2 years ago

Updated 2 months ago

llm.c by karpathy

LLM training in pure C/CUDA, no PyTorch needed

norvig:

alexey-milovidov:

didierrlopes:

hiyouga:

Created 1 year ago

Updated 3 months ago

sglang by sgl-project

Fast serving framework for LLMs and vision language models

samlambert:

ebursztein:

philschmid:

pankajroark:

Created 1 year ago

Updated 22 hours ago

mamba by state-spaces

Mamba SSM architecture for sequence modeling

geohot:

alexchen4ai:

luiscape:

zhiyuan8:

Created 1 year ago

Updated 5 days ago

vec2text by vec2text

Utilities for decoding deep representations (sentence embeddings) back to text

jn2clark:

taranjeet:

transitive-bullshit:

0hq:

Created 2 years ago

Updated 2 months ago

insanely-fast-whisper by Vaibhavs10

Fast Whisper transcription CLI

doriandarko:

jrk:

tjbck:

luiscape:

Created 2 years ago

Updated 1 year ago

epub2tts by aedocw

CLI tool to create audiobooks from epub/text files using TTS engines

Created 2 years ago

Updated 4 months ago

alignment-handbook by huggingface

Handbook for aligning language models with human/AI preferences

eugeneyan:

drishanarora:

philschmid:

vincentweisser:

Created 2 years ago

Updated 1 month ago

GPTQ-triton by fpgaminer

Triton kernel for GPTQ inference, improving context scaling

jph00:

osanseviero:

Created 2 years ago

Updated 2 years ago

candle by huggingface

Minimalist ML framework for Rust, emphasizing performance and ease of use

tobi:

binarybana:

alexchen4ai:

jn2clark:

Created 2 years ago

Updated 1 day ago

gradio-tools by freddyaboulton

Gradio apps to LLM agent tool converter

ogabrielluiz:

abidlabs:

osanseviero:

Created 2 years ago

Updated 2 years ago

llmparser by kyang6

LLM tool for structured data extraction and classification

jeresig:

bryanhelmig:

nicolaerusan:

Created 2 years ago

Updated 2 years ago

stanford_alpaca by tatsu-lab

Instruction-following LLaMA model training and data generation

karpathy:

john-b-yang:

pgarbacki:

osanseviero:

Created 2 years ago

Updated 1 year ago

theseus by facebookresearch

Library for differentiable nonlinear optimization layers in PyTorch

natolambert:

Created 3 years ago

Updated 9 months ago

evaluate by huggingface

ML model evaluation library for standardized performance reporting

clmnt:

chiphuyen:

natolambert:

lvwerra:

Created 3 years ago

Updated 2 weeks ago

promptsource by bigscience-workshop

Toolkit for creating, sharing, and using natural language prompts

clmnt:

chiphuyen:

jph00:

teknium1:

Created 4 years ago

Updated 2 years ago

pytorch_block_sparse by huggingface

PyTorch extension for block-sparse linear layers

clmnt:

parasj:

lucidrains:

lewtun:

Created 5 years ago

Updated 4 years ago

datasets by huggingface

Access and process large AI datasets efficiently

clmnt:

chiphuyen:

transitive-bullshit:

gakonst:

Created 5 years ago

Updated 1 day ago

tokenizers by huggingface

Fast tokenizer library optimized for research and production

clmnt:

syrusakbary:

transitive-bullshit:

JohannesHa:

Created 6 years ago

Updated 6 days ago

node-question-answering by huggingface

Fast question answering for Node.js

clmnt:

chuanli11:

luiscape:

julien-c:

Created 5 years ago

Updated 2 years ago

detecting-fake-text by HendrikStrobelt

Tool for detecting text generated by large language models

thomwolf:

Created 6 years ago

Updated 1 year ago

OpenNMT-tf by OpenNMT

Sequence learning toolkit for neural machine translation

RJT1990:

parano:

Created 8 years ago

Updated 2 years ago

text by pytorch

PyTorch library for NLP tasks

luiscape:

eugeneyan:

artidoro:

hammer:

Created 8 years ago

Updated 1 month ago

fairseq-lua by facebookresearch

Lua-based toolkit for sequence-to-sequence learning

bcherny:

generall:

thomwolf:

vincentweisser:

Created 8 years ago

Updated 4 years ago

generating-reviews-discovering-sentiment by openai

Language model code for generating reviews and discovering sentiment

aravindsrinivas:

shyamal-anadkat:

evhub:

vincentweisser:

Created 8 years ago

Updated 2 years ago

OpenNMT-py by OpenNMT

PyTorch framework for neural machine translation and LLM experimentation

mlabonne:

osanseviero:

hammer:

codekansas:

Created 8 years ago

Updated 7 months ago

examples by pytorch

PyTorch examples for diverse AI tasks

lilianweng:

hammer:

tjbck:

ari-holtzman:

Created 9 years ago

Updated 1 month ago

im2latex-tensorflow by ritheshkumar95

TensorFlow implementation of an im2latex system

Created 8 years ago

Updated 3 years ago

requests-for-research by openai

Deep learning problems collection for research

truell20:

chiphuyen:

vincentweisser:

gakonst:

Created 9 years ago

Updated 1 year ago

Feedback? Help us improve.