Sasha Rush

Research Scientist at Cursor; Professor at Cornell Tech

Authored Projects (4)

Starred by

Jason Knight

Jason Knight(Director AI Compilers at NVIDIA; Cofounder of OctoML),

Tim J. Baek

Tim J. Baek(Founder of Open WebUI),

Johannes Hagemann

Johannes Hagemann(Cofounder of Prime Intellect),

Shizhe Diao

Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA), and

4 more.

awesome-o1 by srush

Bibliography for OpenAI's o1 project

Focuses on chain-of-thought prompting for improved reasoning in LLMs.
Explores self-play, self-training, and expert iteration techniques.
Examines scaling laws, search algorithms (MCTS), and reward modeling.
Includes work on verifiable reasoning and process/outcome rewards.

Created 1 year ago

Updated 1 year ago

Starred by

Luca Soldaini

Luca Soldaini(Research Scientist at Ai2),

Yaowei Zheng

Yaowei Zheng(Author of LLaMA-Factory),

Lysandre Debut

Lysandre Debut(Chief Open-Source Officer at Hugging Face),

Jeremy Howard

Jeremy Howard(Cofounder of fast.ai), and

8 more.

MiniChain by srush

Tiny library for coding with large language models

Annotates Python functions that call language models with @prompt decorator.
Builds a graph of LLM calls for debugging and error handling.
Supports OpenAI, Hugging Face, Google Search, Python, Manifest-ML, Bash backends.
Includes prompt visualization system using Gradio for debugging prompt chains.

Created 3 years ago

Updated 1 year ago

Starred by

Jiayi Pan

Jiayi Pan(Author of SWE-Gym; MTS at xAI),

Albert Gu

Albert Gu(Cofounder of Cartesia; Professor at CMU),

Will Brown

Will Brown(Research Lead at Prime Intellect),

Yaowei Zheng

Yaowei Zheng(Author of LLaMA-Factory), and

9 more.

LLM-Training-Puzzles by srush

Hands-on puzzles for large language model training

Explores memory efficiency and compute pipelining.
Focuses on training on thousands of GPUs.
Uses Colab for hands-on experience.

Created 2 years ago

Updated 2 years ago

Starred by

Jeff Hammerbacher

Jeff Hammerbacher(Cofounder of Cloudera) and

Benjamin Bolte

Benjamin Bolte(Cofounder of K-Scale Labs).

llama2.rs by srush

Rust library for fast Llama2 inference on CPU

Supports 4-bit GPT-Q quantization for smaller model size.
Uses batched prefill, SIMD, and memory mapping for speed.
Includes a Python API for integration.
Supports Grouped Query Attention for large Llama models.

Created 2 years ago

Updated 2 years ago

Starred Projects (39)

jax-js by ekzhang

JAX-style ML framework for the web

abhiaiyer91:

smthomas:

mattjj:

Created 1 year ago

Updated 1 week ago

scaling-book by jax-ml

LLM scaling guide on TPUs

codekansas:

froystig:

ekzhang:

mattjj:

Created 1 year ago

Updated 1 month ago

picotron by huggingface

Minimalist distributed training framework for educational use

karpathy:

transitive-bullshit:

pgarbacki:

lewtun:

Created 1 year ago

Updated 8 months ago

awesome-discrete-diffusion-models by kuleshov-group

Curated list of discrete diffusion model resources

Created 3 years ago

Updated 7 months ago

lm.rs by samuel-vitorino

Minimal LLM inference in Rust

kerollmops:

Created 1 year ago

Updated 1 year ago

zml by zml

AI inference stack for production

pgarbacki:

luiscape:

shykes:

eiso:

Created 1 year ago

Updated 5 hours ago

flash-linear-attention by fla-org

Efficient Torch/Triton implementations for linear attention models

hiyouga:

xiezhq-hermann:

zhyncs:

yang-song:

Created 2 years ago

Updated 20 hours ago

tensordict by pytorch

PyTorch tensor container for efficient ML data handling

jph00:

rwightman:

soumith:

hammer:

Created 3 years ago

Updated 5 hours ago

ThunderKittens by HazyResearch

CUDA kernel framework for fast deep learning primitives

karpathy:

codekansas:

vincentweisser:

zhyncs:

Created 2 years ago

Updated 3 days ago

attorch by BobMcDear

PyTorch nn module subset, implemented in Python using Triton

karpathy:

Edward-Sun:

sualehasif:

comaniac:

Created 2 years ago

Updated 8 months ago

llm.c by karpathy

LLM training in pure C/CUDA, no PyTorch needed

norvig:

alexey-milovidov:

didierrlopes:

hiyouga:

Created 2 years ago

Updated 10 months ago

cutlass by NVIDIA

CUDA C++ and Python DSLs for high-performance linear algebra

pgarbacki:

pankajroark:

tridao:

chiphuyen:

Created 8 years ago

Updated 2 days ago

sglang by sgl-project

Fast serving framework for LLMs and vision language models

amin3141:

shimmyshimmer:

beyang:

samlambert:

Created 2 years ago

Updated 5 hours ago

mamba by state-spaces

Mamba SSM architecture for sequence modeling

geohot:

alexchen4ai:

luiscape:

zhiyuan8:

Created 2 years ago

Updated 1 day ago

vec2text by vec2text

Utilities for decoding deep representations (sentence embeddings) back to text

jn2clark:

taranjeet:

transitive-bullshit:

0hq:

Created 3 years ago

Updated 4 months ago

insanely-fast-whisper by Vaibhavs10

Fast Whisper transcription CLI

kentcdodds:

doriandarko:

jrk:

tjbck:

Created 2 years ago

Updated 6 months ago

epub2tts by aedocw

CLI tool to create audiobooks from epub/text files using TTS engines

Created 3 years ago

Updated 2 months ago

alignment-handbook by huggingface

Handbook for aligning language models with human/AI preferences

eugeneyan:

drishanarora:

philschmid:

vincentweisser:

Created 2 years ago

Updated 2 weeks ago

GPTQ-triton by fpgaminer

Triton kernel for GPTQ inference, improving context scaling

jph00:

osanseviero:

Created 3 years ago

Updated 2 years ago

candle by huggingface

Minimalist ML framework for Rust, emphasizing performance and ease of use

tobi:

binarybana:

alexchen4ai:

jn2clark:

Created 2 years ago

Updated 22 hours ago

gradio-tools by freddyaboulton

Gradio apps to LLM agent tool converter

ogabrielluiz:

abidlabs:

osanseviero:

Created 3 years ago

Updated 3 years ago

llmparser by kyang6

LLM tool for structured data extraction and classification

jeresig:

bryanhelmig:

nicolaerusan:

Created 3 years ago

Updated 2 years ago

stanford_alpaca by tatsu-lab

Instruction-following LLaMA model training and data generation

karpathy:

john-b-yang:

pgarbacki:

osanseviero:

Created 3 years ago

Updated 1 year ago

theseus by facebookresearch

Library for differentiable nonlinear optimization layers in PyTorch

natolambert:

Created 4 years ago

Updated 1 year ago

evaluate by huggingface

ML model evaluation library for standardized performance reporting

clmnt:

chiphuyen:

natolambert:

lvwerra:

Created 4 years ago

Updated 1 week ago

promptsource by bigscience-workshop

Toolkit for creating, sharing, and using natural language prompts

clmnt:

chiphuyen:

jph00:

teknium1:

Created 5 years ago

Updated 2 years ago

pytorch_block_sparse by huggingface

PyTorch extension for block-sparse linear layers

clmnt:

parasj:

lucidrains:

lewtun:

Created 5 years ago

Updated 5 years ago

datasets by huggingface

Access and process large AI datasets efficiently

clmnt:

chiphuyen:

transitive-bullshit:

gakonst:

Created 6 years ago

Updated 21 hours ago

tokenizers by huggingface

Fast tokenizer library optimized for research and production

clmnt:

hammer:

syrusakbary:

transitive-bullshit:

Created 6 years ago

Updated 21 hours ago

node-question-answering by huggingface

Fast question answering for Node.js

clmnt:

chuanli11:

luiscape:

julien-c:

Created 6 years ago

Updated 2 years ago

detecting-fake-text by HendrikStrobelt

Tool for detecting text generated by large language models

thomwolf:

Created 7 years ago

Updated 2 years ago

OpenNMT-tf by OpenNMT

Sequence learning toolkit for neural machine translation

RJT1990:

parano:

Created 8 years ago

Updated 2 years ago

text by pytorch

PyTorch library for NLP tasks

luiscape:

eugeneyan:

artidoro:

hammer:

Created 9 years ago

Updated 7 months ago

fairseq-lua by facebookresearch

Lua-based toolkit for sequence-to-sequence learning

bcherny:

generall:

thomwolf:

vincentweisser:

Created 9 years ago

Updated 4 years ago

generating-reviews-discovering-sentiment by openai

Language model code for generating reviews and discovering sentiment

aravindsrinivas:

shyamal-anadkat:

evhub:

vincentweisser:

Created 9 years ago

Updated 2 years ago

OpenNMT-py by OpenNMT

PyTorch framework for neural machine translation and LLM experimentation

mlabonne:

osanseviero:

hammer:

codekansas:

Created 9 years ago

Updated 6 months ago

examples by pytorch

PyTorch examples for diverse AI tasks

lilianweng:

hammer:

tjbck:

ari-holtzman:

Created 9 years ago

Updated 7 months ago

im2latex-tensorflow by ritheshkumar95

TensorFlow implementation of an im2latex system

Created 9 years ago

Updated 4 years ago

requests-for-research by openai

Deep learning problems collection for research

truell20:

chiphuyen:

vincentweisser:

gakonst:

Created 10 years ago

Updated 2 years ago

Feedback? Help us improve.