Stas Bekman

Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake

Authored Projects (1)

Starred by

Tobi Lutke

Tobi Lutke(Cofounder of Shopify),

Woosuk Kwon

Woosuk Kwon(Coauthor of vLLM),

Wu Yuxin

Wu Yuxin(Cofounder of Moonshot AI),

Roy Frostig

Roy Frostig(Coauthor of JAX; Research Scientist at Google DeepMind), and

19 more.

ml-engineering by stas00

Open book for LLM/VLM training engineers

Methodologies, tools, and instructions for training/fine-tuning LLMs and multi-modal models.
Includes scripts and commands for quick solutions, plus debugging/testing tips.
Covers hardware (accelerators, storage, networking) and orchestration systems (SLURM).
Features guides for debugging PyTorch, using Slurm, and creating tiny models.

Created 5 years ago

Updated 3 weeks ago

Starred Projects (83)

autokernel by RightNow-AI

Autonomous GPU kernel optimization for PyTorch

hammer:

pgarbacki:

winglian:

luiscape:

Created 1 month ago

Updated 3 weeks ago

llm-d by llm-d

Kubernetes-native framework for distributed LLM inference

parano:

vanpelt:

WoosukKwon:

hammer:

Created 11 months ago

Updated 1 day ago

InferenceX by SemiAnalysisAI

Real-time LLM inference performance benchmarking

parano:

hammer:

vincentweisser:

Created 9 months ago

Updated 21 hours ago

ArcticInference by snowflakedb

vLLM plugin for high-throughput, low-latency LLM and embedding inference

luiscape:

WoosukKwon:

Created 1 year ago

Updated 2 weeks ago

YaFSDP by yandex

Sharded data parallelism framework for transformer-like neural networks

omarsar:

luiscape:

winglian:

Created 1 year ago

Updated 1 week ago

lectures by gpu-mode

Lecture series for GPU-accelerated computing

cournape:

danielhanchen:

xiezhq-hermann:

willccbb:

Created 2 years ago

Updated 2 months ago

ArcticTraining by snowflakedb

LLM post-training acceleration framework

aksh-at:

luiscape:

Created 1 year ago

Updated 1 day ago

torchft by meta-pytorch

PyTorch library for fault-tolerant distributed training

hammer:

gakonst:

JohannesHa:

Created 1 year ago

Updated 1 week ago

lingua by facebookresearch

LLM research codebase for training and inference

theophilegervet:

binarybana:

simon-mo:

omarsar:

Created 1 year ago

Updated 8 months ago

gpustack by gpustack

GPU cluster manager for AI model deployment

hammer:

transitive-bullshit:

ggerganov:

Created 1 year ago

Updated 2 days ago

evaluation-guidebook by huggingface

LLM evaluation guide for practitioners

clmnt:

winglian:

thomwolf:

dguido:

Created 1 year ago

Updated 4 months ago

tensorizer by coreweave

Module for fast model serialization/deserialization

hammer:

vanpelt:

luiscape:

simon-mo:

Created 3 years ago

Updated 2 months ago

exo by exo-explore

AI cluster for running models on diverse devices

hammer:

k06a:

chiphuyen:

omarsar:

Created 1 year ago

Updated 1 day ago

prompt-lookup-decoding by apoorvumang

Decoding method for faster LLM generation

zhyncs:

jph00:

casper-hansen:

ggerganov:

Created 2 years ago

Updated 1 year ago

json_repair by mangiucugna

JSON repair tool for LLM outputs

ebursztein:

philschmid:

Created 2 years ago

Updated 23 hours ago

Liger-Kernel by linkedin

Triton kernels for efficient LLM training

karpathy:

chiphuyen:

pgarbacki:

Jiayi-Pan:

Created 1 year ago

Updated 3 days ago

guidance by guidance-ai

Guidance is a programming paradigm for steering LLMs

tobi:

ekzhu:

Ying1123:

JustinLin610:

Created 3 years ago

Updated 1 day ago

applied-ai by meta-pytorch

Applied AI experiments and examples for PyTorch

winglian:

Created 2 years ago

Updated 7 months ago

InternEvo by InternLM

Lightweight training framework for model pre-training

hammer:

Created 2 years ago

Updated 7 months ago

veScale by volcengine

PyTorch-native framework for LLM training

JustinLin610:

casper-hansen:

hiyouga:

xiezhq-hermann:

Created 2 years ago

Updated 1 month ago

fms-fsdp by foundation-model-stack

Efficiently train foundation models with PyTorch

winglian:

Created 2 years ago

Updated 4 months ago

ao by pytorch

PyTorch library for quantization and sparsity in training/inference

danielhanchen:

shimmyshimmer:

parano:

willccbb:

Created 2 years ago

Updated 1 day ago

AI-Chip by basicmi

AI chip resource list

casper-hansen:

forresti:

antiagainst:

lantiga:

Created 8 years ago

Updated 1 year ago

gritlm by ContextualAI

Research paper and models for generative representational instruction tuning

jn2clark:

apsdehal:

huybery:

xiaofan-luan:

Created 2 years ago

Updated 9 months ago

nanotron by huggingface

Minimalistic library for large language model pretraining

clmnt:

shizhediao:

vincentweisser:

luiscape:

Created 2 years ago

Updated 4 days ago

gateway by Portkey-AI

AI gateway for routing to 250+ LLMs via single API

shyamal-anadkat:

swyxio:

victortaelin:

chiphuyen:

Created 2 years ago

Updated 2 weeks ago

stable-diffusion-webui by AUTOMATIC1111

Web UI for Stable Diffusion

clmnt:

jmorganca:

k06a:

vincentweisser:

Created 3 years ago

Updated 1 month ago

cookbook by EleutherAI

Deep learning resource for practical model work

JohannesHa:

osanseviero:

Created 2 years ago

Updated 3 weeks ago

HALOs by ContextualAI

Library for aligning LLMs using human-aware loss functions

hiyouga:

winglian:

Created 2 years ago

Updated 6 months ago

gpt-fast by meta-pytorch

PyTorch text generation for efficient transformer inference

karpathy:

antiagainst:

jamesr66a:

merrymercy:

Created 2 years ago

Updated 7 months ago

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

tobi:

clmnt:

tjbck:

chiphuyen:

Created 3 years ago

Updated 3 weeks ago

gpt-neox by EleutherAI

Framework for training large-scale autoregressive language models

hammer:

gakonst:

transitive-bullshit:

pgarbacki:

Created 5 years ago

Updated 2 months ago

lens by ContextualAI

Vision-language research paper using LLMs

douwekiela:

apsdehal:

Created 2 years ago

Updated 8 months ago

RetroMAE by staoxiao

Code for retrieval-oriented language model pre-training via masked auto-encoders

Created 3 years ago

Updated 1 year ago

PiPPy by pytorch

PyTorch tool for pipeline parallelism

yang-song:

jph00:

JohannesHa:

Edward-Sun:

Created 4 years ago

Updated 1 year ago

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

aravindsrinivas:

ValentaTomas:

winglian:

eugeneyan:

Created 6 years ago

Updated 23 hours ago

open_lm by mlfoundations

Language model research repo for medium-sized models (up to 7B params)

shizhediao:

alexchen4ai:

vincentweisser:

jph00:

Created 2 years ago

Updated 10 months ago

tokenmonster by alasdairforsythe

Subword tokenizer and vocabulary trainer for multiple languages

jph00:

chiphuyen:

lucidrains:

Created 2 years ago

Updated 1 year ago

llm-analysis by cli99

CLI tool for LLM latency/memory analysis during training/inference

Ying1123:

Created 2 years ago

Updated 11 months ago

webdataset by webdataset

High-performance I/O system for large deep learning problems, strong PyTorch support

soldni:

chiphuyen:

hammer:

theophilegervet:

Created 6 years ago

Updated 2 months ago

aim by aimhubio

Experiment tracker for AI model training runs

amin3141:

patrick-kidger:

transitive-bullshit:

yang-song:

Created 6 years ago

Updated 1 day ago

bitsandbytes by bitsandbytes-foundation

PyTorch library for k-bit quantization, enabling accessible LLMs

lysandrejik:

tjbck:

alexchen4ai:

danielhanchen:

Created 4 years ago

Updated 1 day ago

large_language_model_training_playbook by huggingface

Tips for training large language models

natolambert:

osanseviero:

lysandrejik:

abhishekkrthakur:

Created 3 years ago

Updated 3 years ago

llm_training_handbook by huggingface

Handbook for large language model training methodologies

osanseviero:

Created 3 years ago

Updated 2 years ago

SwissArmyTransformer by THUDM

Transformer library for flexible model development

jph00:

Created 4 years ago

Updated 1 year ago

cutlass by NVIDIA

CUDA C++ and Python DSLs for high-performance linear algebra

pgarbacki:

pankajroark:

tridao:

chiphuyen:

Created 8 years ago

Updated 2 days ago

petals by bigscience-workshop

Run LLMs at home, BitTorrent-style

osanseviero:

chiphuyen:

vincentweisser:

ishaan-jaff:

Created 3 years ago

Updated 1 year ago

transformers-bloom-inference by huggingface

Inference solutions for BLOOM models

Edward-Sun:

soldni:

chuanli11:

philschmid:

Created 3 years ago

Updated 1 year ago

DeepSpeed-MII by deepspeedai

Python library for high-throughput, low-latency, and cost-effective model inference

hiyouga:

Ying1123:

merrymercy:

Sanger2000:

Created 4 years ago

Updated 9 months ago

t-zero by bigscience-workshop

Codebase for training, evaluation, and inference of the T0 model

philschmid:

Edward-Sun:

thomwolf:

Created 4 years ago

Updated 3 years ago

oslo by tunib-ai

Framework for large-scale transformer optimization

tridao:

philschmid:

Created 4 years ago

Updated 3 years ago

mistral by stanford-crfm

Framework for large language model training

clmnt:

osanseviero:

infwinston:

parasj:

Created 5 years ago

Updated 1 month ago

parallelformers by tunib-ai

Toolkit for easy model parallelization

soldni:

Edward-Sun:

parasj:

patrickvonplaten:

Created 4 years ago

Updated 3 years ago

sparseml by neuralmagic

Sparsification toolkit for optimized neural networks

chiphuyen:

infwinston:

shawnlewis:

hammer:

Created 5 years ago

Updated 10 months ago

accelerate by huggingface

PyTorch training helper for distributed execution

clmnt:

chiphuyen:

eugeneyan:

pgarbacki:

Created 5 years ago

Updated 1 day ago

ecco by jalammar

Python library for interactive NLP model visualization in Jupyter notebooks

domoritz:

JustinLin610:

hammer:

omarsar:

Created 5 years ago

Updated 1 year ago

question_generation by patil-suraj

Question generation study using transformers

Edward-Sun:

tholor:

rodrigosnader:

patrickvonplaten:

Created 5 years ago

Updated 2 years ago

catalyst by catalyst-team

PyTorch framework for accelerated deep learning R&D

logankilpatrick:

parasj:

chiphuyen:

luiscape:

Created 7 years ago

Updated 9 months ago

NeMo by NVIDIA-NeMo

Scalable generative AI framework for LLMs, multimodal, and speech AI research

alexchen4ai:

Ying1123:

shizhediao:

robinjhuang:

Created 6 years ago

Updated 1 day ago

simpletransformers by ThilinaRajapakse

Rapid NLP task implementation

lysandrejik:

shizhediao:

gakonst:

ogabrielluiz:

Created 6 years ago

Updated 7 months ago

pytorch-tutorial by yunjey

PyTorch tutorial for deep learning researchers

tjbck:

bryanhelmig:

haotian-liu:

huybery:

Created 9 years ago

Updated 2 years ago

beginners-pytorch-deep-learning by falloutdurham

PyTorch deep learning examples from a book

Created 6 years ago

Updated 3 years ago

awesome-diarization by wq2012

List of resources for speaker diarization

Created 7 years ago

Updated 8 months ago

grokking-pytorch by Kaixhin

PyTorch guide with notes on usage, best practices, and debugging

aravindsrinivas:

hammer:

eugeneyan:

iamtrask:

Created 7 years ago

Updated 4 years ago

awesome-knowledge-distillation by dkozlov

Collection of knowledge distillation resources

Edward-Sun:

generall:

Created 9 years ago

Updated 2 weeks ago

awesome-transformer-nlp by cedrickchee

Curated list of NLP resources for Transformer networks

omarsar:

Created 7 years ago

Updated 1 year ago

xlnet by zihangdai

Language model research paper using generalized autoregressive pretraining

ankane:

evhub:

shizhediao:

forresti:

Created 6 years ago

Updated 2 years ago

transformer by sannykim

Resource list for studying Transformers

thomwolf:

Created 6 years ago

Updated 2 years ago

nlp-library by mihail911

NLP papers for practitioners

omarsar:

hammer:

vnivargi:

osanseviero:

Created 8 years ago

Updated 5 years ago

pattern by clips

Python web mining module

hammer:

AntonOsika:

generall:

luiscape:

Created 15 years ago

Updated 1 year ago

pytext by facebookresearch

NLP framework (deprecated, migrate to torchtext)

lysandrejik:

chiphuyen:

codekansas:

omarsar:

Created 7 years ago

Updated 3 years ago

captum by meta-pytorch

PyTorch library for model interpretability research

eugeneyan:

gakonst:

luiscape:

tgaddair:

Created 6 years ago

Updated 2 days ago

ray by ray-project

AI compute engine for scaling Python and AI applications

didierrlopes:

beyang:

hsbt:

gregpr07:

Created 9 years ago

Updated 20 hours ago

awesome-healthcare by kakoni

Curated list of open source healthcare software, libraries, tools, and resources

Created 10 years ago

Updated 2 months ago

clinicalBERT by kexinhuang12345

Clinical notes model for hospital readmission prediction

Created 7 years ago

Updated 3 years ago

transfer-learning-conv-ai by huggingface

Conversational AI code for transfer learning research

clmnt:

huybery:

vincentweisser:

codekansas:

Created 7 years ago

Updated 2 years ago

transformers by huggingface

ML library for pretrained model inference and training

clmnt:

lilianweng:

karpathy:

tjbck:

Created 7 years ago

Updated 1 day ago

pytorch-nlp-notebooks by scoutbee

PyTorch tutorials for NLP tasks

Created 7 years ago

Updated 6 years ago

the-incredible-pytorch by ritchieng

Curated list of PyTorch resources

ogabrielluiz:

philschmid:

john-b-yang:

jongwook:

Created 9 years ago

Updated 2 weeks ago

apex by NVIDIA

PyTorch extension for streamlined mixed precision & distributed training

aravindsrinivas:

JohannesHa:

spartee:

tgaddair:

Created 8 years ago

Updated 3 days ago

Awesome-pytorch-list by bharathgs

Curated list of PyTorch content on GitHub

aravindsrinivas:

spartee:

huybery:

generall:

Created 9 years ago

Updated 2 months ago

pytorch_image_classification by hysts

PyTorch image classification for various datasets (CIFAR, MNIST, ImageNet)

guygurari:

collin-burns:

Created 8 years ago

Updated 4 years ago

lectures by oxford-cs-deepnlp-2017

NLP course (lecture slides) for deep learning approaches to language

bcherny:

eddyxu:

simonw:

jongwook:

Created 9 years ago

Updated 2 years ago

Feedback? Help us improve.