Stas Bekman

Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake

Authored Projects (1)

Starred by

Tobi Lutke

Tobi Lutke(Cofounder of Shopify),

Wu Yuxin

Wu Yuxin(Cofounder of Moonshot AI),

Roy Frostig

Roy Frostig(Coauthor of JAX; Research Scientist at Google DeepMind),

Jonathan Ragan-Kelley

Jonathan Ragan-Kelley(Professor at MIT), and

18 more.

ml-engineering by stas00

Open book for LLM/VLM training engineers

Methodologies, tools, and instructions for training/fine-tuning LLMs and multi-modal models.
Includes scripts and commands for quick solutions, plus debugging/testing tips.
Covers hardware (accelerators, storage, networking) and orchestration systems (SLURM).
Features guides for debugging PyTorch, using Slurm, and creating tiny models.

Created 5 years ago

Updated 1 week ago

Starred Projects (80)

InferenceMAX by InferenceMAX

Real-time LLM inference performance benchmarking

hammer:

vincentweisser:

Created 3 months ago

Updated 12 hours ago

ArcticInference by snowflakedb

vLLM plugin for high-throughput, low-latency LLM and embedding inference

luiscape:

WoosukKwon:

Created 7 months ago

Updated 18 hours ago

YaFSDP by yandex

Sharded data parallelism framework for transformer-like neural networks

omarsar:

luiscape:

winglian:

Created 1 year ago

Updated 1 month ago

lectures by gpu-mode

Lecture series for GPU-accelerated computing

cournape:

danielhanchen:

xiezhq-hermann:

willccbb:

Created 1 year ago

Updated 1 month ago

torchft by meta-pytorch

PyTorch library for fault-tolerant distributed training

hammer:

gakonst:

JohannesHa:

Created 1 year ago

Updated 1 week ago

lingua by facebookresearch

LLM research codebase for training and inference

theophilegervet:

binarybana:

simon-mo:

omarsar:

Created 1 year ago

Updated 3 months ago

gpustack by gpustack

GPU cluster manager for AI model deployment

hammer:

transitive-bullshit:

ggerganov:

Created 1 year ago

Updated 9 hours ago

evaluation-guidebook by huggingface

LLM evaluation guide for practitioners

clmnt:

winglian:

thomwolf:

dguido:

Created 1 year ago

Updated 4 weeks ago

tensorizer by coreweave

Module for fast model serialization/deserialization

vanpelt:

luiscape:

simon-mo:

binarybana:

Created 3 years ago

Updated 2 months ago

exo by exo-explore

AI cluster for running models on diverse devices

k06a:

chiphuyen:

omarsar:

luiscape:

Created 1 year ago

Updated 1 day ago

prompt-lookup-decoding by apoorvumang

Decoding method for faster LLM generation

zhyncs:

jph00:

casper-hansen:

ggerganov:

Created 1 year ago

Updated 1 year ago

json_repair by mangiucugna

JSON repair tool for LLM outputs

philschmid:

Created 2 years ago

Updated 3 days ago

Liger-Kernel by linkedin

Triton kernels for efficient LLM training

karpathy:

pgarbacki:

Jiayi-Pan:

WoosukKwon:

Created 1 year ago

Updated 9 hours ago

guidance by guidance-ai

Guidance is a programming paradigm for steering LLMs

tobi:

ekzhu:

Ying1123:

JustinLin610:

Created 3 years ago

Updated 3 weeks ago

applied-ai by meta-pytorch

Applied AI experiments and examples for PyTorch

winglian:

Created 2 years ago

Updated 2 months ago

InternEvo by InternLM

Lightweight training framework for model pre-training

hammer:

Created 1 year ago

Updated 2 months ago

veScale by volcengine

PyTorch-native framework for LLM training

JustinLin610:

casper-hansen:

hiyouga:

xiezhq-hermann:

Created 1 year ago

Updated 1 month ago

fms-fsdp by foundation-model-stack

Efficiently train foundation models with PyTorch

winglian:

Created 1 year ago

Updated 3 months ago

ao by pytorch

PyTorch library for quantization and sparsity in training/inference

danielhanchen:

shimmyshimmer:

parano:

willccbb:

Created 2 years ago

Updated 14 hours ago

AI-Chip by basicmi

AI chip resource list

casper-hansen:

forresti:

antiagainst:

lantiga:

Created 8 years ago

Updated 1 year ago

gritlm by ContextualAI

Research paper and models for generative representational instruction tuning

jn2clark:

apsdehal:

huybery:

xiaofan-luan:

Created 1 year ago

Updated 4 months ago

nanotron by huggingface

Minimalistic library for large language model pretraining

clmnt:

shizhediao:

vincentweisser:

luiscape:

Created 2 years ago

Updated 2 months ago

gateway by Portkey-AI

AI gateway for routing to 250+ LLMs via single API

shyamal-anadkat:

swyxio:

victortaelin:

chiphuyen:

Created 2 years ago

Updated 6 days ago

stable-diffusion-webui by AUTOMATIC1111

Web UI for Stable Diffusion

clmnt:

k06a:

vincentweisser:

tjbck:

Created 3 years ago

Updated 3 weeks ago

cookbook by EleutherAI

Deep learning resource for practical model work

JohannesHa:

osanseviero:

Created 1 year ago

Updated 3 months ago

HALOs by ContextualAI

Library for aligning LLMs using human-aware loss functions

hiyouga:

winglian:

Created 1 year ago

Updated 1 month ago

gpt-fast by meta-pytorch

PyTorch text generation for efficient transformer inference

karpathy:

antiagainst:

jamesr66a:

merrymercy:

Created 2 years ago

Updated 2 months ago

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

tobi:

clmnt:

tjbck:

chiphuyen:

Created 3 years ago

Updated 1 month ago

gpt-neox by EleutherAI

Framework for training large-scale autoregressive language models

hammer:

gakonst:

transitive-bullshit:

pgarbacki:

Created 4 years ago

Updated 1 month ago

lens by ContextualAI

Vision-language research paper using LLMs

douwekiela:

apsdehal:

Created 2 years ago

Updated 3 months ago

RetroMAE by staoxiao

Code for retrieval-oriented language model pre-training via masked auto-encoders

Created 3 years ago

Updated 1 year ago

PiPPy by pytorch

PyTorch tool for pipeline parallelism

yang-song:

jph00:

JohannesHa:

Edward-Sun:

Created 3 years ago

Updated 1 year ago

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

aravindsrinivas:

ValentaTomas:

winglian:

eugeneyan:

Created 5 years ago

Updated 22 hours ago

open_lm by mlfoundations

Language model research repo for medium-sized models (up to 7B params)

shizhediao:

alexchen4ai:

vincentweisser:

jph00:

Created 2 years ago

Updated 5 months ago

tokenmonster by alasdairforsythe

Subword tokenizer and vocabulary trainer for multiple languages

chiphuyen:

lucidrains:

Created 2 years ago

Updated 1 year ago

llm-analysis by cli99

CLI tool for LLM latency/memory analysis during training/inference

Ying1123:

Created 2 years ago

Updated 6 months ago

webdataset by webdataset

High-performance I/O system for large deep learning problems, strong PyTorch support

soldni:

chiphuyen:

hammer:

theophilegervet:

Created 6 years ago

Updated 4 months ago

aim by aimhubio

Experiment tracker for AI model training runs

amin3141:

patrick-kidger:

transitive-bullshit:

yang-song:

Created 6 years ago

Updated 21 hours ago

bitsandbytes by bitsandbytes-foundation

PyTorch library for k-bit quantization, enabling accessible LLMs

tjbck:

alexchen4ai:

danielhanchen:

shimmyshimmer:

Created 4 years ago

Updated 19 hours ago

large_language_model_training_playbook by huggingface

Tips for training large language models

natolambert:

osanseviero:

lysandrejik:

abhishekkrthakur:

Created 2 years ago

Updated 2 years ago

llm_training_handbook by huggingface

Handbook for large language model training methodologies

osanseviero:

Created 2 years ago

Updated 1 year ago

SwissArmyTransformer by THUDM

Transformer library for flexible model development

jph00:

Created 4 years ago

Updated 10 months ago

petals by bigscience-workshop

Run LLMs at home, BitTorrent-style

osanseviero:

chiphuyen:

vincentweisser:

ishaan-jaff:

Created 3 years ago

Updated 1 year ago

transformers-bloom-inference by huggingface

Inference solutions for BLOOM models

Edward-Sun:

soldni:

chuanli11:

philschmid:

Created 3 years ago

Updated 1 year ago

DeepSpeed-MII by deepspeedai

Python library for high-throughput, low-latency, and cost-effective model inference

hiyouga:

Ying1123:

merrymercy:

Sanger2000:

Created 3 years ago

Updated 4 months ago

t-zero by bigscience-workshop

Codebase for training, evaluation, and inference of the T0 model

philschmid:

Edward-Sun:

thomwolf:

Created 3 years ago

Updated 3 years ago

oslo by tunib-ai

Framework for large-scale transformer optimization

tridao:

philschmid:

Created 3 years ago

Updated 3 years ago

mistral by stanford-crfm

Framework for large language model training

clmnt:

osanseviero:

infwinston:

parasj:

Created 4 years ago

Updated 2 years ago

parallelformers by tunib-ai

Toolkit for easy model parallelization

soldni:

Edward-Sun:

parasj:

patrickvonplaten:

Created 4 years ago

Updated 2 years ago

sparseml by neuralmagic

Sparsification toolkit for optimized neural networks

chiphuyen:

infwinston:

shawnlewis:

hammer:

Created 4 years ago

Updated 5 months ago

accelerate by huggingface

PyTorch training helper for distributed execution

clmnt:

chiphuyen:

eugeneyan:

pgarbacki:

Created 5 years ago

Updated 1 week ago

ecco by jalammar

Python library for interactive NLP model visualization in Jupyter notebooks

domoritz:

JustinLin610:

hammer:

omarsar:

Created 5 years ago

Updated 1 year ago

question_generation by patil-suraj

Question generation study using transformers

Edward-Sun:

tholor:

rodrigosnader:

patrickvonplaten:

Created 5 years ago

Updated 1 year ago

catalyst by catalyst-team

PyTorch framework for accelerated deep learning R&D

logankilpatrick:

parasj:

chiphuyen:

luiscape:

Created 7 years ago

Updated 4 months ago

NeMo by NVIDIA-NeMo

Scalable generative AI framework for LLMs, multimodal, and speech AI research

alexchen4ai:

Ying1123:

shizhediao:

robinjhuang:

Created 6 years ago

Updated 11 hours ago

simpletransformers by ThilinaRajapakse

Rapid NLP task implementation

lysandrejik:

shizhediao:

gakonst:

ogabrielluiz:

Created 6 years ago

Updated 2 months ago

pytorch-tutorial by yunjey

PyTorch tutorial for deep learning researchers

tjbck:

bryanhelmig:

haotian-liu:

huybery:

Created 8 years ago

Updated 2 years ago

beginners-pytorch-deep-learning by falloutdurham

PyTorch deep learning examples from a book

Created 6 years ago

Updated 2 years ago

awesome-diarization by wq2012

List of resources for speaker diarization

Created 6 years ago

Updated 3 months ago

grokking-pytorch by Kaixhin

PyTorch guide with notes on usage, best practices, and debugging

aravindsrinivas:

hammer:

eugeneyan:

iamtrask:

Created 7 years ago

Updated 4 years ago

awesome-knowledge-distillation by dkozlov

Collection of knowledge distillation resources

Edward-Sun:

generall:

Created 8 years ago

Updated 1 week ago

awesome-transformer-nlp by cedrickchee

Curated list of NLP resources for Transformer networks

omarsar:

Created 6 years ago

Updated 1 year ago

xlnet by zihangdai

Language model research paper using generalized autoregressive pretraining

ankane:

evhub:

shizhediao:

forresti:

Created 6 years ago

Updated 2 years ago

transformer by sannykim

Resource list for studying Transformers

thomwolf:

Created 6 years ago

Updated 1 year ago

nlp_course by yandexdataschool

NLP course materials

borzunov:

pirroh:

omarsar:

Created 7 years ago

Updated 4 days ago

nlp-library by mihail911

NLP papers for practitioners

omarsar:

hammer:

vnivargi:

osanseviero:

Created 8 years ago

Updated 5 years ago

pattern by clips

Python web mining module

hammer:

AntonOsika:

generall:

luiscape:

Created 14 years ago

Updated 1 year ago

pytext by facebookresearch

NLP framework (deprecated, migrate to torchtext)

lysandrejik:

chiphuyen:

codekansas:

omarsar:

Created 7 years ago

Updated 3 years ago

captum by meta-pytorch

PyTorch library for model interpretability research

eugeneyan:

gakonst:

luiscape:

tgaddair:

Created 6 years ago

Updated 2 days ago

ray by ray-project

AI compute engine for scaling Python and AI applications

beyang:

hsbt:

gregpr07:

hiyouga:

Created 9 years ago

Updated 10 hours ago

awesome-healthcare by kakoni

Curated list of open source healthcare software, libraries, tools, and resources

Created 9 years ago

Updated 1 year ago

clinicalBERT by kexinhuang12345

Clinical notes model for hospital readmission prediction

Created 6 years ago

Updated 3 years ago

transfer-learning-conv-ai by huggingface

Conversational AI code for transfer learning research

clmnt:

huybery:

vincentweisser:

codekansas:

Created 6 years ago

Updated 2 years ago

transformers by huggingface

ML library for pretrained model inference and training

clmnt:

lilianweng:

karpathy:

tjbck:

Created 7 years ago

Updated 9 hours ago

pytorch-nlp-notebooks by scoutbee

PyTorch tutorials for NLP tasks

Created 6 years ago

Updated 6 years ago

the-incredible-pytorch by ritchieng

Curated list of PyTorch resources

ogabrielluiz:

philschmid:

john-b-yang:

jongwook:

Created 8 years ago

Updated 1 month ago

apex by NVIDIA

PyTorch extension for streamlined mixed precision & distributed training

aravindsrinivas:

JohannesHa:

spartee:

tgaddair:

Created 7 years ago

Updated 5 days ago

Awesome-pytorch-list by bharathgs

Curated list of PyTorch content on GitHub

aravindsrinivas:

spartee:

huybery:

generall:

Created 8 years ago

Updated 1 year ago

pytorch_image_classification by hysts

PyTorch image classification for various datasets (CIFAR, MNIST, ImageNet)

guygurari:

collin-burns:

Created 8 years ago

Updated 3 years ago

lectures by oxford-cs-deepnlp-2017

NLP course (lecture slides) for deep learning approaches to language

bcherny:

eddyxu:

simonw:

jongwook:

Created 8 years ago

Updated 2 years ago

Feedback? Help us improve.