Stas Bekman

updated 2 days ago

Starred Projects (77)

YaFSDP by yandex

Sharded data parallelism framework for transformer-like neural networks

972

Starred by

David Cournapeau(Author of scikit-learn),

Daniel Han(Cofounder of Unsloth), and

3 more.

lectures by gpu-mode

Lecture series for GPU-accelerated computing

PyTorch library for fault-tolerant distributed training

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Georgios Konstantopoulos(CTO, General Partner at Paradigm).

torchft by pytorch

1.6%

371

created 9 months ago

updated 19 hours ago

Starred by

Travis Fischer(Founder of Agentic).

lingua by facebookresearch

LLM research codebase for training and inference

created 9 months ago

updated 2 weeks ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Travis Fischer(Founder of Agentic), and

1 more.

gpustack by gpustack

1.6%

GPU cluster manager for AI model deployment

LLM evaluation guide for practitioners

updated 2 days ago

Starred by

Thomas Wolf(Cofounder of Hugging Face),

Dan Guido(Cofounder of Trail of Bits), and

2 more.

evaluation-guidebook by huggingface

0.7%

created 9 months ago

updated 6 months ago

Starred by

Chris Van Pelt(Cofounder of Weights & Biases).

tensorizer by coreweave

250

Module for fast model serialization/deserialization

updated 14 hours ago

Starred by

Anton Bukov(Cofounder of 1inch Network),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

8 more.

exo by exo-explore

AI cluster for running models on diverse devices

29k

Decoding method for faster LLM generation

updated 4 months ago

Starred by

Jeremy Howard(Cofounder of fast.ai) and

Georgi Gerganov(Author of llama.cpp, whisper.cpp).

prompt-lookup-decoding by apoorvumang

1.1%

556

JSON repair tool for LLM outputs

updated 11 months ago

Starred by

Philipp Schmid(DevRel at Google DeepMind).

json_repair by mangiucugna

1.1%

Triton kernels for efficient LLM training

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

4 more.

Liger-Kernel by linkedin

0.6%

updated 1 day ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Ying Sheng(Author of SGLang), and

20 more.

guidance by guidance-ai

Guidance is a programming paradigm for steering LLMs

21k

updated 22 hours ago

applied-ai by pytorch-labs

Applied AI experiments and examples for PyTorch

289

Lightweight training framework for model pre-training

updated 2 months ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

InternEvo by InternLM

1.0%

402

Starred by

Zhiqiang Xie(Author of SGLang).

veScale by volcengine

PyTorch-native framework for LLM training

839

updated 3 weeks ago

fms-fsdp by foundation-model-stack

Efficiently train foundation models with PyTorch

258

PyTorch library for quantization and sparsity in training/inference

Starred by

Lianmin Zheng(Author of SGLang),

Woosuk Kwon(Author of vLLM), and

4 more.

ao by pytorch

0.5%

updated 17 hours ago

Starred by

Luca Antiga(CTO of Lightning AI).

AI-Chip by basicmi

AI chip resource list

Starred by

Amanpreet Singh(Cofounder of Contextual AI) and

Philipp Schmid(DevRel at Google DeepMind).

gritlm by ContextualAI

Research paper and models for generative representational instruction tuning

662

Minimalistic library for large language model pretraining

Starred by

Lewis Tunstall(Researcher at Hugging Face),

Jeff Hammerbacher(Cofounder of Cloudera), and

3 more.

nanotron by huggingface

1.2%

AI gateway for routing to 250+ LLMs via single API

updated 3 weeks ago

Starred by

Shawn Wang(Editor of Latent Space),

Victor Taelin(Author of Bend, Kind, HVM), and

4 more.

gateway by Portkey-AI

0.5%

updated 1 day ago

Starred by

Anton Bukov(Cofounder of 1inch Network),

Tim J. Baek(Founder of Open WebUI), and

17 more.

stable-diffusion-webui by AUTOMATIC1111

Web UI for Stable Diffusion

155k

updated 3 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

cookbook by EleutherAI

Deep learning resource for practical model work

809

updated 4 days ago

HALOs by ContextualAI

Library for aligning LLMs using human-aware loss functions

873

updated 2 weeks ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Lianmin Zheng(Author of SGLang), and

12 more.

gpt-fast by pytorch-labs

PyTorch text generation for efficient transformer inference

updated 3 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Tim J. Baek(Founder of Open WebUI), and

19 more.

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

10k

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

5 more.

gpt-neox by EleutherAI

Framework for training large-scale autoregressive language models

Vision-language research paper using LLMs

Starred by

Douwe Kiela(Cofounder of Contextual AI) and

Amanpreet Singh(Cofounder of Contextual AI).

lens by ContextualAI

352

Code for retrieval-oriented language model pre-training via masked auto-encoders

RetroMAE by staoxiao

264

Starred by

Yang Song(Professor at Caltech; Research Scientist at OpenAI),

Jeremy Howard(Cofounder of fast.ai), and

3 more.

PiPPy by pytorch

PyTorch tool for pipeline parallelism

775

updated 11 months ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Eugene Yan(AI Scientist at AWS), and

11 more.

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

40k

created 5 years ago

updated 21 hours ago

Starred by

Jeremy Howard(Cofounder of fast.ai) and

Jeff Hammerbacher(Cofounder of Cloudera).

open_lm by mlfoundations

Language model research repo for medium-sized models (up to 7B params)

506

Subword tokenizer and vocabulary trainer for multiple languages

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Phil Wang(Prolific Research Paper Implementer).

tokenmonster by alasdairforsythe

0.7%

594

Starred by

Ying Sheng(Author of SGLang).

llm-analysis by cli99

CLI tool for LLM latency/memory analysis during training/inference

441

High-performance I/O system for large deep learning problems, strong PyTorch support

updated 3 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeff Hammerbacher(Cofounder of Cloudera), and

7 more.

webdataset by webdataset

0.6%

Starred by

Patrick Kidger(Core Contributor to JAX ecosystem),

Travis Fischer(Founder of Agentic), and

7 more.

aim by aimhubio

Experiment tracker for AI model training runs

updated 23 hours ago

Starred by

Tim J. Baek(Founder of Open WebUI),

Daniel Han(Cofounder of Unsloth), and

14 more.

bitsandbytes by bitsandbytes-foundation

PyTorch library for k-bit quantization, enabling accessible LLMs

Tips for training large language models

updated 3 days ago

Starred by

Nathan Lambert(AI Researcher at AI2),

Omar Sanseviero(DevRel at Google DeepMind), and

3 more.

large_language_model_training_playbook by huggingface

478

Handbook for large language model training methodologies

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

llm_training_handbook by huggingface

506

Starred by

Jeremy Howard(Cofounder of fast.ai).

SwissArmyTransformer by THUDM

Transformer library for flexible model development

updated 7 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

6 more.

petals by bigscience-workshop

Run LLMs at home, BitTorrent-style

10k

Inference solutions for BLOOM models

updated 10 months ago

Starred by

Philipp Schmid(DevRel at Google DeepMind).

transformers-bloom-inference by huggingface

563

updated 9 months ago

Starred by

Ying Sheng(Author of SGLang),

Lianmin Zheng(Author of SGLang), and

3 more.

DeepSpeed-MII by deepspeedai

Python library for high-throughput, low-latency, and cost-effective model inference

Codebase for training, evaluation, and inference of the T0 model

Starred by

Philipp Schmid(DevRel at Google DeepMind) and

Thomas Wolf(Cofounder of Hugging Face).

t-zero by bigscience-workshop

463

Framework for large-scale transformer optimization

Starred by

Tri Dao(Chief Scientist at Together AI) and

Philipp Schmid(DevRel at Google DeepMind).

oslo by tunib-ai

309

Framework for large language model training

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Wei-Lin Chiang(Cofounder of LMArena), and

2 more.

mistral by stanford-crfm

575

Toolkit for easy model parallelization

Starred by

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers) and

Julien Chaumond(Cofounder of Hugging Face).

parallelformers by tunib-ai

790

Sparsification toolkit for optimized neural networks

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Wei-Lin Chiang(Cofounder of LMArena), and

2 more.

sparseml by neuralmagic

updated 2 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Eugene Yan(AI Scientist at AWS), and

9 more.

accelerate by huggingface

PyTorch training helper for distributed execution

Python library for interactive NLP model visualization in Jupyter notebooks

updated 1 day ago

Starred by

Dominik Moritz(Professor at CMU; ML Researcher at Apple),

Jeff Hammerbacher(Cofounder of Cloudera), and

1 more.

ecco by jalammar

Question generation study using transformers

updated 11 months ago

Starred by

Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers) and

Julien Chaumond(Cofounder of Hugging Face).

question_generation by patil-suraj

created 5 years ago

PyTorch framework for accelerated deep learning R&D

Starred by

Logan Kilpatrick(Product Lead on Google AI Studio),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

2 more.

catalyst by catalyst-team

Starred by

Ying Sheng(Author of SGLang),

Tim J. Baek(Founder of Open WebUI), and

8 more.

NeMo by NVIDIA

Scalable generative AI framework for LLMs, multimodal, and speech AI research

15k

updated 14 hours ago

Starred by

Tim J. Baek(Founder of Open WebUI),

Haotian Liu(Research Scientist at xAI; Author of LLaVA), and

6 more.

pytorch-tutorial by yunjey

PyTorch tutorial for deep learning researchers

32k

PyTorch deep learning examples from a book

beginners-pytorch-deep-learning by falloutdurham

503

awesome-diarization by wq2012

List of resources for speaker diarization

PyTorch guide with notes on usage, best practices, and debugging

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Jeff Hammerbacher(Cofounder of Cloudera), and

4 more.

grokking-pytorch by Kaixhin

updated 3 years ago

Starred by

Andrey Vasnetsov(Cofounder of Qdrant).

awesome-knowledge-distillation by dkozlov

Collection of knowledge distillation resources

awesome-transformer-nlp by cedrickchee

Curated list of NLP resources for Transformer networks

updated 9 months ago

Starred by

Abhishek Thakur(World's First 4x Kaggle GrandMaster),

Amanpreet Singh(Cofounder of Contextual AI), and

4 more.

xlnet by zihangdai

Language model research paper using generalized autoregressive pretraining

Resource list for studying Transformers

Starred by

Thomas Wolf(Cofounder of Hugging Face).

transformer by sannykim

544

NLP papers for practitioners

Starred by

Michele Castata(President of Replit).

nlp_course by yandexdataschool

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Omar Sanseviero(DevRel at Google DeepMind).

nlp-library by mihail911

updated 5 years ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Anton Osika(Cofounder of Lovable), and

4 more.

pattern by clips

Python web mining module

created 14 years ago

Starred by

Lysandre Debut(Chief Open-Source Officer at Hugging Face),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

9 more.

pytext by facebookresearch

NLP framework (deprecated, migrate to torchtext)

Starred by

Eugene Yan(AI Scientist at AWS),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

3 more.

captum by pytorch

PyTorch library for model interpretability research

Starred by

Hiroshi Shibata(Core Contributor to Ruby),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

26 more.

ray by ray-project

AI compute engine for scaling Python and AI applications

38k

updated 12 hours ago

awesome-healthcare by kakoni

Curated list of open source healthcare software, libraries, tools, and resources

created 9 years ago

clinicalBERT by kexinhuang12345

Clinical notes model for hospital readmission prediction

424

Conversational AI code for transfer learning research

transfer-learning-conv-ai by huggingface

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

41 more.

transformers by huggingface

ML library for pretrained model inference and training

148k

PyTorch tutorials for NLP tasks

updated 10 hours ago

pytorch-nlp-notebooks by scoutbee

419

updated 5 years ago

Starred by

Philipp Schmid(DevRel at Google DeepMind),

John Yang(Author of SWE-bench, SWE-agent), and

4 more.

the-incredible-pytorch by ritchieng

Curated list of PyTorch resources

12k

updated 6 days ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Jeff Hammerbacher(Cofounder of Cloudera), and

8 more.

apex by NVIDIA

PyTorch extension for streamlined mixed precision & distributed training

updated 3 days ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Andrey Vasnetsov(Cofounder of Qdrant), and

1 more.

Awesome-pytorch-list by bharathgs

Curated list of PyTorch content on GitHub

16k

pytorch_image_classification by hysts

PyTorch image classification for various datasets (CIFAR, MNIST, ImageNet)

updated 3 years ago

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Simon Willison(Author of Django), and

8 more.

lectures by oxford-cs-deepnlp-2017

NLP course (lecture slides) for deep learning approaches to language

16k