Sebastian Raschka

@rasbt

Author of Build a Large Language Model From Scratch

View on GitHub

Authored Projects (4)

Starred by

Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google),

Bojan Tunguz(AI Scientist; Formerly at NVIDIA), and

3 more.

LLMs-from-scratch by rasbt

1.4%

61k

Educational resource for LLM construction in PyTorch

created 2 years ago

updated 19 hours ago

LLM-workshop-2024 by rasbt

0.6%

995

Coding workshop for understanding LLM implementation and usage

created 1 year ago

updated 6 months ago

MachineLearning-QandAI-book by rasbt

0.8%

602

Supplementary materials for an ML/AI Q&A book

created 2 years ago

updated 10 months ago

scipy2023-deeplearning by rasbt

601

PyTorch deep learning workshop material

created 2 years ago

updated 1 year ago

Starred Projects (18)

Starred by

Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google),

Bojan Tunguz(AI Scientist; Formerly at NVIDIA), and

3 more.

LLMs-from-scratch by rasbt

1.4%

61k

Educational resource for LLM construction in PyTorch

created 2 years ago

updated 19 hours ago

Starred by

Michael Han(Cofounder of Unsloth),

Travis Fischer(Founder of Agentic), and

5 more.

DeepSeek-R1 by deepseek-ai

0.1%

91k

Reasoning models research paper

created 6 months ago

updated 1 month ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Omar Sanseviero(DevRel at Google DeepMind), and

1 more.

SimpleTuner by bghira

0.6%

Fine-tuning kit for diffusion models

created 2 years ago

updated 3 days ago

ml-retreat by hesamsheikh

2.0%

ML learning journal for advanced topics

created 10 months ago

updated 6 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Stefan van der Walt(Core Contributor to scientific Python ecosystem), and

7 more.

litgpt by Lightning-AI

0.2%

13k

LLM SDK for pretraining, finetuning, and deploying 20+ high-performance LLMs

created 2 years ago

updated 1 week ago

mlforswes by loganthorneloe

0.4%

802

ML learning roadmap for software engineers

created 1 year ago

updated 2 weeks ago

Starred by

Michael Han(Cofounder of Unsloth),

Simon Willison(Author of Django), and

3 more.

phoenix by Arize-ai

0.9%

AI observability platform for experimentation, evaluation, and troubleshooting

created 2 years ago

updated 18 hours ago

Starred by

Luca Antiga(CTO of Lightning AI),

William Falcon(Founder of Lightning AI), and

1 more.

lightning-thunder by Lightning-AI

0.1%

PyTorch compiler for model optimization via source-to-source transformation

created 1 year ago

updated 14 hours ago

Starred by

David Cournapeau(Author of scikit-learn),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

3 more.

lectures by gpu-mode

0.4%

Lecture series for GPU-accelerated computing

created 1 year ago

updated 1 month ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and

Jeff Hammerbacher(Cofounder of Cloudera).

direct-preference-optimization by eric-mitchell

0.5%

Reference implementation for Direct Preference Optimization (DPO)

created 2 years ago

updated 11 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Jonathan Ragan-Kelley(Professor at MIT), and

8 more.

ml-engineering by stas00

0.6%

15k

Open book for LLM/VLM training engineers

created 4 years ago

updated 2 days ago

Starred by

Jeremy Howard(Cofounder of fast.ai).

neurips_llm_efficiency_challenge by llm-efficiency-challenge

256

Competition toolkit for efficient LLM inference on a single GPU

created 2 years ago

updated 1 year ago

Starred by

Eugene Yan(AI Scientist at AWS).

LLaMA-Cult-and-More by shm007g

445

LLM resource list for models, datasets, training, and evaluation

created 2 years ago

updated 2 years ago

Starred by

Victor Taelin(Author of Bend, Kind, HVM),

Jeff Hammerbacher(Cofounder of Cloudera), and

1 more.

nanoT5 by PiotrNawrot

PyTorch code for T5 pre-training and fine-tuning on a single GPU

created 2 years ago

updated 11 months ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Deshraj Yadav(Cofounder of Mem0), and

1 more.

pytorch-grad-cam by jacobgil

0.3%

12k

PyTorch SDK for explainable AI in computer vision

created 8 years ago

updated 3 months ago

mint by dpressel

256

Minimal PyTorch library for Transformer tutorials

created 3 years ago

updated 3 years ago

deep-significance by Kaleidophon

336

SDK for statistical significance testing of deep neural networks

created 4 years ago

updated 1 year ago

Starred by

Travis Fischer(Founder of Agentic),

Lewis Tunstall(Researcher at Hugging Face), and

9 more.

umap by lmcinnes

0.1%

Dimension reduction technique for visualization and general non-linear reduction

created 8 years ago

updated 1 week ago

Feedback? Help us improve.