Patrick von Platen

@patrickvonplaten

Core Contributor to Hugging Face Transformers and Diffusers

View on GitHub

Starred Projects (181)

Starred by

Jeff Hammerbacher(Cofounder of Cloudera) and

Zhuohan Li(Author of vLLM).

DeepGEMM by deepseek-ai

0.4%

CUDA library for efficient FP8 GEMM kernels with fine-grained scaling

created 5 months ago

updated 1 day ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Eric Zhang(Founding Engineer at Modal), and

3 more.

jaxtyping by patrick-kidger

0.6%

Typing library for array shapes/dtypes

created 3 years ago

updated 3 months ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Didier Lopes(Founder of OpenBB), and

12 more.

axolotl by axolotl-ai-cloud

0.6%

10k

CLI tool for streamlined post-training of AI models

created 2 years ago

updated 22 hours ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

41 more.

transformers by huggingface

0.2%

148k

ML library for pretrained model inference and training

created 6 years ago

updated 10 hours ago

Starred by

Michael Han(Cofounder of Unsloth) and

Lysandre Debut(Chief Open-Source Officer at Hugging Face).

ktransformers by kvcache-ai

0.4%

15k

Framework for LLM inference optimization experimentation

created 1 year ago

updated 2 days ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

11 more.

redis by redis

0.1%

70k

Redis is a versatile data structure server, cache, and query engine

created 16 years ago

updated 1 day ago

LiveBench by LiveBench

0.7%

836

LLM benchmark for evaluating models on recently released data

created 1 year ago

updated 1 day ago

Starred by

Michael Han(Cofounder of Unsloth).

ml-cross-entropy by apple

0.6%

506

PyTorch module for memory-efficient cross-entropy in LLMs

created 8 months ago

updated 5 days ago

Starred by

Simon Willison(Author of Django),

Philipp Schmid(DevRel at Google DeepMind), and

8 more.

simple-evals by openai

0.4%

Lightweight library for evaluating language models

created 1 year ago

updated 3 weeks ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Michael Han(Cofounder of Unsloth), and

6 more.

DeepSeek-V3 by deepseek-ai

0.2%

98k

MoE language model research paper with 671B total parameters

created 7 months ago

updated 1 month ago

Starred by

Tim J. Baek(Founder of Open WebUI),

Alexander Wettig(Author of SWE-bench, SWE-agent), and

1 more.

awesome-o1 by srush

Bibliography for OpenAI's o1 project

created 9 months ago

updated 8 months ago

Starred by

Kyle Mathews(Author of Gatsby),

Jonathan Ragan-Kelley(Professor at MIT), and

2 more.

avante.nvim by yetone

0.7%

15k

Neovim plugin emulating Cursor AI IDE for AI-driven code assistance

created 11 months ago

updated 10 hours ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Eric Zhang(Founding Engineer at Modal), and

4 more.

flux by black-forest-labs

0.4%

24k

Inference code for FLUX image generation & editing models

created 1 year ago

updated 2 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

14 more.

litellm by BerriAI

1.9%

27k

SDK/proxy for calling 100+ LLM APIs using the OpenAI format

created 2 years ago

updated 15 hours ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Simon Willison(Author of Django), and

3 more.

yet-another-applied-llm-benchmark by carlini

0.2%

LLM benchmark for evaluating models on previously asked programming questions

created 1 year ago

updated 3 months ago

Starred by

Lewis Tunstall(Researcher at Hugging Face),

Soumith Chintala(Author of PyTorch), and

4 more.

torchtune by pytorch

0.2%

PyTorch library for LLM post-training and experimentation

created 1 year ago

updated 1 day ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Omar Sanseviero(DevRel at Google DeepMind), and

3 more.

mistral-finetune by mistralai

0.1%

Lightweight codebase for memory-efficient Mistral model fine-tuning

created 1 year ago

updated 10 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jeff Hammerbacher(Cofounder of Cloudera), and

5 more.

LoRA by microsoft

0.3%

12k

PyTorch library for low-rank adaptation (LoRA) of LLMs

created 4 years ago

updated 7 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

6 more.

ThunderKittens by HazyResearch

0.6%

CUDA kernel framework for fast deep learning primitives

created 1 year ago

updated 3 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Lysandre Debut(Chief Open-Source Officer at Hugging Face), and

4 more.

mistral-common by mistralai

0.3%

771

Inference library for Mistral models preprocessing

created 1 year ago

updated 1 day ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

client-python by mistralai

0.3%

628

Python SDK for Mistral AI platform

created 1 year ago

updated 1 week ago

cookbook by mistralai

0.4%

Cookbook with examples using Mistral models

created 1 year ago

updated 1 day ago

Starred by

Dongxu Huang(Cofounder of PingCAP) and

Georgios Konstantopoulos(CTO, General Partner at Paradigm).

copilot.lua by zbirenbaum

0.5%

Neovim plugin enhancing GitHub Copilot

created 3 years ago

updated 1 day ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Jeff Hammerbacher(Cofounder of Cloudera), and

6 more.

LLM-Training-Puzzles by srush

1.0%

Hands-on puzzles for large language model training

created 2 years ago

updated 1 year ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Jonathan Ragan-Kelley(Professor at MIT), and

8 more.

ml-engineering by stas00

0.6%

15k

Open book for LLM/VLM training engineers

created 4 years ago

updated 2 days ago

Starred by

Travis Fischer(Founder of Agentic),

Zhuohan Li(Author of vLLM), and

8 more.

LLaVA by haotian-liu

0.2%

23k

Multimodal assistant with GPT-4 level capabilities

created 2 years ago

updated 11 months ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

20 more.

mlx by ml-explore

0.5%

22k

Array framework for machine learning on Apple silicon

created 1 year ago

updated 16 hours ago

Starred by

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai),

Shawn Wang(Editor of Latent Space), and

8 more.

mamba by state-spaces

0.4%

16k

Mamba SSM architecture for sequence modeling

created 1 year ago

updated 2 weeks ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Lianmin Zheng(Author of SGLang), and

12 more.

gpt-fast by pytorch-labs

0.1%

PyTorch text generation for efficient transformer inference

created 1 year ago

updated 3 months ago

Starred by

Pietro Schirano(Founder of MagicPath),

Jonathan Ragan-Kelley(Professor at MIT), and

7 more.

insanely-fast-whisper by Vaibhavs10

0.3%

Fast Whisper transcription CLI

created 1 year ago

updated 1 year ago

Starred by

Tobi Lutke(Cofounder of Shopify).

taesd by madebyollin

0.5%

758

Tiny AutoEncoder for Stable Diffusion latents

created 2 years ago

updated 3 months ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Simon Willison(Author of Django), and

1 more.

consistencydecoder by openai

Improved decoding for stable diffusion VAEs

created 1 year ago

updated 1 year ago

SALMONN by bytedance

0.5%

Multimodal LLM for speech, audio events, and music inputs

created 2 years ago

updated 3 weeks ago

Starred by

Travis Fischer(Founder of Agentic),

Thomas Wolf(Cofounder of Hugging Face), and

2 more.

distil-whisper by huggingface

0.1%

Distilled speech recognition model, a faster Whisper variant

created 1 year ago

updated 6 months ago

Starred by

Jaret Burkett(Founder of Ostris) and

Omar Sanseviero(DevRel at Google DeepMind).

IP-Adapter by tencent-ailab

0.2%

Adapter for image prompt in text-to-image diffusion models

created 1 year ago

updated 1 year ago

PixArt-alpha by PixArt-alpha

0.2%

Fast text-to-image synthesis with Diffusion Transformers

created 1 year ago

updated 9 months ago

Starred by

Philipp Schmid(DevRel at Google DeepMind),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

1 more.

stable-fast by chengzeyi

0.1%

Inference optimization framework for HuggingFace Diffusers

created 1 year ago

updated 4 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Sebastian Raschka(Author of Build a Large Language Model From Scratch), and

1 more.

SimpleTuner by bghira

0.6%

Fine-tuning kit for diffusion models

created 2 years ago

updated 3 days ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

latent-consistency-model by luosiallen

0.0%

LCM: Fast image synthesis via few-step inference

created 1 year ago

updated 1 year ago

Starred by

Andreas Jansson(Cofounder of Replicate).

Hotshot-XL by hotshotco

0.2%

Text-to-GIF model for Stable Diffusion XL

created 1 year ago

updated 1 year ago

speculative-decoding by lucidrains

275

Speculative decoding explorations

created 1 year ago

updated 7 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Tobi Lutke(Cofounder of Shopify), and

26 more.

vllm by vllm-project

1.0%

54k

LLM serving engine for high-throughput, memory-efficient inference

created 2 years ago

updated 10 hours ago

Pallaidium by tin2tin

0.4%

Generative AI movie studio integrated into Blender

created 2 years ago

updated 2 weeks ago

Starred by

Travis Fischer(Founder of Agentic),

Zhiqiang Xie(Author of SGLang), and

3 more.

mistral-inference by mistralai

0.1%

10k

Inference library for Mistral models

created 1 year ago

updated 4 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

facechain by modelscope

0.0%

AI toolchain for generating personalized digital-twin portraits

created 2 years ago

updated 1 month ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Jason Miller(Author of Preact), and

11 more.

candle by huggingface

0.3%

18k

Minimalist ML framework for Rust, emphasizing performance and ease of use

created 2 years ago

updated 1 day ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm).

diffusers-rs by LaurentMazare

0.3%

568

Rust implementation of the Diffusers API for generative models

created 2 years ago

updated 1 year ago

Starred by

Tim J. Baek(Founder of Open WebUI),

Michael Han(Cofounder of Unsloth), and

14 more.

trl by huggingface

0.9%

15k

Library for transformer RL

created 5 years ago

updated 19 hours ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

distill-sd by segmind

607

Diffusion model distillation for smaller, faster Stable Diffusion

created 2 years ago

updated 1 year ago

BK-SDM by Nota-NetsPresso

1.4%

293

Compressed Stable Diffusion research paper for efficient text-to-image generation

created 2 years ago

updated 1 year ago

Starred by

Dan Abramov(Core Contributor to React),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

27 more.

stable-diffusion by CompVis

0.1%

71k

Latent text-to-image diffusion model

created 3 years ago

updated 1 year ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

2 more.

jax-triton by jax-ml

0.5%

411

JAX integrations for OpenAI Triton

created 3 years ago

updated 1 month ago

Starred by

Dan Guido(Cofounder of Trail of Bits),

Michael Han(Cofounder of Unsloth), and

9 more.

ComfyUI by comfyanonymous

0.8%

84k

Visual AI engine for diffusion models, API, and backend

created 2 years ago

updated 18 hours ago

Starred by

Max Howell(Author of Homebrew).

kohya_ss by bmaltais

0.2%

11k

GUI for Stable Diffusion training scripts

created 2 years ago

updated 1 week ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

audio-ai-timeline by archinetai

AI model timeline for audio generation

created 2 years ago

updated 1 year ago

Starred by

Travis Fischer(Founder of Agentic),

Jeff Hammerbacher(Cofounder of Cloudera), and

2 more.

consistency_models by openai

0.0%

PyTorch code for consistency models research paper

created 2 years ago

updated 1 year ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Alexey Milovidov(Cofounder of Clickhouse), and

6 more.

OpenLLM by bentoml

0.2%

12k

SDK for running open-source LLMs as OpenAI-compatible APIs

created 2 years ago

updated 4 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Evan Conrad(Cofounder of SF Compute), and

7 more.

modular by modular

0.2%

25k

AI toolchain unifying fragmented AI deployment workflows

created 2 years ago

updated 1 day ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Calvin French-Owen(Coounder of Segment), and

7 more.

audiocraft by facebookresearch

0.1%

22k

PyTorch library for audio processing and generation research

created 2 years ago

updated 4 months ago

recognize-anything by xinyu1205

0.3%

Image tagging models for common/open-set categories and comprehensive captioning

created 2 years ago

updated 5 months ago

Starred by

Travis Fischer(Founder of Agentic),

Jaret Burkett(Founder of Ostris), and

2 more.

sd-webui-controlnet by Mikubill

0.1%

18k

WebUI extension for ControlNet, an image-generation plugin

created 2 years ago

updated 11 months ago

Starred by

Anton Bukov(Cofounder of 1inch Network),

Tim J. Baek(Founder of Open WebUI), and

17 more.

stable-diffusion-webui by AUTOMATIC1111

0.2%

155k

Web UI for Stable Diffusion

created 2 years ago

updated 3 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

Wuerstchen by dome272

549

Text-to-image research paper on efficient diffusion model pretraining

created 2 years ago

updated 1 year ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

2 more.

datacomp by mlfoundations

0.4%

728

Competition tooling for multimodal dataset curation to pre-train CLIP models

created 2 years ago

updated 3 months ago

Starred by

Travis Fischer(Founder of Agentic),

Didier Lopes(Founder of OpenBB), and

2 more.

StableStudio by Stability-AI

0.0%

Open-source interface for generative AI

created 2 years ago

updated 1 year ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Toran Bruce Richards(Founder of AutoGPT), and

6 more.

stable-dreamfusion by ashawkey

0.1%

Text-to-3D model using NeRF and diffusion

created 2 years ago

updated 1 year ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

sdnext by vladmandic

0.3%

WebUI for AI generative image and video creation

created 2 years ago

updated 21 hours ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jeff Hammerbacher(Cofounder of Cloudera), and

20 more.

diffusers by huggingface

0.3%

30k

PyTorch/Flax library for diffusion model research and applications

created 3 years ago

updated 13 hours ago

Starred by

Travis Fischer(Founder of Agentic) and

Omar Sanseviero(DevRel at Google DeepMind).

Grounded-Segment-Anything by IDEA-Research

0.2%

17k

Framework for open-world visual tasks, combining multiple models

created 2 years ago

updated 11 months ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Aman Sanger(Cofounder of Cursor), and

6 more.

llm-foundry by mosaicml

0.0%

LLM training code for Databricks foundation models

created 2 years ago

updated 20 hours ago

Starred by

Didier Lopes(Founder of OpenBB).

ControlNet-v1-1-nightly by lllyasviel

0.1%

ControlNet 1.1 is a research project for neural network control of diffusion models

created 2 years ago

updated 11 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Carol Willing(Core Contributor to CPython, Jupyter), and

37 more.

langchain by langchain-ai

0.4%

113k

Framework for building LLM-powered applications

created 2 years ago

updated 22 hours ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera).

streaming by mosaicml

0.4%

Data streaming library for efficient neural network training

created 3 years ago

updated 2 weeks ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jaret Burkett(Founder of Ostris), and

4 more.

IF by deep-floyd

0.0%

Text-to-image model for photorealistic synthesis and language understanding

created 2 years ago

updated 1 year ago

diffusion by mosaicml

0.1%

703

Diffusion model training code

created 2 years ago

updated 6 months ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

15 more.

flash-attention by Dao-AILab

0.7%

19k

Fast, memory-efficient attention implementation

created 3 years ago

updated 15 hours ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jaret Burkett(Founder of Ostris), and

11 more.

stablediffusion by Stability-AI

0.1%

41k

Latent diffusion model for high-resolution image synthesis

created 2 years ago

updated 1 month ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Omar Sanseviero(DevRel at Google DeepMind), and

1 more.

whisper-jax by sanchit-gandhi

0.1%

JAX implementation of OpenAI's Whisper model for fast TPU inference

created 2 years ago

updated 1 year ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Tim J. Baek(Founder of Open WebUI), and

19 more.

text-generation-inference by huggingface

0.2%

10k

Rust/Python/gRPC server for fast LLM text generation

created 2 years ago

updated 1 week ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

9 more.

bark by suno-ai

0.1%

38k

Generative audio model for realistic speech and sound effects

created 2 years ago

updated 11 months ago

gen-efficientnet-pytorch by rwightman

PyTorch image models for efficient architectures

created 6 years ago

updated 1 year ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind) and

Chris Van Pelt(Cofounder of Weights & Biases).

EditAnything by sail-sg

0.0%

Image editing research paper using segmentation and diffusion

created 2 years ago

updated 5 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

Kandinsky-2 by ai-forever

0.0%

Multilingual text-to-image latent diffusion model

created 2 years ago

updated 1 year ago

tomesd by dbolya

Speed-up tool for Stable Diffusion

created 2 years ago

updated 1 year ago

Starred by

Carol Willing(Core Contributor to CPython, Jupyter),

Omar Sanseviero(DevRel at Google DeepMind), and

16 more.

gpt4all by nomic-ai

0.1%

74k

Desktop app for local LLM inference, no GPU/API needed

created 2 years ago

updated 2 months ago

Starred by

Anastasios Angelopoulos(Cofounder of LMArena).

DiT by facebookresearch

0.3%

PyTorch implementation for diffusion models with transformers (DiT)

created 2 years ago

updated 1 year ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

AudioLDM by haoheliu

0.3%

Audio generation research paper using latent diffusion

created 2 years ago

updated 1 month ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Georgios Konstantopoulos(CTO, General Partner at Paradigm), and

13 more.

peft by huggingface

0.4%

19k

Parameter-efficient fine-tuning (PEFT) library

created 2 years ago

updated 1 day ago

Starred by

Travis Fischer(Founder of Agentic),

Jeremy Howard(Cofounder of fast.ai), and

4 more.

setfit by huggingface

0.3%

Few-shot learning framework for Sentence Transformers

created 3 years ago

updated 3 months ago

Starred by

Chenlin Meng(Cofounder of Pika),

Omar Sanseviero(DevRel at Google DeepMind), and

1 more.

T2I-Adapter by TencentARC

0.2%

T2I-Adapter for controllable text-to-image diffusion models (SD-XL)

created 2 years ago

updated 1 year ago

Starred by

Taranjeet Singh(Cofounder of Mem0),

Jonathan Ragan-Kelley(Professor at MIT), and

8 more.

ControlNet by lllyasviel

0.1%

33k

Neural network structure for adding conditional control to diffusion models

created 2 years ago

updated 1 year ago

Starred by

Zhiqiang Xie(Author of SGLang),

Fabian Hedin(Cofounder of Lovable), and

21 more.

llama by meta-llama

0.1%

59k

Inference code for Llama 2 models (deprecated)

created 2 years ago

updated 6 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Jonathan Ragan-Kelley(Professor at MIT), and

13 more.

FlexLLMGen by FMInference

0.1%

High-throughput generation engine for LLMs with limited GPU memory

created 2 years ago

updated 9 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

mixture-of-diffusers by albarji

442

Image generation method for scene composition using multiple diffusion processes

created 2 years ago

updated 2 years ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Travis Fischer(Founder of Agentic), and

8 more.

InvokeAI by invoke-ai

0.2%

26k

Creative engine for visual media generation using Stable Diffusion models

created 3 years ago

updated 2 days ago

Starred by

Chenlin Meng(Cofounder of Pika) and

Omar Sanseviero(DevRel at Google DeepMind).

Tune-A-Video by showlab

Text-to-video generation via diffusion model fine-tuning

created 2 years ago

updated 1 year ago

Starred by

Didier Lopes(Founder of OpenBB),

Taranjeet Singh(Cofounder of Mem0), and

5 more.

imaginAIry by brycedrennan

0.0%

Pythonic AI image/video generation tool using Stable Diffusion

created 2 years ago

updated 10 months ago

Starred by

Ben Firshman(Cofounder of Replicate),

Travis Fischer(Founder of Agentic), and

2 more.

instruct-pix2pix by timothybrooks

0.1%

Image editing model for instruction-based image manipulation

created 2 years ago

updated 1 year ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Mckay Wrigley(Founder of Takeoff AI), and

11 more.

whisper.cpp by ggml-org

0.4%

42k

C/C++ port for high-performance Whisper ASR inference

created 2 years ago

updated 15 hours ago

Starred by

Peter Norvig(Author of Artificial Intelligence: A Modern Approach; Research Director at Google),

Aravind Srinivas(Cofounder of Perplexity), and

44 more.

tensorflow by tensorflow

0.1%

191k

Open-source ML framework

created 9 years ago

updated 10 hours ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Kyle Mathews(Author of Gatsby), and

3 more.

whisperX by m-bain

0.6%

17k

ASR tool for accurate, batched, word-level Whisper transcriptions

created 2 years ago

updated 1 month ago

Starred by

Philipp Schmid(DevRel at Google DeepMind),

Omar Sanseviero(DevRel at Google DeepMind), and

1 more.

speechbox by huggingface

359

Speech processing tools (punctuation, diarization)

created 2 years ago

updated 1 year ago

Starred by

Jaret Burkett(Founder of Ostris).

stablediffusion-infinity by lkwq007

0.1%

Web app for Stable Diffusion outpainting on infinite canvas

created 2 years ago

updated 2 years ago

Starred by

Anastasios Angelopoulos(Cofounder of LMArena),

Omar Sanseviero(DevRel at Google DeepMind), and

1 more.

riffusion-hobby by riffusion

0.1%

Library for real-time music/audio generation using stable diffusion

created 2 years ago

updated 1 year ago

Starred by

Chenlin Meng(Cofounder of Pika),

Simon Willison(Author of Django), and

4 more.

dream-textures by carson-katri

0.1%

Blender add-on for Stable Diffusion integration

created 2 years ago

updated 11 months ago

Starred by

Shawn Wang(Editor of Latent Space),

Eugene Yan(AI Scientist at AWS), and

6 more.

lora by cloneofsimo

0.0%

LoRA tool for fast diffusion fine-tuning

created 2 years ago

updated 1 year ago

CLIP_benchmark by LAION-AI

0.3%

743

CLI tool for CLIP-like model evaluation across diverse tasks/datasets

created 3 years ago

updated 1 week ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Omar Sanseviero(DevRel at Google DeepMind), and

2 more.

encodec by facebookresearch

0.3%

Neural audio codec for high-fidelity compression research

created 2 years ago

updated 1 year ago

Starred by

Jeremy Howard(Cofounder of fast.ai).

RePaint by andreas128

0.1%

Image inpainting via denoising diffusion probabilistic models

created 3 years ago

updated 2 years ago

cycle-diffusion by ChenWu98

631

PyTorch code for diffusion model latent space research paper

created 2 years ago

updated 1 year ago

Starred by

Casey Caruso(Managing Partner of Topology Ventures),

Travis Fischer(Founder of Agentic), and

2 more.

fast-stable-diffusion by TheLastBen

0.1%

Colab notebooks for fast Stable Diffusion + DreamBooth

created 2 years ago

updated 6 days ago

Starred by

Andreas Jansson(Cofounder of Replicate).

paint-with-words-sd by cloneofsimo

645

Stable Diffusion for text-guided image generation from segmentation maps

created 2 years ago

updated 2 years ago

Starred by

Ying Sheng(Author of SGLang) and

Lianmin Zheng(Author of SGLang).

dpm-solver by LuChengTHU

0.2%

Fast ODE solver for diffusion probabilistic model sampling

created 3 years ago

updated 1 year ago

IOPaint by Sanster

0.2%

22k

Image editing tool for inpainting and outpainting tasks

created 3 years ago

updated 3 months ago

Starred by

Chenlin Meng(Cofounder of Pika).

prompt-to-prompt by google

0.2%

Image editing via prompt manipulation, based on attention control

created 2 years ago

updated 1 year ago

Starred by

Chenlin Meng(Cofounder of Pika),

Lewis Tunstall(Researcher at Hugging Face), and

1 more.

stable-diffusion-videos by nateraw

0.0%

Video generator for Stable Diffusion latent space exploration

created 2 years ago

updated 10 months ago

Starred by

Patrick Kidger(Core Contributor to JAX ecosystem),

Travis Fischer(Founder of Agentic), and

7 more.

aim by aimhubio

0.2%

Experiment tracker for AI model training runs

created 6 years ago

updated 1 day ago

g-diffuser-bot by parlance-zz

0.4%

279

Discord bot for Stable Diffusion

created 2 years ago

updated 2 years ago

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), and

18 more.

whisper by openai

0.4%

86k

Speech recognition model for multilingual transcription/translation

created 2 years ago

updated 1 month ago

Starred by

Phil Wang(Prolific Research Paper Implementer) and

Patrick Kidger(Core Contributor to JAX ecosystem).

diffrax by patrick-kidger

0.3%

JAX library for numerical differential equation solvers

created 4 years ago

updated 2 days ago

Starred by

Jane Manchun Wong(Security Researcher; Tech Blogger),

Jeremy Howard(Cofounder of fast.ai), and

1 more.

k-diffusion by crowsonkb

0.0%

PyTorch implementation of Karras et al. (2022) diffusion models

created 3 years ago

updated 6 months ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Jaret Burkett(Founder of Ostris), and

4 more.

latent-diffusion by CompVis

0.2%

13k

Image synthesis research paper using latent diffusion models

created 3 years ago

updated 1 year ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

3 more.

taming-transformers by CompVis

0.1%

Image synthesis research paper using transformers

created 4 years ago

updated 1 year ago

DiffSinger by MoonInTheRiver

0.2%

PyTorch code for singing voice synthesis (SVS) and TTS research

created 3 years ago

updated 4 months ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Luca Antiga(CTO of Lightning AI), and

1 more.

tacotron2 by NVIDIA

0.0%

PyTorch implementation for text-to-speech synthesis

created 7 years ago

updated 1 year ago

Squeezeformer by kssteven418

0.4%

258

Speech recognition model based on an efficient Transformer architecture

created 3 years ago

updated 2 years ago

Starred by

Chenlin Meng(Cofounder of Pika),

Taranjeet Singh(Cofounder of Mem0), and

2 more.

disco-diffusion by alembics

0.0%

AI art and animation notebook

created 3 years ago

updated 2 years ago

Starred by

Chenlin Meng(Cofounder of Pika) and

Ben Firshman(Cofounder of Replicate).

clip-guided-diffusion by afiaka87

462

CLI tool for text-to-image generation using CLIP-guided diffusion

created 4 years ago

updated 3 years ago

Starred by

Jeremy Howard(Cofounder of fast.ai),

Chenlin Meng(Cofounder of Pika), and

1 more.

v-diffusion-pytorch by crowsonkb

719

PyTorch code for v-objective diffusion model inference

created 3 years ago

updated 2 years ago

WaveGrad by ivanvovk

403

PyTorch implementation of Google Brain's WaveGrad vocoder

created 4 years ago

updated 4 years ago

Starred by

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley),

Shengjia Zhao(Chief Scientist at Meta Superintelligence Labs), and

1 more.

glide-text2im by openai

0.1%

Text-conditional image synthesis model from research paper

created 3 years ago

updated 1 year ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Bojan Tunguz(AI Scientist; Formerly at NVIDIA), and

2 more.

guided-diffusion by openai

0.2%

Image synthesis codebase for diffusion models

created 4 years ago

updated 1 year ago

blended-diffusion by omriav

0.2%

577

Image editing technique (research paper)

created 3 years ago

updated 1 year ago

Starred by

Aravind Srinivas(Cofounder of Perplexity) and

Jeremy Howard(Cofounder of fast.ai).

improved-diffusion by openai

0.1%

Image diffusion codebase for research

created 4 years ago

updated 1 year ago

FastDiff by Rongjiehuang

411

PyTorch implementation for fast, high-fidelity speech synthesis via conditional diffusion

created 3 years ago

updated 1 year ago

Starred by

Taranjeet Singh(Cofounder of Mem0),

Omar Sanseviero(DevRel at Google DeepMind), and

5 more.

Awesome-Diffusion-Models by diff-usion

0.2%

12k

Diffusion models resource collection

created 3 years ago

updated 1 year ago

Starred by

Luca Antiga(CTO of Lightning AI),

Jeff Hammerbacher(Cofounder of Cloudera), and

4 more.

Transformers-Tutorials by NielsRogge

0.2%

11k

Transformer demos using Hugging Face, implemented in PyTorch

created 4 years ago

updated 1 month ago

Starred by

Michael Han(Cofounder of Unsloth),

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and

6 more.

TTS by coqui-ai

0.4%

42k

Deep learning toolkit for Text-to-Speech, research-tested

created 5 years ago

updated 11 months ago

Starred by

Travis Fischer(Founder of Agentic),

Shawn Wang(Editor of Latent Space), and

3 more.

tortoise-tts by neonbjb

0.2%

14k

Multi-voice TTS system emphasizing quality, realistic prosody

created 3 years ago

updated 8 months ago

Starred by

Andrey Vasnetsov(Cofounder of Qdrant).

wav2vec2-live by oliverguhr

362

Live speech recognition demo using wav2vec 2.0

created 4 years ago

updated 1 year ago

GigaSpeech by SpeechColab

0.3%

689

Large dataset for speech recognition research

created 4 years ago

updated 1 year ago

Starred by

Lysandre Debut(Chief Open-Source Officer at Hugging Face) and

Soumith Chintala(Author of PyTorch).

espnet by espnet

0.3%

End-to-end speech processing toolkit for various speech tasks

created 7 years ago

updated 4 days ago

Starred by

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

George Hotz(Author of tinygrad; Founder of the tiny corp, comma.ai), and

10 more.

tqdm by tqdm

0.2%

30k

Progress bar for Python and CLI tools

created 10 years ago

updated 2 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

huggingsound by jonatasgrosman

458

Speech toolkit for speech-related tasks based on Hugging Face's tools

created 3 years ago

updated 1 year ago

ctc-segmentation by lumaku

338

Python package for audio segmentation and utterance alignment

created 5 years ago

updated 1 year ago

av_hubert by facebookresearch

0.2%

925

Self-supervised learning framework for audio-visual speech research

created 3 years ago

updated 1 year ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Anton Troynikov(Cofounder of Chroma), and

12 more.

haystack by deepset-ai

0.4%

22k

AI orchestration framework for LLM application development

created 5 years ago

updated 2 days ago

icefall by k2-fsa

0.7%

created 4 years ago

updated 2 weeks ago

Gramformer by PrithivirajDamodaran

Grammar correction framework for NLP text

created 4 years ago

updated 2 years ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

voice_datasets by jim-schwoebel

0.3%

Voice dataset list for voice/sound computing

created 6 years ago

updated 1 year ago

UniSpeech by microsoft

467

Speech models for self-supervised learning

created 4 years ago

updated 1 year ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

muzic by microsoft

0.1%

AI research project for music understanding and generation

created 4 years ago

updated 9 months ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind),

Wei-Lin Chiang(Cofounder of LMArena), and

2 more.

mistral by stanford-crfm

575

Framework for large language model training

created 4 years ago

updated 1 year ago

Starred by

Julien Chaumond(Cofounder of Hugging Face),

Lysandre Debut(Chief Open-Source Officer at Hugging Face), and

5 more.

optimum by huggingface

0.3%

Hardware optimization tools for Transformers, Diffusers, etc

created 4 years ago

updated 1 day ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and

11 more.

DeepSpeed by deepspeedai

0.2%

40k

Deep learning optimization library for distributed training and inference

created 5 years ago

updated 21 hours ago

Starred by

Julien Chaumond(Cofounder of Hugging Face) and

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake).

parallelformers by tunib-ai

790

Toolkit for easy model parallelization

created 4 years ago

updated 2 years ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Wei-Lin Chiang(Cofounder of LMArena), and

6 more.

dalle-mini by borisdayma

0.1%

15k

Text-to-image model for generating images from text prompts

created 4 years ago

updated 1 year ago

Starred by

Omar Sanseviero(DevRel at Google DeepMind).

pyctcdecode by kensho-technologies

0.7%

453

CTC beam search decoder for speech recognition

created 4 years ago

updated 2 years ago

Starred by

Ying Sheng(Author of SGLang),

Tim J. Baek(Founder of Open WebUI), and

8 more.

NeMo by NVIDIA

0.4%

15k

Scalable generative AI framework for LLMs, multimodal, and speech AI research

created 6 years ago

updated 14 hours ago

Starred by

Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n),

Omar Sanseviero(DevRel at Google DeepMind), and

11 more.

pytorch-image-models by huggingface

0.2%

35k

PyTorch image model collection with training, eval, and inference scripts

created 6 years ago

updated 16 hours ago

Starred by

Lewis Tunstall(Researcher at Hugging Face) and

Thomas Wolf(Cofounder of Hugging Face).

fastformers by microsoft

705

NLU optimization recipes for transformer models

created 5 years ago

updated 4 months ago

Starred by

Lilian Weng(Cofounder of Thinking Machines Lab),

Aravind Srinivas(Cofounder of Perplexity), and

17 more.

fairseq by facebookresearch

0.1%

32k

Sequence modeling toolkit for translation, language modeling, and text generation research

created 8 years ago

updated 1 month ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Jeff Hammerbacher(Cofounder of Cloudera), and

2 more.

awesome-jax by n2cholas

0.3%

Curated list of JAX resources for high-performance ML research

created 4 years ago

updated 5 months ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Didier Lopes(Founder of OpenBB), and

10 more.

sentence-transformers by UKPLab

0.2%

17k

Framework for text embeddings, retrieval, and reranking

created 6 years ago

updated 3 days ago

Starred by

Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems),

Eugene Yan(AI Scientist at AWS), and

9 more.

accelerate by huggingface

0.2%

PyTorch training helper for distributed execution

created 4 years ago

updated 1 day ago

Starred by

Georgios Konstantopoulos(CTO, General Partner at Paradigm),

Paige Bailey(DevRel Lead at Google DeepMind), and

5 more.

mesh-transformer-jax by kingoflolz

0.0%

JAX library for model-parallel transformers

created 4 years ago

updated 2 years ago

Starred by

Elie Bursztein(Cybersecurity Lead at Google DeepMind),

Lysandre Debut(Chief Open-Source Officer at Hugging Face), and

4 more.

gpt-neo by EleutherAI

0.0%

GPT-2/3-style model implementation using mesh-tensorflow

created 5 years ago

updated 3 years ago

Starred by

Soumith Chintala(Author of PyTorch),

Travis Fischer(Founder of Agentic), and

2 more.

speechbrain by speechbrain

0.3%

10k

PyTorch toolkit for speech and text processing research

created 5 years ago

updated 5 days ago

Starred by

Tobi Lutke(Cofounder of Shopify),

Abhishek Thakur(World's First 4x Kaggle GrandMaster), and

7 more.

autotrain-advanced by huggingface

0.2%

No-code tool for training/finetuning models across modalities/tasks

created 4 years ago

updated 6 months ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Travis Fischer(Founder of Agentic), and

11 more.

CLIP by openai

0.3%

30k

Image-text matching model for zero-shot prediction

created 4 years ago

updated 1 year ago

Starred by

Charlie Marsh(Founder of Astral; Author of Ruff, uv),

Jiayi Pan(Author of SWE-Gym; AI Researcher at UC Berkeley), and

10 more.

flax by google

0.2%

NN library for JAX, designed for flexibility in neural network research

created 5 years ago

updated 17 hours ago

Starred by

Julien Chaumond(Cofounder of Hugging Face) and

Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake).

question_generation by patil-suraj

Question generation study using transformers

created 5 years ago

updated 1 year ago

Starred by

Travis Fischer(Founder of Agentic),

Amanpreet Singh(Cofounder of Contextual AI), and

5 more.

tch-rs by LaurentMazare

0.3%

Rust bindings for PyTorch C++ API (libtorch)

created 6 years ago

updated 1 day ago

Starred by

Travis Fischer(Founder of Agentic),

Lewis Tunstall(Researcher at Hugging Face), and

3 more.

rust-bert by guillaume-be

0.3%

Rust SDK for transformer-based NLP, porting Hugging Face models

created 5 years ago

updated 1 month ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Woosuk Kwon(Author of vLLM), and

9 more.

xla by pytorch

0.2%

PyTorch on XLA devices

created 6 years ago

updated 19 hours ago

Starred by

Jeff Hammerbacher(Cofounder of Cloudera),

Wes McKinney(Author of Pandas), and

10 more.

netron by lutzroeder

0.2%

31k

Model visualizer for neural networks, deep learning, and ML

created 14 years ago

updated 1 day ago

Starred by

Chenlin Meng(Cofounder of Pika),

Haotian Liu(Research Scientist at xAI; Author of LLaVA), and

1 more.

reformer-pytorch by lucidrains

0.1%

PyTorch implementation of the Reformer, an efficient Transformer research paper

created 5 years ago

updated 2 years ago

Starred by

Travis Fischer(Founder of Agentic),

Philipp Schmid(DevRel at Google DeepMind), and

9 more.

tokenizers by huggingface

0.2%

10k

Fast tokenizer library optimized for research and production

created 5 years ago

updated 4 days ago

Starred by

Lukas Biewald(Cofounder of Weights & Biases) and

Julien Chaumond(Cofounder of Hugging Face).

DialoGPT by microsoft

0.0%

Response generation model via large-scale pretraining

created 6 years ago

updated 2 years ago

Starred by

Aravind Srinivas(Cofounder of Perplexity),

Wes McKinney(Author of Pandas), and

9 more.

ludwig by ludwig-ai

0.0%

12k

Low-code framework for custom AI models (LLMs, neural networks)

created 6 years ago

updated 4 days ago

mit-deep-learning-book-pdf by janishar

0.1%

13k

PDF resource for deep learning fundamentals

created 8 years ago

updated 1 year ago

Feedback? Help us improve.