Patrick von Platen

Author of Hugging Face Diffusers; Research Engineer at Mistral

Starred Projects (186)

DeepGEMM by deepseek-ai

CUDA library for efficient FP8 GEMM kernels with fine-grained scaling

parano:

shyamal-anadkat:

hammer:

zhuohan123:

Created 7 months ago

Updated 6 days ago

jaxtyping by patrick-kidger

Typing library for array shapes/dtypes

geohot:

ekzhang:

lucidrains:

jiamings:

Created 3 years ago

Updated 4 months ago

axolotl by axolotl-ai-cloud

CLI tool for streamlined post-training of AI models

tobi:

zhyncs:

amiruci:

luiscape:

Created 2 years ago

Updated 13 hours ago

transformers by huggingface

ML library for pretrained model inference and training

clmnt:

lilianweng:

karpathy:

tjbck:

Created 6 years ago

Updated 12 hours ago

ktransformers by kvcache-ai

Framework for LLM inference optimization experimentation

luiscape:

JustinLin610:

shimmyshimmer:

zhyncs:

Created 1 year ago

Updated 2 days ago

redis by redis

Redis is a versatile data structure server, cache, and query engine

mikeyk:

nirga:

chiphuyen:

gakonst:

Created 16 years ago

Updated 3 days ago

LiveBench by LiveBench

LLM benchmark for evaluating models on recently released data

Created 1 year ago

Updated 2 days ago

ml-cross-entropy by apple

PyTorch module for memory-efficient cross-entropy in LLMs

hiyouga:

pgarbacki:

divchenko:

shimmyshimmer:

Created 10 months ago

Updated 23 hours ago

simple-evals by openai

Lightweight library for evaluating language models

simonw:

zhyncs:

philschmid:

Ying1123:

Created 1 year ago

Updated 1 month ago

DeepSeek-V3 by deepseek-ai

MoE language model research paper with 671B total parameters

tobi:

shimmyshimmer:

jiamings:

syrusakbary:

Created 8 months ago

Updated 3 weeks ago

awesome-o1 by srush

Bibliography for OpenAI's o1 project

binarybana:

tjbck:

JohannesHa:

shizhediao:

Created 11 months ago

Updated 10 months ago

avante.nvim by yetone

Neovim plugin emulating Cursor AI IDE for AI-driven code assistance

sxyu:

willccbb:

KyleAMathews:

jrk:

Created 1 year ago

Updated 14 hours ago

flux by black-forest-labs

Inference code for FLUX image generation & editing models

karpathy:

ekzhang:

omarsar:

ogabrielluiz:

Created 1 year ago

Updated 1 month ago

litellm by BerriAI

SDK/proxy for calling 100+ LLM APIs using the OpenAI format

tobi:

mxcl:

chiphuyen:

amin3141:

Created 2 years ago

Updated 15 hours ago

yet-another-applied-llm-benchmark by carlini

LLM benchmark for evaluating models on previously asked programming questions

karpathy:

ezyang:

simonw:

swyxio:

Created 1 year ago

Updated 4 months ago

torchtune by pytorch

PyTorch library for LLM post-training and experimentation

zhyncs:

lewtun:

JustinLin610:

shizhediao:

Created 1 year ago

Updated 1 day ago

mistral-finetune by mistralai

Lightweight codebase for memory-efficient Mistral model fine-tuning

tobi:

vincentweisser:

shyamal-anadkat:

osanseviero:

Created 1 year ago

Updated 1 year ago

LoRA by microsoft

PyTorch library for low-rank adaptation (LoRA) of LLMs

chiphuyen:

hammer:

zhiyuan8:

gakonst:

Created 4 years ago

Updated 9 months ago

ThunderKittens by HazyResearch

CUDA kernel framework for fast deep learning primitives

karpathy:

gakonst:

luiscape:

albertfgu:

Created 1 year ago

Updated 2 days ago

mistral-common by mistralai

Inference library for Mistral models preprocessing

tobi:

lysandrejik:

theophilegervet:

hammer:

Created 1 year ago

Updated 3 days ago

client-python by mistralai

Python SDK for Mistral AI platform

hammer:

Created 1 year ago

Updated 2 weeks ago

cookbook by mistralai

Cookbook with examples using Mistral models

hiyouga:

Created 1 year ago

Updated 6 days ago

copilot.lua by zbirenbaum

Neovim plugin enhancing GitHub Copilot

c4pt0r:

albertfgu:

gakonst:

sirupsen:

Created 3 years ago

Updated 1 day ago

LLM-Training-Puzzles by srush

Hands-on puzzles for large language model training

Jiayi-Pan:

albertfgu:

willccbb:

hiyouga:

Created 2 years ago

Updated 1 year ago

ml-engineering by stas00

Open book for LLM/VLM training engineers

tobi:

froystig:

jrk:

casper-hansen:

Created 5 years ago

Updated 22 hours ago

LLaVA by haotian-liu

Multimodal assistant with GPT-4 level capabilities

shizhediao:

zhiyuan8:

transitive-bullshit:

zhuohan123:

Created 2 years ago

Updated 1 year ago

mlx by ml-explore

Array framework for machine learning on Apple silicon

geohot:

karpathy:

jmorganca:

chiphuyen:

Created 1 year ago

Updated 2 days ago

mamba by state-spaces

Mamba SSM architecture for sequence modeling

geohot:

alexchen4ai:

luiscape:

zhiyuan8:

Created 1 year ago

Updated 2 weeks ago

gpt-fast by meta-pytorch

PyTorch text generation for efficient transformer inference

karpathy:

antiagainst:

jamesr66a:

merrymercy:

Created 1 year ago

Updated 3 weeks ago

insanely-fast-whisper by Vaibhavs10

Fast Whisper transcription CLI

doriandarko:

jrk:

tjbck:

luiscape:

Created 1 year ago

Updated 1 year ago

taesd by madebyollin

Tiny AutoEncoder for Stable Diffusion latents

tobi:

claforte:

jiamings:

ajayjain:

Created 2 years ago

Updated 5 months ago

consistencydecoder by openai

Improved decoding for stable diffusion VAEs

shyamal-anadkat:

gakonst:

simonw:

vincentweisser:

Created 1 year ago

Updated 1 year ago

SALMONN by bytedance

Multimodal LLM for speech, audio events, and music inputs

Created 2 years ago

Updated 3 weeks ago

distil-whisper by huggingface

Distilled speech recognition model, a faster Whisper variant

clmnt:

transitive-bullshit:

luiscape:

thomwolf:

Created 1 year ago

Updated 8 months ago

IP-Adapter by tencent-ailab

Adapter for image prompt in text-to-image diffusion models

vincentweisser:

jaretburkett:

osanseviero:

Created 2 years ago

Updated 1 year ago

PixArt-alpha by PixArt-alpha

Fast text-to-image synthesis with Diffusion Transformers

s9xie:

Created 1 year ago

Updated 10 months ago

stable-fast by chengzeyi

Inference optimization framework for HuggingFace Diffusers

philschmid:

luiscape:

youkaichao:

gakonst:

Created 1 year ago

Updated 5 months ago

SimpleTuner by bghira

Fine-tuning kit for diffusion models

chiphuyen:

rasbt:

osanseviero:

Created 2 years ago

Updated 18 hours ago

latent-consistency-model by luosiallen

LCM: Fast image synthesis via few-step inference

jiamings:

codekansas:

osanseviero:

Created 1 year ago

Updated 1 year ago

Hotshot-XL by hotshotco

Text-to-GIF model for Stable Diffusion XL

luiscape:

andreasjansson:

aakashs:

johnmullan:

Created 1 year ago

Updated 1 year ago

speculative-decoding by lucidrains

Speculative decoding explorations

luiscape:

vincentweisser:

borzunov:

Created 2 years ago

Updated 9 months ago

vllm by vllm-project

LLM serving engine for high-throughput, memory-efficient inference

karpathy:

clmnt:

tobi:

danielhanchen:

Created 2 years ago

Updated 13 hours ago

Pallaidium by tin2tin

Generative AI movie studio integrated into Blender

johnmullan:

Created 2 years ago

Updated 2 months ago

mistral-inference by mistralai

Inference library for Mistral models

vincentweisser:

parano:

transitive-bullshit:

JustinLin610:

Created 2 years ago

Updated 6 months ago

facechain by modelscope

AI toolchain for generating personalized digital-twin portraits

assafelovic:

JustinLin610:

osanseviero:

Created 2 years ago

Updated 3 months ago

candle by huggingface

Minimalist ML framework for Rust, emphasizing performance and ease of use

tobi:

binarybana:

alexchen4ai:

jn2clark:

Created 2 years ago

Updated 3 days ago

diffusers-rs by LaurentMazare

Rust implementation of the Diffusers API for generative models

gakonst:

luiscape:

LaurentMazare:

Created 2 years ago

Updated 1 year ago

trl by huggingface

Library for transformer RL

jeffchuber:

vincentweisser:

tjbck:

alexchen4ai:

Created 5 years ago

Updated 13 hours ago

distill-sd by segmind

Diffusion model distillation for smaller, faster Stable Diffusion

osanseviero:

ogabrielluiz:

Created 2 years ago

Updated 1 year ago

BK-SDM by Nota-NetsPresso

Compressed Stable Diffusion research paper for efficient text-to-image generation

Created 2 years ago

Updated 1 year ago

stable-diffusion by CompVis

Latent text-to-image diffusion model

gaearon:

codekansas:

ValentaTomas:

ankane:

Created 3 years ago

Updated 1 year ago

jax-triton by jax-ml

JAX integrations for OpenAI Triton

hammer:

gakonst:

ogabrielluiz:

mattjj:

Created 3 years ago

Updated 2 weeks ago

ComfyUI by comfyanonymous

Visual AI engine for diffusion models, API, and backend

dguido:

shimmyshimmer:

tjbck:

victortaelin:

Created 2 years ago

Updated 23 hours ago

kohya_ss by bmaltais

GUI for Stable Diffusion training scripts

mxcl:

ericjang:

Created 2 years ago

Updated 1 month ago

audio-ai-timeline by archinetai

AI model timeline for audio generation

osanseviero:

kmfreyberg:

omarsar:

Created 2 years ago

Updated 1 year ago

consistency_models by openai

PyTorch code for consistency models research paper

codekansas:

JustinLin610:

ablattmann:

Edward-Sun:

Created 2 years ago

Updated 1 year ago

OpenLLM by bentoml

SDK for running open-source LLMs as OpenAI-compatible APIs

parano:

JustinLin610:

chiphuyen:

alexey-milovidov:

Created 2 years ago

Updated 3 days ago

modular by modular

AI toolchain unifying fragmented AI deployment workflows

lattner:

tobi:

flaque:

AlexCheema:

Created 2 years ago

Updated 1 day ago

audiocraft by facebookresearch

PyTorch library for audio processing and generation research

hiyouga:

Jiayi-Pan:

jn2clark:

calvinfo:

Created 2 years ago

Updated 6 months ago

recognize-anything by xinyu1205

Image tagging models for common/open-set categories and comprehensive captioning

jn2clark:

Created 2 years ago

Updated 7 months ago

sd-webui-controlnet by Mikubill

WebUI extension for ControlNet, an image-generation plugin

transitive-bullshit:

pgarbacki:

jaretburkett:

zhiyuan8:

Created 2 years ago

Updated 1 year ago

stable-diffusion-webui by AUTOMATIC1111

Web UI for Stable Diffusion

clmnt:

k06a:

vincentweisser:

tjbck:

Created 3 years ago

Updated 1 day ago

Wuerstchen by dome272

Text-to-image research paper on efficient diffusion model pretraining

jiamings:

osanseviero:

Created 2 years ago

Updated 1 year ago

datacomp by mlfoundations

Competition tooling for multimodal dataset curation to pre-train CLIP models

shizhediao:

hammer:

chiphuyen:

osanseviero:

Created 2 years ago

Updated 4 months ago

StableStudio by Stability-AI

Open-source interface for generative AI

transitive-bullshit:

didierrlopes:

ogabrielluiz:

osanseviero:

Created 2 years ago

Updated 1 year ago

stable-dreamfusion by ashawkey

Text-to-3D model using NeRF and diffusion

hiyouga:

chiphuyen:

forresti:

torantulino:

Created 2 years ago

Updated 1 year ago

sdnext by vladmandic

WebUI for AI generative image and video creation

osanseviero:

abidlabs:

Created 2 years ago

Updated 1 day ago

diffusers by huggingface

PyTorch/Flax library for diffusion model research and applications

karpathy:

clmnt:

vincentweisser:

hammer:

Created 3 years ago

Updated 12 hours ago

Grounded-Segment-Anything by IDEA-Research

Framework for open-world visual tasks, combining multiple models

ishaan-jaff:

jiamings:

codekansas:

transitive-bullshit:

Created 2 years ago

Updated 1 year ago

llm-foundry by mosaicml

LLM training code for Databricks foundation models

hiyouga:

vincentweisser:

hammer:

Sanger2000:

Created 2 years ago

Updated 2 weeks ago

ControlNet-v1-1-nightly by lllyasviel

ControlNet 1.1 is a research project for neural network control of diffusion models

didierrlopes:

Created 2 years ago

Updated 1 year ago

langchain by langchain-ai

Framework for building LLM-powered applications

karpathy:

MagMueller:

gregpr07:

willingc:

Created 2 years ago

Updated 1 day ago

streaming by mosaicml

Data streaming library for efficient neural network training

youkaichao:

hiyouga:

jn2clark:

johnmullan:

Created 3 years ago

Updated 1 week ago

IF by deep-floyd

Text-to-image model for photorealistic synthesis and language understanding

chiphuyen:

parano:

pgarbacki:

jaretburkett:

Created 2 years ago

Updated 1 year ago

diffusion by mosaicml

Diffusion model training code

hanlint:

jfrankle:

Created 2 years ago

Updated 8 months ago

flash-attention by Dao-AILab

Fast, memory-efficient attention implementation

karpathy:

Jiayi-Pan:

zhiyuan8:

alexchen4ai:

Created 3 years ago

Updated 1 day ago

stablediffusion by Stability-AI

Latent diffusion model for high-resolution image synthesis

robinjhuang:

chiphuyen:

vincentweisser:

ogabrielluiz:

Created 2 years ago

Updated 2 months ago

whisper-jax by sanchit-gandhi

JAX implementation of OpenAI's Whisper model for fast TPU inference

tobi:

mattjj:

parano:

osanseviero:

Created 2 years ago

Updated 1 year ago

text-generation-inference by huggingface

Rust/Python/gRPC server for fast LLM text generation

tobi:

clmnt:

tjbck:

chiphuyen:

Created 2 years ago

Updated 1 day ago

bark by suno-ai

Generative audio model for realistic speech and sound effects

tobi:

pgarbacki:

chiphuyen:

tjbck:

Created 2 years ago

Updated 1 year ago

gen-efficientnet-pytorch by rwightman

PyTorch image models for efficient architectures

Created 6 years ago

Updated 1 year ago

EditAnything by sail-sg

Image editing research paper using segmentation and diffusion

pgarbacki:

omarsar:

ogabrielluiz:

osanseviero:

Created 2 years ago

Updated 6 months ago

Kandinsky-2 by ai-forever

Multilingual text-to-image latent diffusion model

rromb:

osanseviero:

jiamings:

Created 2 years ago

Updated 1 year ago

tomesd by dbolya

Speed-up tool for Stable Diffusion

jiamings:

Created 2 years ago

Updated 1 year ago

gpt4all by nomic-ai

Desktop app for local LLM inference, no GPU/API needed

willingc:

zhiyuan8:

osanseviero:

antirez:

Created 2 years ago

Updated 3 months ago

DiT by facebookresearch

PyTorch implementation for diffusion models with transformers (DiT)

shizhediao:

Edward-Sun:

aangelopoulos:

JustinLin610:

Created 2 years ago

Updated 1 year ago

AudioLDM by haoheliu

Audio generation research paper using latent diffusion

osanseviero:

Created 2 years ago

Updated 2 months ago

peft by huggingface

Parameter-efficient fine-tuning (PEFT) library

tobi:

gakonst:

chiphuyen:

Ying1123:

Created 2 years ago

Updated 2 days ago

setfit by huggingface

Few-shot learning framework for Sentence Transformers

clmnt:

luiscape:

transitive-bullshit:

jph00:

Created 3 years ago

Updated 1 month ago

T2I-Adapter by TencentARC

T2I-Adapter for controllable text-to-image diffusion models (SD-XL)

sxyu:

chenlin9:

osanseviero:

lllyasviel:

Created 2 years ago

Updated 1 year ago

ControlNet by lllyasviel

Neural network structure for adding conditional control to diffusion models

vincentweisser:

codekansas:

louisgv:

ogabrielluiz:

Created 2 years ago

Updated 1 year ago

llama by meta-llama

Inference code for Llama 2 models (deprecated)

froystig:

xiezhq-hermann:

fabhed:

borzunov:

Created 2 years ago

Updated 7 months ago

FlexLLMGen by FMInference

High-throughput generation engine for LLMs with limited GPU memory

chiphuyen:

jrk:

jph00:

parano:

Created 2 years ago

Updated 10 months ago

mixture-of-diffusers by albarji

Image generation method for scene composition using multiple diffusion processes

osanseviero:

Created 3 years ago

Updated 2 years ago

InvokeAI by invoke-ai

Creative engine for visual media generation using Stable Diffusion models

ogabrielluiz:

assafelovic:

jiamings:

chiphuyen:

Created 3 years ago

Updated 13 hours ago

Tune-A-Video by showlab

Text-to-video generation via diffusion model fine-tuning

chenlin9:

yoland68:

osanseviero:

Created 2 years ago

Updated 1 year ago

imaginAIry by brycedrennan

Pythonic AI image/video generation tool using Stable Diffusion

luiscape:

paul-gauthier:

alexanderatallah:

didierrlopes:

Created 3 years ago

Updated 1 year ago

instruct-pix2pix by timothybrooks

Image editing model for instruction-based image manipulation

borzunov:

parano:

huybery:

bfirsh:

Created 2 years ago

Updated 1 year ago

whisper.cpp by ggml-org

C/C++ port for high-performance Whisper ASR inference

tobi:

mckaywrigley:

codekansas:

vincentweisser:

Created 3 years ago

Updated 1 week ago

tensorflow by tensorflow

Open-source ML framework

norvig:

aravindsrinivas:

karpathy:

bcherny:

Created 10 years ago

Updated 12 hours ago

whisperX by m-bain

ASR tool for accurate, batched, word-level Whisper transcriptions

gakonst:

paul-gauthier:

nicolaerusan:

KyleAMathews:

Created 2 years ago

Updated 2 months ago

speechbox by huggingface

Speech processing tools (punctuation, diarization)

clmnt:

philschmid:

osanseviero:

lewtun:

Created 2 years ago

Updated 1 year ago

stablediffusion-infinity by lkwq007

Web app for Stable Diffusion outpainting on infinite canvas

chuanli11:

Edward-Sun:

jaretburkett:

Created 3 years ago

Updated 2 years ago

riffusion-hobby by riffusion

Library for real-time music/audio generation using stable diffusion

codekansas:

tuhins:

aangelopoulos:

osanseviero:

Created 2 years ago

Updated 1 year ago

dream-textures by carson-katri

Blender add-on for Stable Diffusion integration

chenlin9:

simonw:

thomwolf:

rromb:

Created 3 years ago

Updated 1 year ago

lora by cloneofsimo

LoRA tool for fast diffusion fine-tuning

vincentweisser:

jn2clark:

swyxio:

eugeneyan:

Created 2 years ago

Updated 1 year ago

CLIP_benchmark by LAION-AI

CLI tool for CLIP-like model evaluation across diverse tasks/datasets

jn2clark:

rwightman:

Created 3 years ago

Updated 1 month ago

encodec by facebookresearch

Neural audio codec for high-fidelity compression research

theophilegervet:

Jiayi-Pan:

osanseviero:

aangelopoulos:

Created 2 years ago

Updated 1 year ago

RePaint by andreas128

Image inpainting via denoising diffusion probabilistic models

jph00:

Created 3 years ago

Updated 3 years ago

cycle-diffusion by ChenWu98

PyTorch code for diffusion model latent space research paper

Edward-Sun:

huybery:

Created 2 years ago

Updated 1 year ago

fast-stable-diffusion by TheLastBen

Colab notebooks for fast Stable Diffusion + DreamBooth

ckathleen:

transitive-bullshit:

parasj:

osanseviero:

Created 3 years ago

Updated 3 weeks ago

paint-with-words-sd by cloneofsimo

Stable Diffusion for text-guided image generation from segmentation maps

andreasjansson:

claforte:

Created 2 years ago

Updated 2 years ago

dpm-solver by LuChengTHU

Fast ODE solver for diffusion probabilistic model sampling

Edward-Sun:

Ying1123:

merrymercy:

PiotrDabkowski:

Created 3 years ago

Updated 1 year ago

IOPaint by Sanster

Image editing tool for inpainting and outpainting tasks

ogabrielluiz:

sxyu:

Created 3 years ago

Updated 4 months ago

prompt-to-prompt by google

Image editing via prompt manipulation, based on attention control

chenlin9:

omarsar:

huybery:

yoland68:

Created 3 years ago

Updated 1 year ago

stable-diffusion-videos by nateraw

Video generator for Stable Diffusion latent space exploration

chenlin9:

ogabrielluiz:

lewtun:

omarsar:

Created 3 years ago

Updated 1 year ago

aim by aimhubio

Experiment tracker for AI model training runs

amin3141:

patrick-kidger:

transitive-bullshit:

yang-song:

Created 6 years ago

Updated 1 day ago

g-diffuser-bot by parlance-zz

Discord bot for Stable Diffusion

Created 3 years ago

Updated 2 years ago

whisper by openai

Speech recognition model for multilingual transcription/translation

bcherny:

karpathy:

ogabrielluiz:

zhyncs:

Created 3 years ago

Updated 1 week ago

diffrax by patrick-kidger

JAX library for numerical differential equation solvers

froystig:

lucidrains:

patrick-kidger:

Created 4 years ago

Updated 6 days ago

k-diffusion by crowsonkb

PyTorch implementation of Karras et al. (2022) diffusion models

jiamings:

parano:

luiscape:

wongmjane:

Created 3 years ago

Updated 8 months ago

latent-diffusion by CompVis

Image synthesis research paper using latent diffusion models

aravindsrinivas:

codekansas:

jaretburkett:

jinze1994:

Created 3 years ago

Updated 1 year ago

taming-transformers by CompVis

Image synthesis research paper using transformers

karpathy:

Jiayi-Pan:

codekansas:

stellaathena:

Created 4 years ago

Updated 1 year ago

DiffSinger by MoonInTheRiver

PyTorch code for singing voice synthesis (SVS) and TTS research

Created 3 years ago

Updated 6 months ago

tacotron2 by NVIDIA

PyTorch implementation for text-to-speech synthesis

aravindsrinivas:

lantiga:

jongwook:

soumith:

Created 7 years ago

Updated 1 year ago

Squeezeformer by kssteven418

Speech recognition model based on an efficient Transformer architecture

Created 3 years ago

Updated 2 years ago

disco-diffusion by alembics

AI art and animation notebook

chenlin9:

taranjeet:

Jiayi-Pan:

soumith:

Created 3 years ago

Updated 2 years ago

clip-guided-diffusion by afiaka87

CLI tool for text-to-image generation using CLIP-guided diffusion

chenlin9:

luiscape:

bfirsh:

Created 4 years ago

Updated 3 years ago

v-diffusion-pytorch by crowsonkb

PyTorch code for v-objective diffusion model inference

jph00:

chenlin9:

luiscape:

lucidrains:

Created 3 years ago

Updated 2 years ago

WaveGrad by ivanvovk

PyTorch implementation of Google Brain's WaveGrad vocoder

ajayjain:

Created 5 years ago

Updated 4 years ago

glide-text2im by openai

Text-conditional image synthesis model from research paper

ShengjiaZhao:

Edward-Sun:

Jiayi-Pan:

JustinLin610:

Created 3 years ago

Updated 1 year ago

guided-diffusion by openai

Image synthesis codebase for diffusion models

aravindsrinivas:

JustinLin610:

rromb:

shizhediao:

Created 4 years ago

Updated 1 year ago

blended-diffusion by omriav

Image editing technique (research paper)

Created 3 years ago

Updated 1 year ago

improved-diffusion by openai

Image diffusion codebase for research

aravindsrinivas:

jph00:

Created 4 years ago

Updated 1 year ago

FastDiff by Rongjiehuang

PyTorch implementation for fast, high-fidelity speech synthesis via conditional diffusion

Created 3 years ago

Updated 1 year ago

Awesome-Diffusion-Models by diff-usion

Diffusion models resource collection

omarsar:

taranjeet:

osanseviero:

eugeneyan:

Created 4 years ago

Updated 1 year ago

Transformers-Tutorials by NielsRogge

Transformer demos using Hugging Face, implemented in PyTorch

ogabrielluiz:

lantiga:

omarsar:

hammer:

Created 5 years ago

Updated 2 months ago

TTS by coqui-ai

Deep learning toolkit for Text-to-Speech, research-tested

hugs:

shimmyshimmer:

chiphuyen:

abidlabs:

Created 5 years ago

Updated 1 year ago

tortoise-tts by neonbjb

Multi-voice TTS system emphasizing quality, realistic prosody

codekansas:

transitive-bullshit:

vincentweisser:

swyxio:

Created 3 years ago

Updated 10 months ago

wav2vec2-live by oliverguhr

Live speech recognition demo using wav2vec 2.0

generall:

Created 4 years ago

Updated 1 year ago

GigaSpeech by SpeechColab

Large dataset for speech recognition research

Created 4 years ago

Updated 1 year ago

espnet by espnet

End-to-end speech processing toolkit for various speech tasks

codekansas:

lysandrejik:

soumith:

trishume:

Created 7 years ago

Updated 3 days ago

tqdm by tqdm

Progress bar for Python and CLI tools

bcherny:

geohot:

hugs:

parano:

Created 10 years ago

Updated 3 months ago

huggingsound by jonatasgrosman

Speech toolkit for speech-related tasks based on Hugging Face's tools

osanseviero:

Created 3 years ago

Updated 2 years ago

ctc-segmentation by lumaku

Python package for audio segmentation and utterance alignment

Created 5 years ago

Updated 1 year ago

av_hubert by facebookresearch

Self-supervised learning framework for audio-visual speech research

Created 3 years ago

Updated 1 year ago

haystack by deepset-ai

AI orchestration framework for LLM application development

tobi:

rodrigosnader:

maxdeichmann:

atroyn:

Created 5 years ago

Updated 12 hours ago

icefall by k2-fsa

Speech-related recipes for various datasets using k2-fsa and lhotse

Created 4 years ago

Updated 1 week ago

Gramformer by PrithivirajDamodaran

Grammar correction framework for NLP text

luiscape:

Created 4 years ago

Updated 2 years ago

voice_datasets by jim-schwoebel

Voice dataset list for voice/sound computing

PiotrDabkowski:

osanseviero:

Created 6 years ago

Updated 1 year ago

UniSpeech by microsoft

Speech models for self-supervised learning

Created 4 years ago

Updated 1 year ago

muzic by microsoft

AI research project for music understanding and generation

luiscape:

osanseviero:

ogabrielluiz:

Created 4 years ago

Updated 11 months ago

mistral by stanford-crfm

Framework for large language model training

clmnt:

osanseviero:

infwinston:

parasj:

Created 4 years ago

Updated 1 year ago

optimum by huggingface

Hardware optimization tools for Transformers, Diffusers, etc

clmnt:

PiotrDabkowski:

ankane:

soldni:

Created 4 years ago

Updated 3 days ago

pyannote-audio by pyannote

Speaker diarization toolkit

luiscape:

transitive-bullshit:

julien-c:

iamtimdavis:

Created 9 years ago

Updated 1 day ago

DeepSpeed by deepspeedai

Deep learning optimization library for distributed training and inference

aravindsrinivas:

ValentaTomas:

winglian:

stas00:

Created 5 years ago

Updated 1 day ago

parallelformers by tunib-ai

Toolkit for easy model parallelization

soldni:

Edward-Sun:

parasj:

julien-c:

Created 4 years ago

Updated 2 years ago

dalle-mini by borisdayma

Text-to-image model for generating images from text prompts

karpathy:

hardmaru:

infwinston:

codekansas:

Created 4 years ago

Updated 1 year ago

pyctcdecode by kensho-technologies

CTC beam search decoder for speech recognition

osanseviero:

kmfreyberg:

gkucsko:

Created 4 years ago

Updated 2 years ago

NeMo by NVIDIA-NeMo

Scalable generative AI framework for LLMs, multimodal, and speech AI research

alexchen4ai:

Ying1123:

shizhediao:

robinjhuang:

Created 6 years ago

Updated 13 hours ago

pytorch-image-models by huggingface

PyTorch image model collection with training, eval, and inference scripts

clmnt:

karpathy:

osanseviero:

Jiayi-Pan:

Created 6 years ago

Updated 1 day ago

fastformers by microsoft

NLU optimization recipes for transformer models

lewtun:

shizhediao:

luiscape:

forresti:

Created 5 years ago

Updated 6 months ago

s3prl by s3prl

Speech representation learning toolkit

codekansas:

hammer:

aangelopoulos:

JustinLin610:

Created 6 years ago

Updated 3 months ago

fairseq by facebookresearch

Sequence modeling toolkit for translation, language modeling, and text generation research

lilianweng:

aravindsrinivas:

tjbck:

pathak22:

Created 8 years ago

Updated 1 week ago

awesome-jax by n2cholas

Curated list of JAX resources for high-performance ML research

aravindsrinivas:

hammer:

dynamicwebpaige:

mattjj:

Created 4 years ago

Updated 2 weeks ago

sentence-transformers by UKPLab

Framework for text embeddings, retrieval, and reranking

chiphuyen:

luiscape:

didierrlopes:

pgarbacki:

Created 6 years ago

Updated 3 days ago

accelerate by huggingface

PyTorch training helper for distributed execution

clmnt:

chiphuyen:

eugeneyan:

pgarbacki:

Created 4 years ago

Updated 1 day ago

mesh-transformer-jax by kingoflolz

JAX library for model-parallel transformers

gakonst:

parano:

nirga:

vincentweisser:

Created 4 years ago

Updated 2 years ago

gpt-neo by EleutherAI

GPT-2/3-style model implementation using mesh-tensorflow

ebursztein:

okhat:

stellaathena:

JohannesHa:

Created 5 years ago

Updated 3 years ago

speechbrain by speechbrain

PyTorch toolkit for speech and text processing research

soumith:

transitive-bullshit:

spahl:

soldni:

Created 5 years ago

Updated 1 month ago

autotrain-advanced by huggingface

No-code tool for training/finetuning models across modalities/tasks

tobi:

abhishekkrthakur:

jeresig:

bryanhelmig:

Created 4 years ago

Updated 8 months ago

CLIP by openai

Image-text matching model for zero-shot prediction

aravindsrinivas:

transitive-bullshit:

Edward-Sun:

mholt:

Created 4 years ago

Updated 1 year ago

flax by google

NN library for JAX, designed for flexibility in neural network research

charliermarsh:

codekansas:

Jiayi-Pan:

jaredpalmer:

Created 5 years ago

Updated 17 hours ago

question_generation by patil-suraj

Question generation study using transformers

Edward-Sun:

tholor:

rodrigosnader:

ankane:

Created 5 years ago

Updated 1 year ago

tch-rs by LaurentMazare

Rust bindings for PyTorch C++ API (libtorch)

sxyu:

transitive-bullshit:

parano:

apsdehal:

Created 6 years ago

Updated 1 month ago

rust-bert by guillaume-be

Rust SDK for transformer-based NLP, porting Hugging Face models

clmnt:

hurshagrawal:

transitive-bullshit:

lewtun:

Created 5 years ago

Updated 3 months ago

xla by pytorch

PyTorch on XLA devices

aravindsrinivas:

WoosukKwon:

Jiayi-Pan:

comaniac:

Created 6 years ago

Updated 1 day ago

datasets by huggingface

Access and process large AI datasets efficiently

clmnt:

chiphuyen:

transitive-bullshit:

gakonst:

Created 5 years ago

Updated 1 day ago

netron by lutzroeder

Model visualizer for neural networks, deep learning, and ML

casper-hansen:

hammer:

guberti:

soldni:

Created 14 years ago

Updated 1 day ago

reformer-pytorch by lucidrains

PyTorch implementation of the Reformer, an efficient Transformer research paper

chenlin9:

haotian-liu:

shizhediao:

thomwolf:

Created 5 years ago

Updated 2 years ago

tokenizers by huggingface

Fast tokenizer library optimized for research and production

clmnt:

syrusakbary:

transitive-bullshit:

JohannesHa:

Created 5 years ago

Updated 2 days ago

DialoGPT by microsoft

Response generation model via large-scale pretraining

lukas:

julien-c:

agermanidis:

Created 6 years ago

Updated 2 years ago

SincNet by mravanelli

Neural audio processing with SincNet

Created 7 years ago

Updated 4 years ago

ludwig by ludwig-ai

Low-code framework for custom AI models (LLMs, neural networks)

aravindsrinivas:

winglian:

w4nderlust:

wesm:

Created 6 years ago

Updated 1 week ago

kaldi by kaldi-asr

Speech recognition toolkit for Linux, macOS, Cygwin, and Windows

bcherny:

trishume:

omarsar:

andreasjansson:

Created 10 years ago

Updated 1 month ago

mit-deep-learning-book-pdf by janishar

PDF resource for deep learning fundamentals

vincentweisser:

gravicle:

claforte:

Created 8 years ago

Updated 1 year ago

Feedback? Help us improve.