Chenlin Meng

Cofounder of Pika

Starred Projects (100)

PhotoMaker by TencentARC

Photo customization research paper using stacked ID embedding

osanseviero:

wsxiaoys:

jiamings:

jaretburkett:

Created 1 year ago

Updated 1 year ago

TTS by coqui-ai

Deep learning toolkit for Text-to-Speech, research-tested

hugs:

shimmyshimmer:

chiphuyen:

abidlabs:

Created 5 years ago

Updated 1 year ago

generative-models by Stability-AI

Generative models SDK for video, image, and 3D synthesis research

hugs:

luiscape:

pgarbacki:

osanseviero:

Created 2 years ago

Updated 19 hours ago

prompt-to-prompt by google

Image editing via prompt manipulation, based on attention control

omarsar:

huybery:

yoland68:

patrickvonplaten:

Created 3 years ago

Updated 1 year ago

Video-LLaMA by DAMO-NLP-SG

Multimodal model for video understanding research

parasj:

jn2clark:

omarsar:

Created 2 years ago

Updated 1 year ago

clip-retrieval by rom1504

CLIP retrieval system for semantic search

jeresig:

yoland68:

simonw:

jn2clark:

Created 4 years ago

Updated 2 months ago

T2I-Adapter by TencentARC

T2I-Adapter for controllable text-to-image diffusion models (SD-XL)

sxyu:

osanseviero:

patrickvonplaten:

lllyasviel:

Created 2 years ago

Updated 1 year ago

so-vits-svc by svc-develop-team

Singing voice conversion using SoftVC VITS

zjasper666:

dsa:

JohannesHa:

aangelopoulos:

Created 2 years ago

Updated 2 years ago

MultiDiffusion by omerbt

Framework for controllable image generation using pre-trained diffusion models

Created 2 years ago

Updated 2 years ago

sd-webui-text2video by kabachuha

Stable Diffusion WebUI extension for text-to-video generation

Created 2 years ago

Updated 1 year ago

Text-To-Video-Finetuning by ExponentialML

Finetuning script for text-to-video models

osanseviero:

ajayjain:

Created 2 years ago

Updated 1 year ago

Tune-A-Video by showlab

Text-to-video generation via diffusion model fine-tuning

yoland68:

patrickvonplaten:

osanseviero:

Created 2 years ago

Updated 2 years ago

Text2Video-Zero by Picsart-AI-Research

Zero-shot video generator using text-to-image diffusion models

transitive-bullshit:

osanseviero:

ajayjain:

Created 2 years ago

Updated 2 years ago

stablediffusion by Stability-AI

Latent diffusion model for high-resolution image synthesis

robinjhuang:

chiphuyen:

vincentweisser:

ogabrielluiz:

Created 2 years ago

Updated 4 months ago

Multilingual_Text_to_Speech by Tomiinek

Tacotron 2 implementation for multilingual speech synthesis research

codekansas:

Created 6 years ago

Updated 2 years ago

webdataset by webdataset

High-performance I/O system for large deep learning problems, strong PyTorch support

soldni:

chiphuyen:

hammer:

theophilegervet:

Created 6 years ago

Updated 4 months ago

x-transformers by lucidrains

Transformer library with extensive experimental features

chiphuyen:

hammer:

Jiayi-Pan:

WoosukKwon:

Created 5 years ago

Updated 2 days ago

Multilingual-CLIP by FreddeFrallan

Multilingual text encoders leveraging OpenAI's CLIP model

jn2clark:

andreasjansson:

Created 4 years ago

Updated 2 years ago

open_clip by mlfoundations

OpenCLIP: open-source CLIP implementation for vision-language representation learning

ekzhang:

jeresig:

c4pt0r:

taranjeet:

Created 4 years ago

Updated 21 hours ago

disco-diffusion by alembics

AI art and animation notebook

taranjeet:

patrickvonplaten:

Jiayi-Pan:

soumith:

Created 3 years ago

Updated 2 years ago

dream-textures by carson-katri

Blender add-on for Stable Diffusion integration

simonw:

thomwolf:

rromb:

patrickvonplaten:

Created 3 years ago

Updated 1 year ago

hifi-gan by jik876

GAN for high-fidelity speech synthesis

andreasjansson:

Created 5 years ago

Updated 1 year ago

stable-diffusion-videos by nateraw

Video generator for Stable Diffusion latent space exploration

patrickvonplaten:

ogabrielluiz:

lewtun:

omarsar:

Created 3 years ago

Updated 1 year ago

stanford_alpaca by tatsu-lab

Instruction-following LLaMA model training and data generation

karpathy:

john-b-yang:

pgarbacki:

osanseviero:

Created 2 years ago

Updated 1 year ago

docarray by docarray

Python library for multimodal data representation, transmission, storage, and retrieval

JohannesHa:

azayarni:

hammer:

simonw:

Created 3 years ago

Updated 4 months ago

serve by jina-ai

Framework for building cloud-native multimodal AI apps

yiranwu0:

assafelovic:

winglian:

ValentaTomas:

Created 5 years ago

Updated 7 months ago

tortoise-tts by neonbjb

Multi-voice TTS system emphasizing quality, realistic prosody

codekansas:

transitive-bullshit:

vincentweisser:

swyxio:

Created 3 years ago

Updated 11 months ago

lora by cloneofsimo

LoRA tool for fast diffusion fine-tuning

vincentweisser:

jn2clark:

swyxio:

eugeneyan:

Created 2 years ago

Updated 1 year ago

langchain by langchain-ai

Framework for building LLM-powered applications

karpathy:

MagMueller:

gregpr07:

willingc:

Created 3 years ago

Updated 12 hours ago

video-diffusion-pytorch by lucidrains

PyTorch implementation of video diffusion models

Created 3 years ago

Updated 1 year ago

point-e by openai

Diffusion model for 3D point cloud generation from prompts

Edward-Sun:

forresti:

kerollmops:

ablattmann:

Created 2 years ago

Updated 1 year ago

trlx by CarperAI

Distributed RLHF for LLMs

nat:

chiphuyen:

eugeneyan:

huybery:

Created 3 years ago

Updated 1 year ago

trl by huggingface

Library for transformer RL

jeffchuber:

vincentweisser:

tjbck:

alexchen4ai:

Created 5 years ago

Updated 20 hours ago

lm-human-preferences by openai

Code for fine-tuning language models using human preferences

aravindsrinivas:

eugeneyan:

Edward-Sun:

shizhediao:

Created 6 years ago

Updated 2 years ago

ControlNet by lllyasviel

Neural network structure for adding conditional control to diffusion models

vincentweisser:

codekansas:

louisgv:

ogabrielluiz:

Created 2 years ago

Updated 1 year ago

ddib by suxuann

Image-to-image translation using diffusion models without paired data

Created 3 years ago

Updated 2 years ago

llama_index by run-llama

Data framework for building LLM-powered agents

karpathy:

atroyn:

zhuohan123:

JustinLin610:

Created 3 years ago

Updated 20 hours ago

LLFF by Fyusion

TensorFlow code for novel view synthesis from sparse images (SIGGRAPH 2019 paper)

gravicle:

trishume:

snavely:

Created 6 years ago

Updated 2 years ago

whisper by openai

Speech recognition model for multilingual transcription/translation

bcherny:

karpathy:

ogabrielluiz:

zhyncs:

Created 3 years ago

Updated 1 month ago

riffusion-hobby by riffusion

Library for real-time music/audio generation using stable diffusion

codekansas:

tuhins:

aangelopoulos:

osanseviero:

Created 2 years ago

Updated 1 year ago

riffusion-app-hobby by riffusion

Web app for real-time music generation using stable diffusion

gaearon:

codekansas:

yoland68:

swyxio:

Created 2 years ago

Updated 1 year ago

MineDojo by MineDojo

AI research framework for embodied agents in Minecraft

infwinston:

huybery:

ageron:

Created 3 years ago

Updated 1 year ago

SLIP by facebookresearch

Research paper code for self-supervised language-image pre-training

rwightman:

s9xie:

Created 3 years ago

Updated 2 years ago

v-diffusion-pytorch by crowsonkb

PyTorch code for v-objective diffusion model inference

jph00:

patrickvonplaten:

luiscape:

lucidrains:

Created 3 years ago

Updated 2 years ago

diffusers by huggingface

PyTorch/Flax library for diffusion model research and applications

karpathy:

clmnt:

vincentweisser:

hammer:

Created 3 years ago

Updated 9 hours ago

k-diffusion by crowsonkb

PyTorch implementation of Karras et al. (2022) diffusion models

jiamings:

parano:

luiscape:

wongmjane:

Created 3 years ago

Updated 10 months ago

diffwave by lmnt-com

Neural vocoder and waveform synthesizer

osanseviero:

Created 5 years ago

Updated 1 year ago

ast by YuanGongND

Purely attention-based audio spectrogram classification

Created 4 years ago

Updated 2 years ago

image-gpt by teddykoker

PyTorch implementation of Image GPT research paper

shizhediao:

luiscape:

Created 5 years ago

Updated 2 years ago

clip-guided-diffusion by afiaka87

CLI tool for text-to-image generation using CLIP-guided diffusion

patrickvonplaten:

luiscape:

bfirsh:

Created 4 years ago

Updated 3 years ago

DiffusionCLIP by gwang-kim

Diffusion model for text-guided image manipulation

Created 4 years ago

Updated 2 years ago

awesome-offline-rl by hanjuku-kaso

Offline RL algorithms index (research papers, reviews, benchmarks, applications)

eugeneyan:

Created 4 years ago

Updated 1 year ago

Awesome-Diffusion-Models by diff-usion

Diffusion models resource collection

omarsar:

taranjeet:

osanseviero:

eugeneyan:

Created 4 years ago

Updated 1 year ago

ddrm by bahjat-kawar

Research paper for diffusion-based image restoration

jiamings:

Created 3 years ago

Updated 3 years ago

intro_dgm by jmtomczak

Introductory examples for deep generative models research paper

ablattmann:

rromb:

Created 4 years ago

Updated 2 months ago

ru-dolph by ai-forever

Hyper-tasking transformer for text-to-image, image classification, and VQA

Created 3 years ago

Updated 2 years ago

awesome-multimodal-ml by pliang279

Curated reading list for multimodal ML research

aravindsrinivas:

john-b-yang:

huybery:

jwyang:

Created 6 years ago

Updated 1 year ago

latent-diffusion by CompVis

Image synthesis research paper using latent diffusion models

aravindsrinivas:

codekansas:

jaretburkett:

jinze1994:

Created 3 years ago

Updated 1 year ago

mindall-e by kakaobrain

PyTorch for text-to-image generation research

JohannesHa:

rromb:

borzunov:

Created 3 years ago

Updated 3 years ago

trajectory-transformer by jannerm

Offline RL research paper code release

Created 4 years ago

Updated 3 years ago

VideoGPT by wilson1yan

Video generation research paper using VQ-VAE and Transformers

aravindsrinivas:

Created 4 years ago

Updated 1 year ago

vdvae by openai

Research paper implementation for very deep VAE models

aravindsrinivas:

jn2clark:

CodeCreator:

Created 5 years ago

Updated 2 years ago

Best_AI_paper_2020 by louisfb01

AI paper list with video explanations and code from 2020

bfirsh:

omarsar:

Created 4 years ago

Updated 3 years ago

decision-transformer by kzl

RL via sequence modeling research paper

aravindsrinivas:

hammer:

jiamings:

rwightman:

Created 4 years ago

Updated 1 year ago

awesome-normalizing-flows by janosh

Awesome list of normalizing flow resources

Created 5 years ago

Updated 4 months ago

TediGAN by IIGROUP

PyTorch code for text-guided face image generation/manipulation

bfirsh:

jiamings:

Created 4 years ago

Updated 2 years ago

StyleCLIP by orpatashnik

Text-driven StyleGAN imagery manipulation via CLIP models

luiscape:

borzunov:

bfirsh:

jn2clark:

Created 4 years ago

Updated 2 years ago

GAN-Inversion by weihaox

GAN inversion resource for TPAMI 2022 survey paper

jiamings:

Created 4 years ago

Updated 9 months ago

guided-diffusion by openai

Image synthesis codebase for diffusion models

aravindsrinivas:

JustinLin610:

rromb:

patrickvonplaten:

Created 4 years ago

Updated 1 year ago

ICLR2021-OpenReviewData by evanzd

ICLR paper analysis tool for visualizing review data

Created 5 years ago

Updated 3 years ago

ICLR2020-OpenReviewData by shaohua0116

Data crawler for ICLR OpenReview webpages

hiyouga:

Created 6 years ago

Updated 5 years ago

GPT-GNN by acbull

Graph pre-training framework for initializing GNNs

parasj:

Created 5 years ago

Updated 1 year ago

sparse_attention by openai

Sparse attention primitives for research

aravindsrinivas:

shizhediao:

nottombrown:

agermanidis:

Created 6 years ago

Updated 5 years ago

reformer-pytorch by lucidrains

PyTorch implementation of the Reformer, an efficient Transformer research paper

haotian-liu:

shizhediao:

thomwolf:

patrickvonplaten:

Created 5 years ago

Updated 2 years ago

vit-pytorch by lucidrains

PyTorch library for Vision Transformer variants and related techniques

karpathy:

lucidrains:

chiphuyen:

forresti:

Created 5 years ago

Updated 6 days ago

basic_reinforcement_learning by vmayoral

Introductory tutorial series for reinforcement learning techniques

vincentweisser:

lantiga:

Created 9 years ago

Updated 2 years ago

DALLE-pytorch by lucidrains

PyTorch implementation of DALL-E, OpenAI's text-to-image transformer

omarsar:

luiscape:

bfirsh:

codekansas:

Created 4 years ago

Updated 1 year ago

minGPT by karpathy

Minimal PyTorch re-implementation for GPT training and inference

aravindsrinivas:

nat:

geohot:

lilianweng:

Created 5 years ago

Updated 1 year ago

DALL-E by openai

PyTorch package for DALL-E's discrete VAE

aravindsrinivas:

borzunov:

andreasjansson:

omarsar:

Created 4 years ago

Updated 1 year ago

BIG-bench by google

Collaborative benchmark for probing and extrapolating LLM capabilities

ShengjiaZhao:

chiphuyen:

hiyouga:

nirga:

Created 4 years ago

Updated 1 year ago

taming-transformers by CompVis

Image synthesis research paper using transformers

karpathy:

Jiayi-Pan:

codekansas:

stellaathena:

Created 4 years ago

Updated 1 year ago

CLIP by openai

Image-text matching model for zero-shot prediction

aravindsrinivas:

transitive-bullshit:

Edward-Sun:

mholt:

Created 4 years ago

Updated 1 year ago

rex-gym by nicrusso7

Gym environments for quadruped robot (SpotMicro) control

pathak22:

Created 6 years ago

Updated 2 years ago

higgsfield by higgsfield-ai

ML framework for large model training and GPU orchestration

aravindsrinivas:

luiscape:

pgarbacki:

chiphuyen:

Created 7 years ago

Updated 1 year ago

pfrl by pfnet

PyTorch library for deep reinforcement learning research

aravindsrinivas:

Created 5 years ago

Updated 1 year ago

Awesome-VAEs by matthewvowels1

Curated list of VAE papers for disentanglement, representation learning, and generative models

ebursztein:

Created 6 years ago

Updated 4 years ago

normalizing_flows by kamenbliznashki

PyTorch for density estimation research

CodeCreator:

Created 6 years ago

Updated 4 years ago

Pytorch-UNet by milesial

PyTorch implementation for image semantic segmentation

aangelopoulos:

hiyouga:

Created 8 years ago

Updated 1 year ago

MARL-Papers by LantaoYu

Paper list for multi-agent reinforcement learning (MARL)

aravindsrinivas:

jiamings:

merrymercy:

Created 8 years ago

Updated 5 months ago

PyTorch-RL by Khrylx

RL algorithms in PyTorch

jiamings:

millionintegrals:

Created 8 years ago

Updated 4 years ago

image-gpt by openai

Image generation research paper, code, and models

aravindsrinivas:

steve8708:

lewtun:

shizhediao:

Created 5 years ago

Updated 3 years ago

glow-pytorch by chaiyujin

PyTorch implementation of OpenAI's Glow generative flow paper

rromb:

Created 7 years ago

Updated 6 years ago

pixel-cnn-pp by pclucas14

Pytorch implementation of PixelCNN++ for generative image modeling

yang-song:

jiamings:

Created 8 years ago

Updated 4 years ago

rlpyt by astooke

PyTorch library for deep reinforcement learning research

suquark:

hammer:

jspahrsummers:

shizhediao:

Created 6 years ago

Updated 4 years ago

pytorch3d by facebookresearch

PyTorch3D is a PyTorch library for 3D deep learning research

aravindsrinivas:

chiphuyen:

hiyouga:

gkioxari:

Created 6 years ago

Updated 5 days ago

awesome-deep-learning-papers by terryum

Curated list of seminal deep learning papers (2012-2016)

lilianweng:

ShengjiaZhao:

bcherny:

vincentweisser:

Created 9 years ago

Updated 1 year ago

ebm_code_release by openai

Code release for energy-based model research paper

jiamings:

Created 6 years ago

Updated 2 years ago

ncsn by ermongroup

Research paper implementation for generative modeling via score estimation

yang-song:

jiamings:

Created 6 years ago

Updated 1 year ago

examples by pytorch

PyTorch examples for diverse AI tasks

lilianweng:

hammer:

tjbck:

ari-holtzman:

Created 9 years ago

Updated 2 months ago

glow by openai

Generative flow research paper code

lilianweng:

patrick-kidger:

tgaddair:

Edward-Sun:

Created 7 years ago

Updated 1 year ago

Feedback? Help us improve.