Haotian Liu

Author of LLaVA; Research Scientist at xAI

Authored Projects (1)

Starred by

Shizhe Diao

Shizhe Diao(Author of LMFlow; Research Scientist at NVIDIA),

Zack Li

Zack Li(Cofounder of Nexa AI),

Travis Fischer

Travis Fischer(Founder of Agentic),

Patrick von Platen

Patrick von Platen(Author of Hugging Face Diffusers; Research Engineer at Mistral), and

16 more.

LLaVA by haotian-liu

Multimodal assistant with GPT-4 level capabilities

Visual instruction tuning for large language and vision models.
Supports Llama-3 (8B) and Qwen-1.5 (72B/110B) models.
LLaVA-NeXT enables zero-shot modality transfer to video tasks.
Includes LoRA finetuning and quantization for reduced GPU RAM.

Created 2 years ago

Updated 1 year ago

Starred Projects (19)

sglang by sgl-project

Fast serving framework for LLMs and vision language models

samlambert:

ebursztein:

philschmid:

pankajroark:

Created 1 year ago

Updated 11 hours ago

MMMU by MMMU-Benchmark

Multimodal benchmark for expert AGI evaluation

Created 1 year ago

Updated 4 months ago

LLaVA-Plus-Codebase by LLaVA-VL

Multimodal agent for vision tasks using external tools

pgarbacki:

Created 1 year ago

Updated 1 year ago

stable-diffusion-webui by AUTOMATIC1111

Web UI for Stable Diffusion

clmnt:

k06a:

vincentweisser:

tjbck:

Created 3 years ago

Updated 1 day ago

text-generation-webui by oobabooga

Web UI for LLM text generation

vincentweisser:

shimmyshimmer:

soumith:

doriandarko:

Created 2 years ago

Updated 16 hours ago

FastChat by lm-sys

Open platform for training, serving, and evaluating LLM-based chatbots

aangelopoulos:

osanseviero:

natolambert:

lewtun:

Created 2 years ago

Updated 3 months ago

LLaVA by haotian-liu

Multimodal assistant with GPT-4 level capabilities

shizhediao:

zhiyuan8:

transitive-bullshit:

patrickvonplaten:

Created 2 years ago

Updated 1 year ago

evals by openai

Framework for evaluating LLMs and LLM systems, plus benchmark registry

aangelopoulos:

chiphuyen:

agola11:

taranjeet:

Created 2 years ago

Updated 9 months ago

X-Decoder by microsoft

Generalized decoding model for pixel, image, and language tasks

jwyang:

jiamings:

s9xie:

osanseviero:

Created 2 years ago

Updated 1 year ago

GLIGEN by gligen

Text-to-image generation research paper using grounded prompts

JustinLin610:

osanseviero:

Created 2 years ago

Updated 1 year ago

CVinW_Readings by Computer-Vision-in-the-Wild

CVinW Readings: a collection of papers on computer vision in the wild

Created 3 years ago

Updated 1 year ago

pytorch-image-models by huggingface

PyTorch image model collection with training, eval, and inference scripts

clmnt:

karpathy:

osanseviero:

Jiayi-Pan:

Created 6 years ago

Updated 23 hours ago

Point-BERT by Julie-tang00

PyTorch code for pre-training 3D point cloud transformers

Created 3 years ago

Updated 6 months ago

Awesome-Visual-Transformer by dk-liang

Vision transformer paper collection

osanseviero:

shizhediao:

Created 4 years ago

Updated 8 months ago

reformer-pytorch by lucidrains

PyTorch implementation of the Reformer, an efficient Transformer research paper

chenlin9:

shizhediao:

thomwolf:

patrickvonplaten:

Created 5 years ago

Updated 2 years ago

tinygrad by tinygrad

Minimalist deep learning framework for education and exploration

geohot:

k06a:

ekzhang:

amin3141:

Created 4 years ago

Updated 20 hours ago

minGPT by karpathy

Minimal PyTorch re-implementation for GPT training and inference

aravindsrinivas:

nat:

geohot:

lilianweng:

Created 5 years ago

Updated 1 year ago

pytorch-tutorial by yunjey

PyTorch tutorial for deep learning researchers

tjbck:

bryanhelmig:

stas00:

huybery:

Created 8 years ago

Updated 2 years ago

tensor2tensor by tensorflow

Deprecated library for deep learning models/datasets, successor to Trax

lilianweng:

aravindsrinivas:

eiso:

JohannesHa:

Created 8 years ago

Updated 2 years ago

Feedback? Help us improve.