Artidoro Pagnoni

Coauthor of QLoRA; Research Scientist at Meta

Authored Projects (1)

Starred by

Tobi Lutke

Tobi Lutke(Cofounder of Shopify),

Chip Huyen

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Vincent Weisser

Vincent Weisser(Cofounder of Prime Intellect),

Jeremy Howard

Jeremy Howard(Cofounder of fast.ai), and

19 more.

qlora by artidoro

Finetuning tool for quantized LLMs

Memory-efficient finetuning using 4-bit quantization and Low-Rank Adapters (LoRA).
Introduces NormalFloat (NF4), double quantization, and paged optimizers.
Supports LLaMA and T5 models; integrates with PEFT and Transformers.
Includes GPT-4 evaluation scripts and releases finetuned Guanaco models.

Created 2 years ago

Updated 1 year ago

Starred Projects (14)

lingua by facebookresearch

LLM research codebase for training and inference

theophilegervet:

binarybana:

simon-mo:

stas00:

Created 1 year ago

Updated 3 months ago

open_lm by mlfoundations

Language model research repo for medium-sized models (up to 7B params)

shizhediao:

alexchen4ai:

vincentweisser:

jph00:

Created 2 years ago

Updated 4 months ago

qlora by artidoro

Finetuning tool for quantized LLMs

tobi:

chiphuyen:

vincentweisser:

jph00:

Created 2 years ago

Updated 1 year ago

neurips_llm_efficiency_challenge by llm-efficiency-challenge

Competition toolkit for efficient LLM inference on a single GPU

hiyouga:

jph00:

rasbt:

Created 2 years ago

Updated 2 years ago

SpQR by Vahe1994

Weight compression research paper for near-lossless LLM quantization

hammer:

pgarbacki:

luiscape:

Created 2 years ago

Updated 10 months ago

OmniXAI by salesforce

Python library for explainable AI (XAI)

chiphuyen:

parano:

Created 3 years ago

Updated 1 year ago

Summarization-Papers by xcfcode

Papers on text summarization

hammer:

Created 5 years ago

Updated 2 years ago

transformers by huggingface

ML library for pretrained model inference and training

clmnt:

lilianweng:

karpathy:

tjbck:

Created 7 years ago

Updated 21 hours ago

pytorch-lightning by Lightning-AI

Deep learning framework for pretraining, finetuning, and deploying AI models

albertfgu:

soldni:

omarsar:

zhangce:

Created 6 years ago

Updated 1 day ago

hummingbird by microsoft

Compiler for trained ML models into tensor computation

tgaddair:

chiphuyen:

parano:

ankane:

Created 5 years ago

Updated 3 months ago

text by pytorch

PyTorch library for NLP tasks

luiscape:

eugeneyan:

hammer:

codekansas:

Created 8 years ago

Updated 1 month ago

spaCy by explosion

NLP library for production applications

aravindsrinivas:

fchollet:

nirga:

jn2clark:

Created 11 years ago

Updated 4 months ago

OpenNMT-py by OpenNMT

PyTorch framework for neural machine translation and LLM experimentation

mlabonne:

osanseviero:

hammer:

codekansas:

Created 8 years ago

Updated 2 days ago

AI-Toolbox by Svalorzen

C++ framework for reinforcement learning and planning problems

millionintegrals:

lantiga:

Created 12 years ago

Updated 7 months ago

Feedback? Help us improve.