Maxime Labonne

Head of Post-Training at Liquid AI

Authored Projects (3)

Starred by

Luca Soldaini

Luca Soldaini(Research Scientist at Ai2),

Jeremy Howard

Jeremy Howard(Cofounder of fast.ai),

Shyamal Anadkat

Shyamal Anadkat(Research Scientist at OpenAI),

Philipp Schmid

Philipp Schmid(DevRel at Google DeepMind), and

2 more.

llm-datasets by mlabonne

Curated datasets/tools for LLM post-training

SFT datasets for turning pre-trained models into helpful assistants.
Math datasets enhance mathematical reasoning and formal logic.
Code datasets improve understanding, generation, and analysis.
Preference datasets align LLM answers with human values/style.

Created 1 year ago

Updated 2 months ago

Starred by

Michael Han

Michael Han(Cofounder of Unsloth),

Will Brown

Will Brown(Research Lead at Prime Intellect),

Zack Li

Zack Li(Cofounder of Nexa AI),

Junyang Lin

Junyang Lin(Core Maintainer at Alibaba Qwen), and

15 more.

llm-course by mlabonne

LLM course with roadmaps and notebooks

LLM Fundamentals: math, Python, neural networks, NLP.
LLM Scientist: pre-training, fine-tuning, preference alignment, quantization.
LLM Engineer: RAG, agents, inference optimization, deployment, security.
Notebooks for auto-eval, lazy mergekit, quantization, fine-tuning.

Created 2 years ago

Updated 4 months ago

Starred by

Pietro Schirano

Pietro Schirano(Founder of MagicPath)

Omar Sanseviero

Omar Sanseviero(DevRel at Google DeepMind)

Philipp Schmid

Philipp Schmid(DevRel at Google DeepMind)

llm-autoeval by mlabonne

Colab notebook for LLM evaluation

Automated setup/execution using RunPod for cloud GPU access.
Customizable evaluation parameters for tailored benchmarking.
Supports benchmarks: AGIEval, GPT4ALL, TruthfulQA, Bigbench, Open LLM Leaderboard.
Generates summaries, uploads to GitHub Gist for sharing.

Created 1 year ago

Updated 1 year ago

Starred Projects (80)

openbench by groq

Provider-agnostic LLM evaluation infrastructure

lewtun:

handotdev:

willccbb:

beyang:

Created 2 months ago

Updated 2 days ago

remove-refusals-with-transformers by Sumandora

Refusal removal via HF Transformers

Created 1 year ago

Updated 1 year ago

evalchemy by mlfoundations

LLM evaluation toolkit for post-trained language models

willccbb:

casper-hansen:

JustinLin610:

jmorganca:

Created 11 months ago

Updated 3 months ago

OpenCoder-llm by OpenCoder-llm

Open code LLM family (1.5B/8B) for English and Chinese

casper-hansen:

Created 11 months ago

Updated 10 months ago

evaluation-guidebook by huggingface

LLM evaluation guide for practitioners

clmnt:

winglian:

thomwolf:

dguido:

Created 1 year ago

Updated 1 week ago

LLM-Engineers-Handbook by PacktPublishing

LLM system handbook, from fundamentals to AWS deployment

shimmyshimmer:

generall:

Created 1 year ago

Updated 7 months ago

dataspeech by huggingface

Suite of scripts for tagging speech datasets, especially for TTS model development

Created 1 year ago

Updated 1 year ago

DistillKit by arcee-ai

Open-source toolkit for LLM distillation research

vincentweisser:

pgarbacki:

JohannesHa:

winglian:

Created 1 year ago

Updated 3 months ago

tree-of-thoughts by kyegomez

Plug-and-play implementation of Tree of Thoughts for LLM reasoning

vincentweisser:

shyamal-anadkat:

omarsar:

bryanhelmig:

Created 2 years ago

Updated 2 months ago

cosmopedia by huggingface

Synthetic dataset for LLM training

shizhediao:

osanseviero:

soldni:

Created 1 year ago

Updated 10 months ago

refusal_direction by andyrdt

Research paper code for analyzing refusal in language models

winglian:

Created 1 year ago

Updated 4 months ago

magpie by magpie-align

Synthetic data pipeline for LLM alignment (ICLR 2025 paper)

hiyouga:

Created 1 year ago

Updated 7 months ago

arena-hard-auto by lmarena

Automatic LLM benchmark for instruction-tuned models, correlating with human preference

hiyouga:

pgarbacki:

zhuohan123:

merrymercy:

Created 1 year ago

Updated 3 months ago

MixEval by JinjieNi

Dynamic LLM evaluation suite for accurate, cost-effective benchmarking

hiyouga:

winglian:

Created 1 year ago

Updated 11 months ago

abliterator by FailSpy

Python library for LLM feature ablation using TransformerLens

Created 1 year ago

Updated 1 year ago

llm-swarm by huggingface

CLI tool to manage scalable open LLM inference endpoints in Slurm clusters

thomwolf:

osanseviero:

natolambert:

lewtun:

Created 1 year ago

Updated 1 year ago

prometheus-eval by prometheus-eval

LLM evaluation framework using open LLMs

winglian:

Created 1 year ago

Updated 5 months ago

EasyContext by jzhang38

Recipes for language model context length extrapolation to 1M tokens

hiyouga:

jiamings:

MishaLaskin:

pgarbacki:

Created 1 year ago

Updated 1 year ago

datatrove by huggingface

Data processing library for large-scale text data

lewtun:

shizhediao:

apsdehal:

hammer:

Created 2 years ago

Updated 6 days ago

mergoo by Leeroo-AI

Library for merging LLM experts and training merged models

clmnt:

philschmid:

Created 1 year ago

Updated 1 year ago

rho by microsoft

LLM pretraining research paper using selective language modeling (SLM)

winglian:

Created 1 year ago

Updated 1 year ago

lighteval by huggingface

LLM evaluation toolkit for multiple backends

mfuntowicz:

luiscape:

shizhediao:

abidlabs:

Created 1 year ago

Updated 22 hours ago

llm-course-chn by friendmine

Chinese translation of a comprehensive LLM course

Created 1 year ago

Updated 1 year ago

bonito by BatsResearch

Synthetic data generator for instruction tuning datasets

osanseviero:

casper-hansen:

Created 1 year ago

Updated 3 months ago

transformer-heads by center-for-humans-and-machines

Toolkit for attaching, training, saving, and loading new heads for transformer models

Created 1 year ago

Updated 7 months ago

quip-sharp by Cornell-RelaxML

LLM quantization for extreme compression

hiyouga:

Created 1 year ago

Updated 11 months ago

AQLM by Vahe1994

PyTorch code for LLM compression via Additive Quantization (AQLM)

lysandrejik:

chiphuyen:

hiyouga:

casper-hansen:

Created 1 year ago

Updated 2 months ago

fsdp_qlora by AnswerDotAI

Training script for LLMs using QLoRA + FSDP

hammer:

calvinfo:

chiphuyen:

hiyouga:

Created 1 year ago

Updated 11 months ago

Open-Sora by hpcaitech

Video generation initiative for efficient, high-quality video production

luiscape:

parasj:

wassemgtk:

pgarbacki:

Created 1 year ago

Updated 5 months ago

GPTFast by MDK8888

HF Transformers accelerator for faster inference

chiphuyen:

jph00:

Created 1 year ago

Updated 1 year ago

LLM-Blender by yuchenlin

LLM ensembling framework using pairwise ranking and generative fusion

winglian:

pgarbacki:

chiphuyen:

philschmid:

Created 2 years ago

Updated 11 months ago

mamba-minimal by johnma2006

Minimal Mamba SSM implementation in one PyTorch file

teoliphant:

victortaelin:

flaque:

albertfgu:

Created 1 year ago

Updated 1 year ago

langfuse by langfuse

Open source LLM engineering platform for observability and evals

marcklingen:

timsuchanek:

tjbck:

shimmyshimmer:

Created 2 years ago

Updated 22 hours ago

garak by NVIDIA

LLM vulnerability scanner for red-teaming and security assessments

ebursztein:

luiscape:

omarsar:

dguido:

Created 2 years ago

Updated 1 day ago

AI-tamago by ykhli

Local-ready LLM virtual pet with thoughts and feelings

handotdev:

mchiang0610:

jmorganca:

Created 2 years ago

Updated 4 months ago

LLMs-from-scratch by rasbt

Educational resource for LLM construction in PyTorch

norvig:

rasbt:

ogabrielluiz:

tunguz:

Created 2 years ago

Updated 1 day ago

letta by letta-ai

Agent framework for stateful agents with memory, reasoning, and context management

xiezhq-hermann:

joewalnes:

c4pt0r:

sxyu:

Created 2 years ago

Updated 5 days ago

self-rewarding-lm-pytorch by lucidrains

Training framework for self-rewarding language models

vincentweisser:

chiphuyen:

pgarbacki:

swyxio:

Created 1 year ago

Updated 1 year ago

mario-gpt by shyamsn97

Research paper code for text-conditioned Super Mario Bros level generation

transitive-bullshit:

osanseviero:

Created 2 years ago

Updated 1 year ago

ollama by ollama

CLI tool for running LLMs locally

tobi:

jmorganca:

domoritz:

ekzhu:

Created 2 years ago

Updated 22 hours ago

EQ-Bench by EQ-bench

Benchmark for emotional intelligence evaluation in LLMs

omarsar:

thomwolf:

Created 1 year ago

Updated 1 year ago

mlx-examples by ml-explore

Examples using the MLX framework

hammer:

didierrlopes:

awni:

willccbb:

Created 1 year ago

Updated 1 week ago

mlx by ml-explore

Array framework for machine learning on Apple silicon

geohot:

karpathy:

jmorganca:

chiphuyen:

Created 1 year ago

Updated 1 day ago

distilabel by argilla-io

Framework for synthetic data and AI feedback pipelines

lvwerra:

jn2clark:

hiyouga:

pgarbacki:

Created 2 years ago

Updated 1 day ago

argilla by argilla-io

Collaboration tool for building high-quality AI datasets

osanseviero:

chiphuyen:

gakonst:

nirga:

Created 4 years ago

Updated 1 day ago

DeepSeek-MoE by deepseek-ai

MoE language model for research purposes

omarsar:

hiyouga:

huybery:

Created 1 year ago

Updated 1 year ago

launchables by brevdev

Notebook templates for AI/ML tasks

didierrlopes:

jeresig:

simonw:

Created 2 years ago

Updated 1 day ago

OpenNMT-py by OpenNMT

PyTorch framework for neural machine translation and LLM experimentation

osanseviero:

hammer:

codekansas:

shizhediao:

Created 8 years ago

Updated 7 months ago

vllm by vllm-project

LLM serving engine for high-throughput, memory-efficient inference

karpathy:

clmnt:

tobi:

danielhanchen:

Created 2 years ago

Updated 23 hours ago

can-ai-code by the-crypt-keeper

AI coding model evaluation framework

ishaan-jaff:

pgarbacki:

osanseviero:

Created 2 years ago

Updated 3 months ago

bagel by jondurbin

Fine-tuning pipeline for language models, "with everything."

jph00:

osanseviero:

casper-hansen:

Created 1 year ago

Updated 1 year ago

web-llm by mlc-ai

In-browser LLM inference engine using WebGPU for hardware acceleration

tobi:

didierrlopes:

doriandarko:

osanseviero:

Created 2 years ago

Updated 1 month ago

augmentoolkit by e-p-armstrong

Data toolkit for custom LLM creation using open-source AI

didierrlopes:

vincentweisser:

winglian:

shimmyshimmer:

Created 1 year ago

Updated 3 weeks ago

laser by pratyushasharma

Research paper code for improving LLM reasoning via layer-selective rank reduction

abidlabs:

Created 1 year ago

Updated 1 year ago

mamba-chat by redotvideo

Chat LLM based on state-space model architecture

vincentweisser:

marcklingen:

aksh-at:

Created 1 year ago

Updated 1 year ago

mergekit by arcee-ai

CLI tool for merging pretrained language models, combining strengths without retraining

shizhediao:

Ying1123:

transitive-bullshit:

thomwolf:

Created 2 years ago

Updated 3 weeks ago

microchain by galatolofederico

Lightweight SDK for LLM agents using function calling

Created 1 year ago

Updated 1 year ago

LLaMA-Factory by hiyouga

Unified fine-tuning tool for 100+ LLMs & VLMs (ACL 2024)

teetone:

lysandrejik:

gregpr07:

calvinfo:

Created 2 years ago

Updated 1 day ago

unsloth by unslothai

Finetuning tool for LLMs, targeting speed and memory efficiency

tobi:

karpathy:

danielhanchen:

yiranwu0:

Created 1 year ago

Updated 1 day ago

h2o-llmstudio by h2oai

LLM Studio: framework for LLM fine-tuning via GUI or CLI

ebursztein:

andyk:

winglian:

JustinLin610:

Created 2 years ago

Updated 2 weeks ago

EasyEdit by zjunlp

Framework for LLM knowledge editing (ACL 2024 paper)

ericciarla:

Created 2 years ago

Updated 1 week ago

OpenPipe by OpenPipe

Fine-tuning platform for cheaper models

pgarbacki:

marcklingen:

transitive-bullshit:

chiphuyen:

Created 2 years ago

Updated 1 year ago

vigogne by bofenghuang

French LLMs for instruction-following and chat

ggerganov:

Created 2 years ago

Updated 10 months ago

TinyLlama by jzhang38

Tiny pretraining project for a 1.1B Llama model

karpathy:

geohot:

tobi:

chiphuyen:

Created 2 years ago

Updated 1 year ago

ragas by explodinggradients

Toolkit for LLM application evaluation

gregpr07:

alexchen4ai:

hiyouga:

nirga:

Created 2 years ago

Updated 1 day ago

Doctor-Dignity by llSourcell

Offline LLM for medical Q&A, passing US Medical Licensing Exam

chiphuyen:

Created 2 years ago

Updated 2 years ago

lmql by eth-sri

LMQL: Language for constraint-guided LLM programming

tholor:

nirga:

chiphuyen:

didierrlopes:

Created 2 years ago

Updated 4 months ago

Awesome-Code-LLM by huybery

Curated list of code LLMs for research

huybery:

Created 2 years ago

Updated 10 months ago

dstack by dstackai

Open-source tool for simplifying GPU allocation and AI workload orchestration

tobi:

mlejva:

luiscape:

winglian:

Created 3 years ago

Updated 1 day ago

Platypus by arielnlee

Code for fine-tuning LLMs using LoRA

jph00:

eugeneyan:

pgarbacki:

Created 2 years ago

Updated 1 year ago

composer by mosaicml

DL framework for training at scale, optimized for large-scale clusters

aravindsrinivas:

eiso:

gakonst:

jn2clark:

Created 4 years ago

Updated 1 week ago

streamlit-agent by langchain-ai

Streamlit apps showcasing LangChain agents

Created 2 years ago

Updated 1 year ago

LLaMA2-Accessory by Alpha-VLLM

Open-source toolkit for LLM development, pretraining, finetuning, and deployment

jn2clark:

chiphuyen:

Ying1123:

transitive-bullshit:

Created 2 years ago

Updated 9 months ago

llm-reasoners by maitrix-org

Library for advanced LLM reasoning with search algorithms

lewtun:

Ying1123:

chiphuyen:

CodeCreator:

Created 2 years ago

Updated 4 months ago

airoboros by jondurbin

Self-instruct tool for LLM finetuning

casper-hansen:

jph00:

eugeneyan:

philschmid:

Created 2 years ago

Updated 1 year ago

lm-evaluation-harness by EleutherAI

Framework for few-shot language model evaluation

aravindsrinivas:

zjasper666:

zhuohan123:

shizhediao:

Created 5 years ago

Updated 3 days ago

refact by smallcloudai

Open-source AI agent for end-to-end software engineering tasks

vincentweisser:

Created 2 years ago

Updated 3 weeks ago

axolotl by axolotl-ai-cloud

CLI tool for streamlined post-training of AI models

tobi:

beyang:

zhyncs:

patrickvonplaten:

Created 2 years ago

Updated 1 day ago

Text_Classification by kk7nc

Survey paper for text classification algorithms

hiyouga:

Created 7 years ago

Updated 6 months ago

ML-Notebooks by dair-ai

ML notebooks for education/research

lewtun:

omarsar:

Created 3 years ago

Updated 1 year ago

Feedback? Help us improve.