Jeffrey Quesnelle

Cofounder of Nous Research

Authored Projects (1)

Starred by

Vincent Weisser

Vincent Weisser(Cofounder of Prime Intellect),

Chip Huyen

Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"),

Jeff Hammerbacher

Jeff Hammerbacher(Cofounder of Cloudera),

Simon Willison

Simon Willison(Coauthor of Django), and

5 more.

yarn by jquesnelle

Context window extension method for LLMs (research paper, models)

Extends LLaMA 2 context to 32K-128K via YaRN; available on Hugging Face.
Includes 64K/128K variants of Mistral 7B v0.1 models.
SOLAR 10.7B variants extend context to 32K/64K.
Provides code/data for reproduction; uses DeepSpeed for training.

Created 2 years ago

Updated 2 years ago

Starred Projects (5)

hermes-agent by NousResearch

Autonomous AI agent for persistent learning and task automation

willccbb:

deshraj:

joewalnes:

lysandrejik:

Created 8 months ago

Updated 21 hours ago

llama_index by run-llama

Data framework for building LLM-powered agents

karpathy:

willingc:

atroyn:

zhuohan123:

Created 3 years ago

Updated 1 day ago

trlx by CarperAI

Distributed RLHF for LLMs

nat:

chiphuyen:

eugeneyan:

huybery:

Created 3 years ago

Updated 2 years ago

PaLM-rlhf-pytorch by lucidrains

RLHF implementation on PaLM

pgarbacki:

winglian:

osanseviero:

tholor:

Created 3 years ago

Updated 6 months ago

RETRO-pytorch by lucidrains

PyTorch implementation of Deepmind's RETRO retrieval-augmented LM

jn2clark:

philschmid:

ablattmann:

Created 4 years ago

Updated 2 years ago

Feedback? Help us improve.