Salvatore Sanfilippo

Author of Redis

Authored Projects (6)

qwen-asr by antirez

Pure C ASR inference engine

Fast speech-to-text for Qwen3 models, supporting offline and streaming modes.
Optimized C implementation with minimal dependencies, leveraging BLAS for CPU performance.
Near-instant model loading via memory-mapped safetensors and efficient streaming.
Handles piped audio input, offering token-by-token output and language control.

Created 8 months ago

Updated 1 week ago

Starred by

Quinn Slack

Quinn Slack(Cofounder of Sourcegraph)

Georgi Gerganov

Georgi Gerganov(Author of llama.cpp, whisper.cpp)

Simon Willison

Simon Willison(Coauthor of Django)

gguf-tools by antirez

CLI tool for GGUF file manipulation and analysis

Shows detailed info about GGUF files, key-value pairs, and tensors.
Compares two GGUF files, computes average weights difference (%).
Inspects tensor weights, useful for quantization checks/fingerprinting.
Splits Mixtral MoE models (experimental), extracts 7B model subset.

Created 2 years ago

Updated 4 months ago

llama.cpp-deepseek-v4-flash by antirez

Experimental LLM inference engine for efficient local deployment

Leverages C/C++ and advanced quantization for high-performance, low-memory LLM inference.
Supports multimodal models and numerous text LLMs, featuring experimental DeepSeek v4 Flash.
Offers an OpenAI-compatible API server, CLI tools, and bindings for seamless application integration.
Optimized for resource-constrained environments, enabling LLMs on devices with limited RAM.

Created 5 months ago

Updated 5 months ago

Starred by

Dan Guido

Dan Guido(Cofounder of Trail of Bits),

Patrick von Platen

Patrick von Platen(Author of Hugging Face Diffusers; Research Engineer at Mistral),

Luis Capelo

Luis Capelo(Cofounder of Lightning AI),

Phil Wang

Phil Wang(Prolific Research Paper Implementer), and

1 more.

voxtral.c by antirez

Pure C speech-to-text inference engine for Mistral Voxtral Realtime 4B

Enables real-time, low-latency speech transcription with a streaming C API.
Leverages Metal GPU acceleration on Apple Silicon or BLAS for efficient inference.
Features memory-mapped weights and a rolling KV cache for fast loading and unlimited audio length.
Offers a zero-dependency C implementation, runnable without Python, CUDA, or vLLM.

Created 8 months ago

Updated 7 months ago

Starred by

Luis Capelo

Luis Capelo(Cofounder of Lightning AI),

Simon Willison

Simon Willison(Coauthor of Django),

Michael Chiang

Michael Chiang(Cofounder of Ollama),

Theo Browne

Theo Browne(Founder of Ping.gg), and

2 more.

iris.c by antirez

Pure C inference engine for AI image generation

Generates images from text prompts and transforms existing images using the FLUX.2-klein-4B model.
Supports text-to-image and image-to-image modalities with an integrated Qwen3-4B text encoder.
Zero-dependency C inference avoids Python/PyTorch/CUDA, with optional BLAS/MPS GPU acceleration.
Features memory-efficient operation and a low-memory mode (--mmap) for systems with limited RAM.

Created 8 months ago

Updated 7 months ago

Starred by

Boris Cherny

Boris Cherny(Creator of Claude Code; MTS at Anthropic),

Luis Capelo

Luis Capelo(Cofounder of Lightning AI),

Tim Suchanek

Tim Suchanek(Founder of expand.ai),

Simon Willison

Simon Willison(Coauthor of Django), and

5 more.

neural-redis by antirez

Redis module for feed-forward neural networks as a native data type

Simplifies ML workflows by integrating data collection and training within Redis.
Uses resilient backpropagation (RPROP) for online training in separate threads.
Supports automatic data normalization and overtraining detection.
Enables regression and classification tasks, suitable for web/mobile app enhancements.

Created 10 years ago

Updated 8 years ago

Starred Projects (16)

LocalAI by mudler

Open-source OpenAI alternative for local AI inference

tobi:

hammer:

tjbck:

JustinLin610:

Created 3 years ago

Updated 9 hours ago

nanoclaw by nanocoai

Personal AI assistant for secure, containerized operation

swyxio:

vincentweisser:

hugs:

binarybana:

Created 8 months ago

Updated 1 day ago

iris.c by antirez

Pure C inference engine for AI image generation

luiscape:

simonw:

mchiang0610:

t3dotgg:

Created 8 months ago

Updated 7 months ago

llama.vim by ggml-org

Vim plugin for LLM-assisted code/text completion

mcollina:

swyxio:

dguido:

ggerganov:

Created 1 year ago

Updated 1 week ago

gemini-cli by google-gemini

AI agent for terminal workflows

ValentaTomas:

MagMueller:

lucidrains:

khou22:

Created 1 year ago

Updated 19 hours ago

Survey_Memory_in_AI by Elvin-Yiming-Du

Survey of AI memory research

Created 1 year ago

Updated 9 months ago

prima.cpp by Lizonghang

Distributed llama.cpp implementation for low-resource LLM inference

Created 1 year ago

Updated 1 year ago

plandex by plandex-ai

CLI tool for AI-assisted coding on large projects

tobi:

apsdehal:

luiscape:

bryanhelmig:

Created 3 years ago

Updated 1 year ago

smolGPT by Om-Alve

Minimal PyTorch LLM for educational training

hugs:

omarsar:

jrk:

Created 1 year ago

Updated 1 year ago

Chital by sheshbabu

macOS app for chatting with local LLMs

mchiang0610:

jmorganca:

Created 2 years ago

Updated 1 year ago

gpt4all by nomic-ai

Desktop app for local LLM inference, no GPU/API needed

willingc:

zhiyuan8:

osanseviero:

chiphuyen:

Created 3 years ago

Updated 1 year ago

telegram-chatgpt-concierge-bot by RafalWilinski

Telegram bot for OpenAI's ChatGPT, plus voice interaction

vanpelt:

Created 3 years ago

Updated 2 years ago

bloomz.cpp by nmntz

C++ project for BLOOM model inference

clmnt:

lewtun:

transitive-bullshit:

generall:

Created 3 years ago

Updated 3 years ago

Gauss by justjake

macOS app for local Stable Diffusion image generation

clmnt:

gakonst:

jrk:

cchio:

Created 3 years ago

Updated 3 years ago

minGPT by karpathy

Minimal PyTorch re-implementation for GPT training and inference

aravindsrinivas:

nat:

geohot:

lilianweng:

Created 6 years ago

Updated 2 years ago

redis-inference-optimization by RedisAI

High-performance deep learning inference and graph execution within Redis

luiscape:

spartee:

parano:

amix:

Created 10 years ago

Updated 1 year ago

Feedback? Help us improve.