Ettore Di Giacinto

Author of LocalAI

Authored Projects (4)

Starred by

Tobi Lutke

Tobi Lutke(Cofounder of Shopify),

Salvatore Sanfilippo

Salvatore Sanfilippo(Author of Redis),

Jeff Hammerbacher

Jeff Hammerbacher(Cofounder of Cloudera),

Tim J. Baek

Tim J. Baek(Founder of Open WebUI), and

15 more.

LocalAI by mudler

Open-source OpenAI alternative for local AI inference

Runs LLMs, generates images/audio on consumer hardware, no GPU needed.
Compatible with OpenAI API, Elevenlabs, Anthropic.
Supports gguf, transformers, diffusers, and more model architectures.
Includes text generation, voice cloning, distributed/P2P inference.

Created 3 years ago

Updated 13 hours ago

Starred by

Jeremy Howard

Jeremy Howard(Cofounder of fast.ai).

parakeet.cpp by mudler

High-performance C++ ASR inference

Efficient offline and streaming speech recognition using NVIDIA Parakeet models, eliminating Python dependencies.
Runs on CPU and GPU (CUDA, Metal) via ggml, supporting CTC, RNNT, and TDT model types.
Delivers byte-identical transcripts to NeMo, significantly faster than NeMo and whisper.cpp.
Features cache-aware streaming with EOU detection and supports GGUF quantization for optimized performance.

Created 2 weeks ago

Updated 1 day ago

LocalAGI by mudler

Self-hostable AI agent platform for local, private AI automation

No-code agent creation via web UI; OpenAI Responses API drop-in.
Agent teaming, planning/reasoning, short/long-term memory via LocalRecall.
Connectors for Discord, Slack, Telegram, GitHub, IRC; REST API.
Supports CPU, NVIDIA/Intel GPUs; text, multimodal, image models.

Created 2 years ago

Updated 6 days ago

LocalRecall by mudler

Local knowledge base for AI agents

Provides a 100% local, offline RESTful API for managing knowledge bases and files.
Supports RAG with local vector stores (ChromaDB) and integrates with agent frameworks.
Handles text, Markdown, and PDF files, with plans for more formats.
Includes a web UI for file management and external source monitoring.

Created 1 year ago

Updated 6 days ago

Starred Projects (27)

parakeet.cpp by mudler

High-performance C++ ASR inference

jph00:

Created 2 weeks ago

Updated 1 day ago

apex-quant by localai-org

MoE-aware mixed-precision quantization for LLMs

winglian:

Created 2 months ago

Updated 2 weeks ago

dimos by dimensionalOS

Agent-native OS and SDK for physical robotics

Created 1 year ago

Updated 14 hours ago

LocalRecall by mudler

Local knowledge base for AI agents

Created 1 year ago

Updated 6 days ago

upscayl by upscayl

AI image upscaler app for Linux, macOS, and Windows

luiscape:

chiphuyen:

taranjeet:

transitive-bullshit:

Created 3 years ago

Updated 3 weeks ago

gguf-parser-go by gpustack

Analyze GGUF models and estimate inference resources

Created 2 years ago

Updated 1 week ago

ha-llmvision by valentinfrlch

Home Assistant integration for multimodal LLM vision

chiphuyen:

Created 2 years ago

Updated 1 week ago

llama3 by meta-llama

*Deprecated* minimal example for loading and running Llama 3 models

tobi:

mckaywrigley:

osanseviero:

simonw:

Created 2 years ago

Updated 1 year ago

llm.c by karpathy

LLM training in pure C/CUDA, no PyTorch needed

norvig:

alexey-milovidov:

didierrlopes:

hiyouga:

Created 2 years ago

Updated 11 months ago

grok-1 by xai-org

JAX example code for loading and running Grok-1 open-weights model

geohot:

yiranwu0:

omarsar:

handotdev:

Created 2 years ago

Updated 1 year ago

LWM by LargeWorldModel

Multimodal autoregressive model for long-context video/text

mateiz:

chiphuyen:

Jiayi-Pan:

pgarbacki:

Created 2 years ago

Updated 1 year ago

intel-extension-for-transformers by intel

Transformer toolkit for GenAI/LLM acceleration on Intel platforms

winglian:

osanseviero:

Created 3 years ago

Updated 1 year ago

GenossGPT by theodo-group

One-line replacement API for OpenAI, using OSS models

ishaan-jaff:

marcklingen:

osanseviero:

Created 2 years ago

Updated 2 years ago

ml-mgie by apple

Image editing via multimodal LLMs (research paper)

simonw:

Created 2 years ago

Updated 2 years ago

big-AGI by enricoros

AI suite for advanced AI/AGI functions, deployable on-prem or cloud

chitalian:

hiyouga:

swyxio:

Created 3 years ago

Updated 23 hours ago

kubectl-ai by sozercan

Kubectl plugin for generating Kubernetes manifests using LLMs

gakonst:

Created 3 years ago

Updated 1 year ago

aikit by kaito-project

AIKit: platform for LLM hosting, fine-tuning, and deployment

Created 2 years ago

Updated 4 days ago

awesome-mlops by kelvins

Curated list of MLOps tools

gregpr07:

vnivargi:

Created 6 years ago

Updated 1 month ago

LocalAI by mudler

Open-source OpenAI alternative for local AI inference

tobi:

antirez:

hammer:

tjbck:

Created 3 years ago

Updated 13 hours ago

LocalAGI by mudler

Self-hostable AI agent platform for local, private AI automation

Created 2 years ago

Updated 6 days ago

Stable-Diffusion-NCNN by EdVince

Stable Diffusion inference via NCNN framework

Created 3 years ago

Updated 2 years ago

bert.cpp by skeskinen

C++ library for local BERT inference

ggerganov:

Created 3 years ago

Updated 2 years ago

go-llama.cpp by go-skynet

Go bindings for llama.cpp

davidzhao:

Created 3 years ago

Updated 20 hours ago

llama.cpp by ggml-org

C/C++ library for local LLM inference

karpathy:

nat:

tobi:

hiyouga:

Created 3 years ago

Updated 14 hours ago

nanoGPT by karpathy

Minimalist repo for training/finetuning GPT models

tobi:

danielgross:

chiphuyen:

ankane:

Created 3 years ago

Updated 7 months ago

awesome-malware-analysis by rshipp

Curated list of malware analysis tools and resources

ebursztein:

Created 11 years ago

Updated 2 years ago

tensorflow by tensorflow

Open-source ML framework

norvig:

aravindsrinivas:

karpathy:

bcherny:

Created 10 years ago

Updated 13 hours ago

Feedback? Help us improve.