sqlite-vec  by asg017

SQLite extension for vector search

Created 1 year ago
6,631 stars

Top 7.6% on SourcePulse

GitHubView on GitHub
Project Summary

This project provides a lightweight SQLite extension for vector search, enabling efficient storage and querying of vector embeddings directly within SQLite databases. It targets developers and researchers needing a portable, dependency-free solution for integrating vector search into applications, particularly those leveraging SQLite.

How It Works

The extension implements vector search using the vec0 virtual table in pure C. It supports various vector types (float, int8, binary) and allows storing non-vector data in auxiliary columns. This approach offers broad compatibility, running on diverse platforms including browsers via WASM, and avoids external dependencies, simplifying deployment.

Quick Start & Requirements

Highlighted Details

  • Pure C implementation, no external dependencies.
  • Supports float, int8, and binary vector types.
  • Runs anywhere SQLite runs, including Linux, macOS, Windows, and WASM.
  • Integrates with popular tools like Datasette, rqlite, and sqlite-utils.

Maintenance & Community

  • Developed by Alex Garcia (asg017), a Mozilla Builders project.
  • Sponsored by Mozilla, Fly.io, Turso, SQLite Cloud, and Shinkai.
  • GitHub Sponsors for individual support.

Licensing & Compatibility

  • MIT License. Permissive for commercial use and closed-source linking.

Limitations & Caveats

The project is pre-v1, indicating potential for breaking changes. Performance is described as "fast enough," suggesting it may not be suitable for extremely high-throughput or latency-sensitive applications compared to specialized vector databases.

Health Check
Last Commit

11 months ago

Responsiveness

1 day

Pull Requests (30d)
2
Issues (30d)
1
Star History
125 stars in the last 30 days

Explore Similar Projects

Starred by Chang She Chang She(Cofounder of LanceDB), Carol Willing Carol Willing(Core Contributor to CPython, Jupyter), and
11 more.

lancedb by lancedb

0.9%
8k
Embedded retrieval engine for multimodal AI
Created 2 years ago
Updated 1 day ago
Feedback? Help us improve.