sqlite-vec  by asg017

SQLite extension for vector search

created 1 year ago
5,930 stars

Top 8.9% on sourcepulse

GitHubView on GitHub
Project Summary

This project provides a lightweight SQLite extension for vector search, enabling efficient storage and querying of vector embeddings directly within SQLite databases. It targets developers and researchers needing a portable, dependency-free solution for integrating vector search into applications, particularly those leveraging SQLite.

How It Works

The extension implements vector search using the vec0 virtual table in pure C. It supports various vector types (float, int8, binary) and allows storing non-vector data in auxiliary columns. This approach offers broad compatibility, running on diverse platforms including browsers via WASM, and avoids external dependencies, simplifying deployment.

Quick Start & Requirements

Highlighted Details

  • Pure C implementation, no external dependencies.
  • Supports float, int8, and binary vector types.
  • Runs anywhere SQLite runs, including Linux, macOS, Windows, and WASM.
  • Integrates with popular tools like Datasette, rqlite, and sqlite-utils.

Maintenance & Community

  • Developed by Alex Garcia (asg017), a Mozilla Builders project.
  • Sponsored by Mozilla, Fly.io, Turso, SQLite Cloud, and Shinkai.
  • GitHub Sponsors for individual support.

Licensing & Compatibility

  • MIT License. Permissive for commercial use and closed-source linking.

Limitations & Caveats

The project is pre-v1, indicating potential for breaking changes. Performance is described as "fast enough," suggesting it may not be suitable for extremely high-throughput or latency-sensitive applications compared to specialized vector databases.

Health Check
Last commit

6 months ago

Responsiveness

1 day

Pull Requests (30d)
2
Issues (30d)
2
Star History
440 stars in the last 90 days

Explore Similar Projects

Starred by Jared Palmer Jared Palmer(Ex-VP of AI at Vercel; Founder of Turborepo; Author of Formik, TSDX).

pgvector-node by pgvector

0.8%
399
Node.js library for pgvector support
created 4 years ago
updated 2 weeks ago
Feedback? Help us improve.