hyperDB  by jdagdelen

Local vector database for LLM agent applications

Created 2 years ago
1,403 stars

Top 28.9% on SourcePulse

GitHubView on GitHub
Project Summary

HyperDB is a high-performance, local vector database designed for seamless integration with Large Language Model (LLM) agents. It offers a simplified interface for indexing documents with metadata and querying them using natural language, aiming to accelerate LLM agent development.

How It Works

HyperDB leverages a C++ backend for its vector store, incorporating hardware acceleration via MKL BLAS for optimized operations. This approach prioritizes speed and efficiency in indexing and retrieval, making it suitable for real-time agent interactions. The database supports advanced features like document IDs and metadata, enhancing the context available to LLM agents.

Quick Start & Requirements

  • Install via pip: pip install hyperdb-python
  • Optional dependency for local embedding: pip install sentence-transformers
  • Example usage and demo files are available in the repository.

Highlighted Details

  • Optimized C++ backend with MKL BLAS hardware acceleration.
  • Simple interface compatible with various LLM agents.
  • Supports indexing documents with IDs and metadata.
  • Benchmarked for high performance.

Maintenance & Community

The project is actively seeking investment and has a Discord server for community engagement.

Licensing & Compatibility

The licensing details are not explicitly stated in the README, but the project is open-source.

Limitations & Caveats

The project is presented with a humorous tone regarding investment, and its stability or production readiness for critical applications may require further evaluation. The README does not specify the exact license.

Health Check
Last Commit

7 months ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
3 stars in the last 30 days

Explore Similar Projects

Starred by Andrej Karpathy Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), Anton Troynikov Anton Troynikov(Cofounder of Chroma), and
44 more.

llama_index by run-llama

0.3%
44k
Data framework for building LLM-powered agents
Created 2 years ago
Updated 18 hours ago
Feedback? Help us improve.