superlinked  by superlinked

Python framework for building high-performance search & recommendation apps

created 1 year ago
1,279 stars

Top 31.8% on sourcepulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

Superlinked is a Python framework designed for AI engineers to build high-performance search and recommendation systems. It uniquely combines structured and unstructured data by encoding metadata alongside content into vectors, enhancing search relevance and enabling sophisticated querying.

How It Works

Superlinked allows users to define custom embedding models by composing pre-trained encoders (e.g., from sentence-transformers, open-clip) with custom encoders for numerical, categorical, and temporal data. This approach facilitates the creation of multi-modal vector spaces that capture complex relationships. The framework supports updating vectors with behavioral events and allows for query-time weighting and natural language querying, powered by LLMs.

Quick Start & Requirements

  • Install: %pip install superlinked
  • Prerequisites: Python, OpenAI API key for natural language query feature.
  • Example: The README provides a comprehensive Python example demonstrating schema definition, index creation, data ingestion, and querying.
  • Documentation: https://docs.superlinked.com/

Highlighted Details

  • Supports embedding diverse data types: Text, Image, Number, Category, Time, Event.
  • Integrates with popular vector databases: Redis, MongoDB, Qdrant.
  • Enables RAG, semantic search, recommendation systems, and analytics use cases.
  • Offers a self-hostable REST API server for production deployments.

Maintenance & Community

  • Active development indicated by recent commits.
  • Community support via GitHub issues and discussions for bug reports, feature requests, and general inquiries.
  • Resources include a Vector DB Comparison and VectorHub learning hub.

Licensing & Compatibility

  • License: Apache License 2.0.
  • Compatibility: Permissive license suitable for commercial use and integration with closed-source applications.

Limitations & Caveats

The framework is actively evolving, with a mention of "early access" for managed cloud offerings, suggesting some features or services might be in beta or under development. The natural language query feature requires an OpenAI API key.

Health Check
Last commit

3 days ago

Responsiveness

1 day

Pull Requests (30d)
3
Issues (30d)
9
Star History
223 stars in the last 90 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems) and Elie Bursztein Elie Bursztein(Cybersecurity Lead at Google DeepMind).

LightRAG by HKUDS

1.0%
19k
RAG framework for fast, simple retrieval-augmented generation
created 10 months ago
updated 18 hours ago
Feedback? Help us improve.