EdgeChains.js is a full-stack Generative AI library designed for managing complex prompt engineering, distributed computing, and API integrations. It targets developers seeking a declarative, configuration-driven approach to building GenAI applications, offering a unified solution for front-end, back-end, and prompt management.

How It Works

EdgeChains leverages jsonnet for declarative configuration of prompts and chains, treating GenAI as a deployment and configuration challenge akin to Kubernetes. This approach, inspired by Google's Borg infrastructure management, allows for versionable, diffable prompts and automatic parallelism across CPUs, GPUs, and TPUs via a WebAssembly runtime. It emphasizes fault tolerance and scalability for complex chain-of-thought applications.

Quick Start & Requirements

• Install dependencies with npm install within the example directory (e.g., JS/edgechains/examples/chat-with-pdf/).
• Requires Node.js, npm, and a PostgreSQL Vector database (Supabase is demonstrated).
• API keys for services like OpenAI and Supabase are needed.
• Setup involves cloning the repository, installing packages, configuring secrets, and setting up the database schema.
• Example: ChatWithPdfExample

Highlighted Details

• Declarative prompt and chain management using jsonnet.
• Automatic parallelism and fault tolerance for LLM chains.
• Built on Hono.js and jsonnet, citing stability from Cloudflare and Google.
• Integrated token cost measurement and tracking.

Maintenance & Community

• Active community with a Discord server mentioned for support.
• Acknowledges inspiration from Next.js and contributions from the LLM community.
• Contribution guidelines and a code of conduct are provided.

Licensing & Compatibility

• Licensed under GNU Affero General Public License v3.0.
• Commercial licensing is available upon contact.

Limitations & Caveats

The project is licensed under AGPLv3, which may impose copyleft restrictions on derivative works, potentially impacting commercial use or integration into closed-source projects without specific licensing agreements.