eino-ext  by cloudwego

Eino framework extensions for LLM application development

created 8 months ago
387 stars

Top 75.2% on sourcepulse

GitHubView on GitHub
Project Summary

This project provides a collection of extensions for the Eino framework, a system for building LLM applications. It offers official implementations for Eino's various component types, callback handlers, and DevOps tools, aiming to enhance the development and debugging experience for LLM application builders.

How It Works

EinoExt extends the Eino framework by providing pre-built, official implementations for its core component types, including ChatModels (OpenAI, Gemini, Claude), Tool integrations (Google Search), Retrievers (Elasticsearch), Document Loaders, and Embeddings. This modular approach allows developers to easily integrate diverse LLM functionalities and data sources without building them from scratch, leveraging the framework's flexibility.

Quick Start & Requirements

  • Install via pip: pip install eino-ext
  • Requires Eino framework: pip install eino
  • Refer to Eino documentation for detailed setup and component usage.

Highlighted Details

  • Extensive component implementations for ChatModels, Tools, Retrievers, Document Loaders, and Embeddings.
  • Includes official callback handlers, such as Langfuse tracing.
  • Offers DevOps tools like an IDE plugin for visualized debugging and graph editing.

Maintenance & Community

  • Developed by CloudWeGo, a ByteDance project.
  • Security vulnerabilities should be reported via ByteDance Security channels, not GitHub issues.

Licensing & Compatibility

  • Licensed under the Apache-2.0 License.
  • Permissive license suitable for commercial use and integration into closed-source projects.

Limitations & Caveats

The project's functionality is entirely dependent on the Eino framework. Specific component integrations may require additional dependencies or API keys not detailed in this overview.

Health Check
Last commit

1 day ago

Responsiveness

1 day

Pull Requests (30d)
36
Issues (30d)
26
Star History
101 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.