flappy  by pleisto

LLM Agent SDK for streamlined AI app creation

Created 2 years ago
307 stars

Top 87.5% on SourcePulse

GitHubView on GitHub
Project Summary

Flappy is a production-ready SDK designed to simplify the creation of AI applications and agents powered by Large Language Models (LLMs). It targets developers seeking to integrate AI capabilities into their projects, offering a language-agnostic and user-friendly approach that abstracts away LLM complexities for easier adoption.

How It Works

Flappy enables agents to interact with LLMs through a core concept of "functions." These can be InvokeFunctions, where developers define pre-set input/output parameters for interaction, or SynthesizedFunctions, where the LLM generates the function based on a description and data structure. A key feature is the CodeInterpreter, which safely executes LLM-generated Python code within a sandboxed environment. Flappy uniquely leverages JSON Schema, transforming abstract class definitions into schemas for machine-readable data management, and employs Abstract Syntax Tree (AST) parsing to validate LLM outputs against these schemas, ensuring data integrity and controlled interactions.

Quick Start & Requirements

  • Install/Run: Language-specific packages are planned. Currently, no direct installation command is provided.
  • Prerequisites: LLM API keys are implicitly required. Python is needed for the CodeInterpreter sandbox.
  • Resources: Setup time and resource footprint are not specified.
  • Links: Documentation and code examples are stated to be available soon.

Highlighted Details

  • Language-agnostic design, aiming for seamless integration across Node.js, Java, C#, Go, and Ruby.
  • Production-ready focus balancing cost-efficiency and sandbox security.
  • LLM abstraction layer allows easy switching between different LLM providers and fallback configurations.
  • Unique JSON Schema integration for defining and validating LLM input/output.

Maintenance & Community

  • The project is under active development, with a first version release anticipated soon.
  • Community contributions are welcomed. Specific community channels (Discord/Slack) or social handles are not listed.

Licensing & Compatibility

  • Licensed under the Apache License 2.0.
  • Permissive license suitable for commercial use and integration into closed-source applications.

Limitations & Caveats

The project is still under development, with documentation and initial language implementations (Node.js, Kotlin/Java) not yet fully released. Support for other languages like Ruby, PHP, C#, and Go is planned but not yet available.

Health Check
Last Commit

1 year ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
0 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Ishaan Jaffer Ishaan Jaffer(Cofounder of LiteLLM), and
10 more.

llama-stack by llamastack

0.2%
8k
Composable building blocks for Llama apps
Created 1 year ago
Updated 2 days ago
Feedback? Help us improve.