ell  by MadcowD

Lightweight prompt engineering framework

created 1 year ago
5,801 stars

Top 9.0% on sourcepulse

GitHubView on GitHub
Project Summary

Ell is a functional programming framework for building and managing language model applications (LMAs), targeting developers and researchers. It treats prompts as executable programs, enabling versioning, monitoring, and visualization of prompt engineering workflows, akin to machine learning checkpointing, with built-in support for multimodal inputs.

How It Works

Ell reframes prompt engineering by defining prompts as Python functions, treating them as discrete subroutines (Language Model Programs or LMPs). This functional approach allows prompts to be versioned, serialized, and analyzed like machine learning models. The framework integrates with Ell Studio, a local tool for prompt version control, monitoring, and visualization, facilitating empirical optimization and regression detection. It also prioritizes first-class support for multimodality, allowing seamless integration of images, audio, and other data types within prompt messages.

Quick Start & Requirements

  • Primary install / run command: pip install -U "ell-ai[all]"
  • Prerequisites: Python. No specific version mentioned, but examples use Python 3.
  • Ell Studio command: ell-studio --storage ./logdir
  • Documentation: https://docs.ell.ai/
  • Getting Started: https://docs.ell.ai/getting-started
  • Community: Discord (link not provided in README)

Highlighted Details

  • Prompts are treated as programs, not strings, enabling a functional approach to prompt engineering.
  • Automatic versioning and serialization of prompts with GPT-4o-mini autogenerated commit messages.
  • Ell Studio provides local, open-source tooling for prompt version control, monitoring, and visualization.
  • First-class support for multimodal inputs (images, audio) integrated directly into message objects.

Maintenance & Community

  • Community support via Discord.
  • Roadmap and specific contributors not detailed in the README.

Licensing & Compatibility

  • License type not specified in the README.
  • Compatibility for commercial or closed-source use is not detailed.

Limitations & Caveats

The README does not specify the license, making commercial or closed-source integration uncertain. Details on specific model compatibility beyond GPT-4o and GPT-4o-mini are not provided. Community support channels like Discord are mentioned but not linked.

Health Check
Last commit

1 month ago

Responsiveness

1 week

Pull Requests (30d)
1
Issues (30d)
0
Star History
82 stars in the last 90 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera), and
2 more.

prompt-engine by microsoft

0.0%
3k
NPM library for LLM prompt engineering
created 3 years ago
updated 2 years ago
Feedback? Help us improve.