promptflow  by microsoft

Suite of tools for LLM app development, from prototype to production

created 2 years ago
10,631 stars

Top 4.8% on sourcepulse

GitHubView on GitHub
Project Summary

Promptflow is a development suite for building, testing, and deploying LLM-based AI applications, targeting developers and researchers. It aims to simplify prompt engineering and ensure production-quality LLM apps through an end-to-end workflow.

How It Works

Promptflow enables users to create executable "flows" by linking LLMs, prompts, and Python code. It facilitates debugging and iteration by tracing LLM interactions. The system also supports evaluating flow quality and performance on datasets, integrating testing into CI/CD pipelines for robust deployment.

Quick Start & Requirements

  • Install via pip: pip install promptflow promptflow-tools
  • Recommended Python version: 3.9 to 3.11.
  • Supports OpenAI and Azure OpenAI connections via configuration files.
  • Quick start tutorial and VS Code extension available for interactive development.
  • Official Docs: https://github.com/microsoft/promptflow

Highlighted Details

  • End-to-end LLM app development: prototyping, testing, evaluation, deployment, and monitoring.
  • VS Code extension for a visual, interactive flow designer.
  • Supports batch testing and evaluation for production readiness.
  • Integrates with CI/CD pipelines.

Maintenance & Community

  • Open to community contributions via discussions, issues, and PRs.
  • Follows Microsoft Open Source Code of Conduct.
  • Telemetry collection is enabled by default but can be disabled.

Licensing & Compatibility

  • Licensed under the MIT license.
  • Permissive license suitable for commercial use and integration into closed-source applications.

Limitations & Caveats

The project is actively developed, and while it offers a comprehensive suite, users should consult the dev setup guide for contributor-specific requirements and be aware of potential ongoing changes.

Health Check
Last commit

1 week ago

Responsiveness

Inactive

Pull Requests (30d)
17
Issues (30d)
8
Star History
345 stars in the last 90 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera), and
2 more.

prompt-engine by microsoft

0.0%
3k
NPM library for LLM prompt engineering
created 3 years ago
updated 2 years ago
Feedback? Help us improve.