promptflow  by microsoft

Suite of tools for LLM app development, from prototype to production

Created 2 years ago
10,741 stars

Top 4.7% on SourcePulse

GitHubView on GitHub
Project Summary

Promptflow is a development suite for building, testing, and deploying LLM-based AI applications, targeting developers and researchers. It aims to simplify prompt engineering and ensure production-quality LLM apps through an end-to-end workflow.

How It Works

Promptflow enables users to create executable "flows" by linking LLMs, prompts, and Python code. It facilitates debugging and iteration by tracing LLM interactions. The system also supports evaluating flow quality and performance on datasets, integrating testing into CI/CD pipelines for robust deployment.

Quick Start & Requirements

  • Install via pip: pip install promptflow promptflow-tools
  • Recommended Python version: 3.9 to 3.11.
  • Supports OpenAI and Azure OpenAI connections via configuration files.
  • Quick start tutorial and VS Code extension available for interactive development.
  • Official Docs: https://github.com/microsoft/promptflow

Highlighted Details

  • End-to-end LLM app development: prototyping, testing, evaluation, deployment, and monitoring.
  • VS Code extension for a visual, interactive flow designer.
  • Supports batch testing and evaluation for production readiness.
  • Integrates with CI/CD pipelines.

Maintenance & Community

  • Open to community contributions via discussions, issues, and PRs.
  • Follows Microsoft Open Source Code of Conduct.
  • Telemetry collection is enabled by default but can be disabled.

Licensing & Compatibility

  • Licensed under the MIT license.
  • Permissive license suitable for commercial use and integration into closed-source applications.

Limitations & Caveats

The project is actively developed, and while it offers a comprehensive suite, users should consult the dev setup guide for contributor-specific requirements and be aware of potential ongoing changes.

Health Check
Last Commit

21 hours ago

Responsiveness

1 day

Pull Requests (30d)
6
Issues (30d)
6
Star History
71 stars in the last 30 days

Explore Similar Projects

Starred by Luis Capelo Luis Capelo(Cofounder of Lightning AI), Addy Osmani Addy Osmani(Head of Chrome Developer Experience at Google), and
23 more.

goose by block

0.8%
20k
Open-source AI agent for automating complex engineering tasks
Created 1 year ago
Updated 20 hours ago
Feedback? Help us improve.