DrWhy  by ModelOriented

XAI toolkit for exploration, explanation, and visualization of predictive models

Created 7 years ago
689 stars

Top 49.3% on SourcePulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

DrWhy is a comprehensive suite of R tools for eXplainable AI (XAI), designed to assist data scientists in developing responsible machine learning models. It provides a unified grammar and a structured lifecycle for exploring, explaining, and debugging predictive models, catering to researchers and practitioners focused on model transparency, fairness, and performance.

How It Works

DrWhy employs a model-agnostic approach, wrapping trained predictive models with a generic interface (DALEX) to enable consistent application of various explanation techniques. It categorizes its tools into model adapters, model-agnostic explainers (e.g., Ceteris Paribus, SHAPley values, feature importance), model-specific explainers, and automated exploration tools, facilitating a systematic model development process.

Quick Start & Requirements

  • Install: install.packages("DALEX") (and other packages as needed).
  • Prerequisites: R (version not specified, but generally recent versions are recommended). Some packages may have dependencies on Python libraries via reticulate (e.g., shapper).
  • Resources: Requires trained predictive models and associated validation data.

Highlighted Details

  • Unified grammar and lifecycle for model explanation, inspired by RUP.
  • Model-agnostic explainers compatible with various ML frameworks (scikit-learn, H2O, XGBoost, Keras, etc.) via adapters.
  • Tools for specific XAI tasks: feature importance (ingredients), prediction explanations (iBreakDown), model validation (auditor), bias detection (fairmodels), and concept drift (drifter).
  • Automated reporting and dashboard generation (modelStudio, modelDown).

Maintenance & Community

The project is associated with ModelOriented and has contributions from various researchers. Links to vignettes, tutorials, and a JOSS paper are provided for deeper dives into specific packages.

Licensing & Compatibility

The README does not explicitly state a single overarching license for the entire DrWhy suite. Individual packages may have different licenses. Compatibility for commercial use would require checking each package's specific license.

Limitations & Caveats

The suite is extensive, with many specialized packages; understanding the full scope and interdependencies may require significant effort. Some packages are wrappers for Python libraries, introducing potential complexities in setup and dependency management.

Health Check
Last Commit

2 years ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
0 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Travis Addair Travis Addair(Cofounder of Predibase), and
4 more.

alibi by SeldonIO

0.1%
3k
Python library for ML model inspection and interpretation
Created 6 years ago
Updated 14 hours ago
Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems"), Gabriel Almeida Gabriel Almeida(Cofounder of Langflow), and
5 more.

lit by PAIR-code

0.1%
4k
Interactive ML model analysis tool for understanding model behavior
Created 5 years ago
Updated 3 weeks ago
Feedback? Help us improve.