DrWhy  by ModelOriented

XAI toolkit for exploration, explanation, and visualization of predictive models

created 6 years ago
689 stars

Top 50.3% on sourcepulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

DrWhy is a comprehensive suite of R tools for eXplainable AI (XAI), designed to assist data scientists in developing responsible machine learning models. It provides a unified grammar and a structured lifecycle for exploring, explaining, and debugging predictive models, catering to researchers and practitioners focused on model transparency, fairness, and performance.

How It Works

DrWhy employs a model-agnostic approach, wrapping trained predictive models with a generic interface (DALEX) to enable consistent application of various explanation techniques. It categorizes its tools into model adapters, model-agnostic explainers (e.g., Ceteris Paribus, SHAPley values, feature importance), model-specific explainers, and automated exploration tools, facilitating a systematic model development process.

Quick Start & Requirements

  • Install: install.packages("DALEX") (and other packages as needed).
  • Prerequisites: R (version not specified, but generally recent versions are recommended). Some packages may have dependencies on Python libraries via reticulate (e.g., shapper).
  • Resources: Requires trained predictive models and associated validation data.

Highlighted Details

  • Unified grammar and lifecycle for model explanation, inspired by RUP.
  • Model-agnostic explainers compatible with various ML frameworks (scikit-learn, H2O, XGBoost, Keras, etc.) via adapters.
  • Tools for specific XAI tasks: feature importance (ingredients), prediction explanations (iBreakDown), model validation (auditor), bias detection (fairmodels), and concept drift (drifter).
  • Automated reporting and dashboard generation (modelStudio, modelDown).

Maintenance & Community

The project is associated with ModelOriented and has contributions from various researchers. Links to vignettes, tutorials, and a JOSS paper are provided for deeper dives into specific packages.

Licensing & Compatibility

The README does not explicitly state a single overarching license for the entire DrWhy suite. Individual packages may have different licenses. Compatibility for commercial use would require checking each package's specific license.

Limitations & Caveats

The suite is extensive, with many specialized packages; understanding the full scope and interdependencies may require significant effort. Some packages are wrappers for Python libraries, introducing potential complexities in setup and dependency management.

Health Check
Last commit

2 years ago

Responsiveness

1 week

Pull Requests (30d)
0
Issues (30d)
0
Star History
3 stars in the last 90 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), Georgios Konstantopoulos Georgios Konstantopoulos(CTO, General Partner at Paradigm), and
2 more.

maestro by roboflow

0.1%
3k
CLI/SDK for fine-tuning multimodal models
created 1 year ago
updated 5 days ago
Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), Elie Bursztein Elie Bursztein(Cybersecurity Lead at Google DeepMind), and
1 more.

alibi by SeldonIO

0.1%
3k
Python library for ML model inspection and interpretation
created 6 years ago
updated 1 month ago
Feedback? Help us improve.