xplique  by deel-ai

Explainability toolbox for neural networks

created 5 years ago
695 stars

Top 50.0% on sourcepulse

GitHubView on GitHub
Project Summary

Xplique is a Python toolkit for neural network explainability, offering a comprehensive suite of tools for understanding complex models. It targets researchers and practitioners in AI, providing methods to analyze model behavior, identify influential features, and extract human-understandable concepts.

How It Works

Xplique is structured into four core modules: Attributions Methods, Feature Visualization, Concepts, and Metrics. It implements state-of-the-art techniques for generating feature attributions (e.g., Grad-CAM, Integrated Gradients), visualizing internal representations, extracting human-interpretable concepts (e.g., CAV, CRAFT), and evaluating explanation quality with various metrics. The library supports both TensorFlow and PyTorch models, with a dedicated wrapper for PyTorch integration.

Quick Start & Requirements

Highlighted Details

  • Supports a wide range of tasks including Classification, Regression, Object Detection, and Semantic Segmentation.
  • Handles various data types: Images, Time Series, and Tabular data.
  • Includes an "Example-based" module for explanations using relevant data samples.
  • Offers a PyTorch wrapper for seamless integration of PyTorch models.

Maintenance & Community

The project is actively developed by the DEEL project team, with contributions welcomed. Further information and community links are available in the README.

Licensing & Compatibility

Released under the MIT license, allowing for commercial use and integration with closed-source projects.

Limitations & Caveats

Some methods may not function as expected with Keras 3.X (TensorFlow 2.16+); TensorFlow 2.15 or earlier is recommended for optimal compatibility. The "Example-based" module is in its early stages.

Health Check
Last commit

9 months ago

Responsiveness

1+ week

Pull Requests (30d)
0
Issues (30d)
0
Star History
8 stars in the last 90 days

Explore Similar Projects

Starred by Dominik Moritz Dominik Moritz(Professor at CMU; ML Researcher at Apple), Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and
2 more.

ecco by jalammar

0%
2k
Python library for interactive NLP model visualization in Jupyter notebooks
created 4 years ago
updated 11 months ago
Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), Elie Bursztein Elie Bursztein(Cybersecurity Lead at Google DeepMind), and
1 more.

alibi by SeldonIO

0.1%
3k
Python library for ML model inspection and interpretation
created 6 years ago
updated 1 month ago
Feedback? Help us improve.