tf-keras-vis  by keisen

Keras visualization toolkit for debugging TensorFlow models

Created 5 years ago
331 stars

Top 82.7% on SourcePulse

GitHubView on GitHub
Project Summary

This toolkit provides visualization methods for debugging tf.keras models, targeting deep learning practitioners and researchers. It enables understanding model behavior through techniques like activation maximization and various saliency maps, aiding in model interpretation and debugging.

How It Works

The library offers a flexible API for generating visualizations by accepting a tf.keras.Model and optional model_modifier classes. These modifiers can alter the model, for instance, by replacing the final layer's activation to linear. Users specify visualization targets using Score classes and can enhance the process with input modifiers (e.g., Jitter, Rotate2D) and regularizers (e.g., TotalVariation2D, Norm). The library supports N-dimensional image inputs, batch processing, and models with multiple inputs/outputs.

Quick Start & Requirements

Highlighted Details

  • Supports Activation Maximization, Class Activation Maps (GradCAM, GradCAM++, ScoreCAM, Faster-ScoreCAM, LayerCAM), and Saliency Maps (Vanilla Saliency, SmoothGrad).
  • Handles N-dim image inputs, batch processing, and complex model architectures (multiple inputs/outputs, mixed precision).
  • Offers customizable input modifiers and regularizers for fine-tuning visualizations.
  • Includes callbacks like Progress for monitoring visualization generation.

Maintenance & Community

The project appears to be actively maintained, with recent updates and a clear roadmap for future features like Deep Dream and Style Transfer.

Licensing & Compatibility

The repository does not explicitly state a license in the provided README. Users should verify licensing for commercial or closed-source use.

Limitations & Caveats

Activation Maximization may produce blurry images with InceptionV3. GradCAM and GradCAM++ may encounter issues with cascading models, recommending FasterScoreCAM as an alternative. Channel-first models and data are not supported.

Health Check
Last Commit

6 months ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
0 stars in the last 30 days

Explore Similar Projects

Starred by Chip Huyen Chip Huyen(Author of "AI Engineering", "Designing Machine Learning Systems") and Kevin Hou Kevin Hou(Head of Product Engineering at Windsurf).

ImageAI by OlafenwaMoses

0.0%
9k
Python library for computer vision tasks
Created 7 years ago
Updated 1 year ago
Feedback? Help us improve.