pytorch_image_classification  by hysts

PyTorch image classification for various datasets (CIFAR, MNIST, ImageNet)

created 7 years ago
1,415 stars

Top 29.3% on sourcepulse

GitHubView on GitHub
Project Summary

This repository provides PyTorch implementations of various state-of-the-art image classification models, including ResNet, WRN, DenseNet, and others, along with popular regularization techniques like Cutout and Mixup. It's designed for researchers and practitioners looking to benchmark and experiment with these architectures and techniques on standard datasets like CIFAR-10/100, MNIST, and ImageNet.

How It Works

The project utilizes a configuration-driven approach, allowing users to specify model architectures, datasets, training parameters, and data augmentation strategies via YAML files. It supports standard training loops, cosine annealing learning rate schedules, and various optimization techniques. The implementation is structured to facilitate easy modification and extension for further research.

Quick Start & Requirements

  • Install: pip install -r requirements.txt
  • Prerequisites: Python >= 3.7, PyTorch >= 1.4.0, torchvision, NVIDIA Apex.
  • Usage: python train.py --config configs/cifar/resnet_preact.yaml
  • Documentation: README

Highlighted Details

  • Implements a wide range of influential architectures (ResNet, WRN, DenseNet, ResNeXt, Shake-Shake, PyramidNet).
  • Integrates numerous regularization and data augmentation techniques (Cutout, Random Erasing, Mixup, RICAP, Dual-Cutout).
  • Provides extensive benchmark results on CIFAR-10, CIFAR-100, MNIST, and FashionMNIST, comparing different models and techniques.
  • Includes experiments on large-batch training, learning rate scaling, and mixed-precision training.

Maintenance & Community

The repository is maintained by hysts. Further community engagement details are not explicitly provided in the README.

Licensing & Compatibility

The repository does not explicitly state a license. Users should verify licensing for commercial or closed-source use.

Limitations & Caveats

The project is primarily tested on Ubuntu and may not work on other operating systems. Some experiments require specific hardware like NVIDIA GPUs and potentially Apex for mixed-precision training. Training times can be substantial, especially for larger models and datasets.

Health Check
Last commit

3 years ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
19 stars in the last 90 days

Explore Similar Projects

Starred by Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake).

fms-fsdp by foundation-model-stack

0.4%
258
Efficiently train foundation models with PyTorch
created 1 year ago
updated 1 week ago
Starred by Aravind Srinivas Aravind Srinivas(Cofounder of Perplexity), Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and
12 more.

DeepSpeed by deepspeedai

0.2%
40k
Deep learning optimization library for distributed training and inference
created 5 years ago
updated 1 day ago
Feedback? Help us improve.