examples  by graphcore

ML examples for Graphcore IPUs, training and inference

created 7 years ago
323 stars

Top 85.3% on sourcepulse

GitHubView on GitHub
Project Summary

This repository provides a comprehensive collection of optimized machine learning examples for Graphcore Intelligence Processing Units (IPUs), covering domains like NLP, Computer Vision, Speech, and GNNs. It targets researchers and developers seeking to leverage IPUs for high-performance training and inference, offering reproducible code and integration with popular ML frameworks.

How It Works

The examples are designed to run on Graphcore IPUs, utilizing the Poplar SDK. They are structured by problem domain and model, with implementations available across various frameworks including PyTorch, TensorFlow 2, Hugging Face Optimum, and PopXL. This approach allows users to easily access and adapt state-of-the-art models optimized for IPU hardware.

Quick Start & Requirements

  • Installation: Requires Poplar SDK 3.2.x.
  • Environment: Tested with Ubuntu 20.04 and Python 3.8.
  • Resources: Users must install and enable the Poplar SDK according to their IPU system's Getting Started guide.
  • Documentation: Software documentation, tutorials, and how-to videos are available.

Highlighted Details

  • Extensive model coverage: NLP (BERT, GPT2, GPT-J, Bloom), Computer Vision (ResNet, EfficientNet, ViT, DINO), Speech (Conformer, wav2vec2, Whisper), GNNs, and more.
  • Framework integration: Supports PyTorch, TensorFlow 2, Hugging Face Optimum, PopXL, and PaddlePaddle.
  • Benchmarking tools: Includes examples-utils for running and reproducing performance benchmarks.
  • PopVision Tools: For visualizing and optimizing model performance on IPUs.

Maintenance & Community

  • Active development with regular model additions and framework updates.
  • Support channels include GitHub issues, email (support@graphcore.ai), and a Slack community (#help).
  • Roadmap and performance results are available on linked pages.

Licensing & Compatibility

  • The top-level LICENSE file applies unless specified otherwise in subdirectories. Specific licenses for individual models are not detailed in the README.
  • Compatibility for commercial use or closed-source linking is not explicitly stated.

Limitations & Caveats

  • PopART applications are deprecated and removed. TensorFlow 1 applications are also deprecated.
  • Specific hardware configurations (e.g., POD128/POD256) may require direct engineering support.
Health Check
Last commit

1 year ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
1 stars in the last 90 days

Explore Similar Projects

Starred by Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera), Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), and
2 more.

serve by pytorch

0.1%
4k
Serve, optimize, and scale PyTorch models in production
created 5 years ago
updated 3 weeks ago
Starred by Andrej Karpathy Andrej Karpathy(Founder of Eureka Labs; Formerly at Tesla, OpenAI; Author of CS 231n), Nat Friedman Nat Friedman(Former CEO of GitHub), and
32 more.

llama.cpp by ggml-org

0.4%
84k
C/C++ library for local LLM inference
created 2 years ago
updated 18 hours ago
Feedback? Help us improve.