happy-transformer  by EricFillion

NLP Transformer toolkit for fine-tuning and inference

created 5 years ago
537 stars

Top 59.9% on sourcepulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

Happy Transformer simplifies fine-tuning and inference for NLP Transformer models, targeting researchers and developers. It streamlines common NLP tasks like text generation, classification, and question answering, enabling users to quickly deploy and train models.

How It Works

Happy Transformer abstracts away the complexities of the Hugging Face Transformers library, providing a high-level API for various NLP tasks. It automates data splitting for training and evaluation, integrates with Weights & Biases for experiment tracking, and supports distributed training via DeepSpeed and Apple's MPS for accelerated hardware utilization. Models can be directly pushed to the Hugging Face Model Hub.

Quick Start & Requirements

  • Primary install: pip install happytransformer
  • Prerequisites: Python 3.7+
  • Documentation: happytransformer.com

Highlighted Details

  • Supports fine-tuning and inference for Text Generation, Text Classification, Word Prediction, Question Answering, and Text-to-Text tasks.
  • Integrates DeepSpeed for distributed training and Apple's MPS for hardware acceleration.
  • Automatic data splitting for training and evaluation.
  • Direct push to Hugging Face Model Hub.

Maintenance & Community

  • Lead Maintainer: Eric Fillion
  • Maintainer: Ted Brownlow
  • Discord server available for community support.

Licensing & Compatibility

  • License: Not explicitly stated in the README. Compatibility for commercial use or closed-source linking is therefore unclear.

Limitations & Caveats

The README does not specify the license, making commercial use and closed-source integration uncertain. Some tasks like Next Sentence Prediction and Token Classification only support inference, not training.

Health Check
Last commit

3 months ago

Responsiveness

1 week

Pull Requests (30d)
0
Issues (30d)
0
Star History
8 stars in the last 90 days

Explore Similar Projects

Starred by Patrick von Platen Patrick von Platen(Core Contributor to Hugging Face Transformers and Diffusers), Travis Fischer Travis Fischer(Founder of Agentic), and
5 more.

setfit by huggingface

0.3%
3k
Few-shot learning framework for Sentence Transformers
created 3 years ago
updated 3 months ago
Starred by Chip Huyen Chip Huyen(Author of AI Engineering, Designing Machine Learning Systems), Omar Sanseviero Omar Sanseviero(DevRel at Google DeepMind), and
1 more.

BioGPT by microsoft

0.1%
4k
BioGPT is a generative pre-trained transformer for biomedical text
created 3 years ago
updated 1 year ago
Feedback? Help us improve.