happy-transformer  by EricFillion

NLP Transformer toolkit for fine-tuning and inference

Created 6 years ago
540 stars

Top 58.9% on SourcePulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

Happy Transformer simplifies fine-tuning and inference for NLP Transformer models, targeting researchers and developers. It streamlines common NLP tasks like text generation, classification, and question answering, enabling users to quickly deploy and train models.

How It Works

Happy Transformer abstracts away the complexities of the Hugging Face Transformers library, providing a high-level API for various NLP tasks. It automates data splitting for training and evaluation, integrates with Weights & Biases for experiment tracking, and supports distributed training via DeepSpeed and Apple's MPS for accelerated hardware utilization. Models can be directly pushed to the Hugging Face Model Hub.

Quick Start & Requirements

  • Primary install: pip install happytransformer
  • Prerequisites: Python 3.7+
  • Documentation: happytransformer.com

Highlighted Details

  • Supports fine-tuning and inference for Text Generation, Text Classification, Word Prediction, Question Answering, and Text-to-Text tasks.
  • Integrates DeepSpeed for distributed training and Apple's MPS for hardware acceleration.
  • Automatic data splitting for training and evaluation.
  • Direct push to Hugging Face Model Hub.

Maintenance & Community

  • Lead Maintainer: Eric Fillion
  • Maintainer: Ted Brownlow
  • Discord server available for community support.

Licensing & Compatibility

  • License: Not explicitly stated in the README. Compatibility for commercial use or closed-source linking is therefore unclear.

Limitations & Caveats

The README does not specify the license, making commercial use and closed-source integration uncertain. Some tasks like Next Sentence Prediction and Token Classification only support inference, not training.

Health Check
Last Commit

1 day ago

Responsiveness

Inactive

Pull Requests (30d)
2
Issues (30d)
0
Star History
2 stars in the last 30 days

Explore Similar Projects

Starred by Elvis Saravia Elvis Saravia(Founder of DAIR.AI) and Stas Bekman Stas Bekman(Author of "Machine Learning Engineering Open Book"; Research Engineer at Snowflake).

awesome-transformer-nlp by cedrickchee

0%
1k
Curated list of NLP resources for Transformer networks
Created 6 years ago
Updated 10 months ago
Feedback? Help us improve.