N46Whisper is a Google Colab notebook designed to automate Japanese subtitle generation for video content, specifically targeting fansubbers of the Nogizaka46 and Sakamichi groups. It leverages faster-whisper for efficient speech-to-text transcription and outputs subtitles in ASS format, ready for editing in Aegisub, thereby significantly reducing manual effort.

How It Works

The application utilizes faster-whisper, a reimplementation of OpenAI's Whisper model, offering up to 4x speed improvement and reduced memory usage with comparable accuracy. It processes audio files to generate transcriptions, which are then formatted into Advanced SubStation Alpha (ASS) files. An optional AI translation feature, using OpenAI's API, can append translated text to original lines, creating bilingual subtitles. Users can also split long lines into shorter segments for better readability.

Quick Start & Requirements

• Install/Run: Open the provided Google Colab notebook link.
• Prerequisites: Google account for Colab, OpenAI API key for translation.
• Setup: Upload video file to Colab or Google Drive and follow notebook instructions.
• Links: Click here to open the notebook in Google Colab

Highlighted Details

• Based on faster-whisper for enhanced performance.
• Generates ASS subtitle files with built-in styling.
• Supports AI translation via OpenAI API for bilingual subtitles.
• Offers line splitting for improved readability.
• Allows batch processing of multiple files.

Maintenance & Community

This project will no longer be maintained as of April 17, 2024.

Licensing & Compatibility

• License: MIT License.
• Compatibility: Permissive for commercial use and integration with closed-source projects.

Limitations & Caveats

The project is no longer maintained. While it supports AI translation, users must provide their own OpenAI API key, and free keys have usage limitations. The effectiveness of AI translation depends on the quality of the OpenAI API and the prompt used.