StoryToolkitAI  by octimot

AI film editing tool for efficient footage understanding

created 2 years ago
840 stars

Top 43.3% on sourcepulse

GitHubView on GitHub
Project Summary

StoryToolkitAI is an AI-powered video editing assistant designed for filmmakers and editors to streamline post-production workflows. It offers local transcription, content indexing, and AI-driven story generation, enabling efficient searching and editing of footage, with export options for professional editing software.

How It Works

The tool leverages multiple AI models, including OpenAI Whisper for transcription and translation, and various LLMs (OpenAI GPT-4, Llama, DeepSeek) for content understanding and story creation. It indexes video content locally, allowing for intuitive, semantic search without exact keyword matching. This approach aims to reduce manual effort in reviewing footage and identifying key moments for editing.

Quick Start & Requirements

  • Installation: Download standalone releases from the releases page or install from source for the latest features.
  • Prerequisites: Local LLM compatibility (OpenAI, ollama, vLLM, LM Studio), DaVinci Resolve Studio 18+ for specific integrations.
  • Resources: Runs locally; resource usage depends on video file size and AI model complexity.

Highlighted Details

  • Automatic transcription and translation to English performed locally.
  • AI-assisted story generation and content selection using LLMs.
  • Integration with DaVinci Resolve Studio for timeline navigation and marker synchronization.
  • Supports multiple transcript export formats (SRT, TXT, AVID DS, Fusion Text).

Maintenance & Community

Actively developed by a small team, with daily use in their editing room. Code contributions are welcome via GitHub issues. Community support and feature requests can be found on GitHub.

Licensing & Compatibility

The tool itself appears to be open source, relying on other open-source projects. Specific licensing details for StoryToolkitAI are not explicitly stated in the README, but it is noted that core features are free to run locally. Commercial use compatibility is not detailed.

Limitations & Caveats

The tool is described as "raw and unpolished" and is still under active development. Some features are currently exclusive to non-standalone versions or planned for future releases. An API key check to storytoolkit.ai and the Assistant feature (when using external LLMs) involve sending data over the internet.

Health Check
Last commit

5 months ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
0
Star History
35 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.