ShortGPT is an experimental AI framework designed to automate the creation of short-form video content for platforms like YouTube Shorts and TikTok. It targets content creators and channel managers seeking to streamline production by automating script generation, footage sourcing, voiceover synthesis, and editing. The framework aims to significantly reduce the manual effort involved in producing a high volume of engaging video content.

How It Works

ShortGPT employs a modular engine-based architecture. The ContentShortEngine and ContentVideoEngine handle core video creation tasks, from scriptwriting to final rendering, incorporating features like LLM-driven editing markup language and automated asset sourcing from Pexels and Bing Image. The ContentTranslationEngine specifically addresses multilingual content by transcribing, translating, and re-voicing videos. Persistence of editing variables is managed via TinyDB.

Quick Start & Requirements

• Recommended: Google Colab notebook (free, no setup required): https://colab.research.google.com/drive/1_2UKdpF6lqxCqWaAcZb3rwMVQqtbisdE?usp=sharing
• Local: Requires Docker.
  • Build: docker build -t short_gpt_docker:latest .
  • Run: docker run -p 31415:31415 --env-file .env short_gpt_docker:latest
• Dependencies: Moviepy, OpenAI, ElevenLabs, EdgeTTS, Pexels API, Bing Image API.

Highlighted Details

• Supports over 30 languages for voiceovers using EdgeTTS and ElevenLabs.
• Automated video editing via an LLM-oriented markup language.
• Integrates with Pexels and Bing Image for asset sourcing.
• Includes a translation engine for dubbing and re-voicing videos.

Maintenance & Community

The project is open to contributions. Further documentation is noted as "incomming."

Licensing & Compatibility

The repository does not explicitly state a license in the provided README.

Limitations & Caveats

The project is described as "experimental." Local installation requires Docker, and the README directs users to a separate installation-notes.md file for more details, which was not provided. The availability and cost of OpenAI and ElevenLabs API keys are implicit requirements for full functionality.