This project provides an end-to-end solution for generating AI-powered video tutorials, complete with animated characters and slide-based explanations. It targets content creators, educators, and developers looking to automate video production for educational or explanatory content, offering a customizable and engaging way to present information.

How It Works

The system generates a tutorial script using Cohere's language model, allowing for customization of creativity, humor, and explanation level. It then leverages Edge TTS for high-quality voiceovers and SadTalker for character facial animation. Relevant images for slides are sourced from Google. The generated audio and character animations are combined with slide images, with flexible positioning of the character and slides (left, right, or background) to create the final video. The backend is built with FastAPI, and the frontend uses Next.js and Tailwind CSS.

Quick Start & Requirements

• Install backend dependencies: pip install -r requirements.txt (after activating a Python virtual environment).
• Install SadTalker separately and ensure its directory is within the backend directory.
• Add Cohere API key to backend/apikeys.json.
• Run frontend: Navigate to frontend/topic2explanation and run npm run dev.
• Run backend: Navigate to backend and run uvicorn main:app.
• Requires Python 3.x, Node.js, and a Cohere API key (trial available).

Highlighted Details

• AI-generated scripts with customizable creativity, humor, and explanation level.
• Character facial animation via SadTalker.
• High-quality voiceovers using Edge TTS.
• Automatic image sourcing from Google for slides.
• Flexible video composition with character and slide placement.

Maintenance & Community

The project is maintained by AkshitIreddy. Links to LinkedIn, GitHub, Medium, and Twitter are provided for the author.

Licensing & Compatibility

The repository does not explicitly state a license.

Limitations & Caveats

The project requires specific setup for SadTalker, including its placement within the backend directory. Customization of character and voice requires manual modification of code and placement of character images in a specific resolution. The lack of an explicit license may pose compatibility concerns for commercial or closed-source use.