BiliNote is an AI-powered video note-taking assistant designed for users who want to automatically generate structured Markdown notes from online videos. It supports platforms like Bilibili and YouTube, offering features such as AI summarization, automatic transcription, screenshot insertion, and original video timestamp linking.

How It Works

The tool leverages a backend FastAPI application and a frontend built with Vite and React. It utilizes FFmpeg for audio processing and can integrate with local or cloud-based LLMs (like OpenAI, DeepSeek, Qwen) for content summarization. For audio transcription, it supports Fast-Whisper, with optional CUDA acceleration for NVIDIA GPUs. The process involves fetching video content, transcribing audio, summarizing with an LLM, and formatting the output into Markdown.

Quick Start & Requirements

• Installation: Clone the repository, install backend dependencies (pip install -r requirements.txt), and start the backend (python main.py). Then, install frontend dependencies (pnpm install) and run the frontend (pnpm dev).
• Prerequisites: FFmpeg must be installed and added to the system's PATH. CUDA is optional for GPU acceleration.
• Setup: Requires Python 3.x, Node.js, pnpm, and FFmpeg.
• Links: Experience Address

Highlighted Details

• Supports Bilibili, YouTube, and local videos.
• Offers customizable note formats, styles, and LLM prompts.
• Includes optional screenshot insertion and video timestamp linking.
• Supports local model audio transcription via Fast-Whisper.

Maintenance & Community

• Active development with recent updates (v1.1.0) adding style and format selection, custom prompts, and task retries.
• Community support via QQ group (785367111) and WeChat group.

Licensing & Compatibility

• License: MIT License.
• Compatibility: Permissive MIT license allows for commercial use and integration with closed-source projects.

Limitations & Caveats

The project is currently undergoing active development, with planned support for additional platforms like Douyin and Kuaishou. The web demo hosted on Cloudflare Pages may experience performance issues. Users are advised to run the Windows executable in an environment without Chinese characters in the path.