notesGPT is a voice note-taking application that transcribes audio, summarizes content, and extracts action items. It targets users who need to quickly process spoken information and generate actionable tasks, leveraging modern AI services for its core functionality.

How It Works

The application utilizes a stack of specialized services for its operations. Speech-to-text is handled by Replicate's Whisper, while Together.ai's Mixtral model and embeddings power LLM summarization and vector search. Convex provides the backend infrastructure, including database, cloud functions, file storage, and vector search capabilities. Next.js with the App Router manages the frontend, and Clerk handles user authentication.

Quick Start & Requirements

• Install: npm install then npm run dev.
• Prerequisites: Accounts and API keys for Convex, Clerk, Together.ai, and Replicate.
• Setup: Requires configuring environment variables in Convex and a local .env.local file with Clerk and Together/Replicate API keys.
• Docs: Deploy Your Own

Highlighted Details

• Leverages Convex for a unified backend, simplifying deployment and data management.
• Integrates Together.ai's Mixtral for LLM tasks and Whisper via Replicate for transcription.
• Features vector search for efficient retrieval of note content.
• Includes user authentication via Clerk.

Maintenance & Community

The project is maintained by Nutlope. Further community engagement channels are not explicitly listed in the README.

Licensing & Compatibility

The repository does not explicitly state a license. This may pose a restriction for commercial use or linking with closed-source projects.

Limitations & Caveats

The project is in an early stage, with many "Future Tasks" listed, including playback functionality, UI animations, and integrations with services like Notion. The lack of an explicit license is a significant caveat for adoption.