Vibe Draw is an AI-powered tool that transforms 2D sketches into 3D models and worlds, targeting creators and designers who want to bypass complex 3D modeling software. It aims to make 3D content creation accessible and intuitive, enabling rapid iteration and export to existing workflows.

How It Works

The system employs a multi-stage AI pipeline. Users sketch on a 2D canvas (using TLDraw), which is then refined by an AI model. This enhanced 2D drawing is subsequently converted into a 3D model. Users can further iterate on these models via sketching or text prompts, and the resulting 3D world can be exported in glTF format. The architecture leverages Next.js/React for the frontend, Three.js for 3D rendering, and FastAPI with Celery/Redis for the backend AI processing and asynchronous tasks.

Quick Start & Requirements

• Frontend: cd frontend && npm install && npm run dev
• Backend: cd backend && cp .env.example .env && docker compose up
• Prerequisites: Node.js 18+, Python 3.10+, API keys for Claude, Gemini, Cerebras, and PiAPI.
• Setup: Requires configuring API keys and running separate frontend and backend services.

Highlighted Details

• Transforms rough sketches into detailed 3D models.
• Enables iterative refinement via sketching or text prompts.
• Exports 3D worlds in standard glTF format.
• Utilizes a stack including Next.js, React, Three.js, FastAPI, Celery, and Redis.

Maintenance & Community

No specific community links or contributor information are provided in the README.

Licensing & Compatibility

• License: AGPL.
• Compatibility: The AGPL license may impose copyleft restrictions on derivative works, potentially impacting integration with closed-source commercial applications.

Limitations & Caveats

The project requires multiple API keys for various AI models, which may incur costs. The AGPL license necessitates careful consideration for commercial use or integration into proprietary software.