Jarvis  by Concept-Bytes

AI assistant for voice-driven conversations

Created 2 years ago
259 stars

Top 98.4% on SourcePulse

GitHubView on GitHub
Project Summary

<2-3 sentences summarising what the project addresses and solves, the target audience, and the benefit.> Concept-Bytes/Jarvis is a Python script that emulates a conversational AI assistant, akin to Iron Man's Jarvis. It targets users seeking a personal AI assistant capable of real-time voice interaction, leveraging advanced OpenAI models for speech recognition, intelligent response generation, and text-to-speech output, offering a seamless, hands-free user experience.

How It Works

Jarvis integrates OpenAI's state-of-the-art models: Whisper V3 for highly accurate real-time speech-to-text conversion, GPT-3.5 Turbo for context-aware natural language understanding and response generation, and OpenAI's TTS for verbalizing assistant replies. The system also features hotword detection, allowing it to actively listen for trigger words to initiate interaction, creating a responsive and interactive conversational flow.

Quick Start & Requirements

  • Primary install / run command: pip install openai speechrecognition torch followed by python jarvis.py.
  • Non-default prerequisites and dependencies: Python 3.9+, OpenAI API access (Whisper, GPT, TTS models), SpeechRecognition library, PyTorch. Users must obtain an Assistant ID and Thread ID from https://platform.openai.com/assistants. A configured microphone set as the default recording device is essential.
  • Command Line Arguments: Control Whisper model size (--model with options: tiny, base, small, medium, large), non-English models (--non_english), and speech detection parameters (--energy_threshold, --record_timeout, --phrase_timeout).
  • Configuration: Customize trigger words via the hot_words list and tune speech detection parameters within the script.

Highlighted Details

  • Real-time speech recognition powered by OpenAI's Whisper V3.
  • Intelligent, context-aware response generation using GPT-3.5 Turbo.
  • Seamless conversational experience with OpenAI Text-to-Speech output.
  • Active hotword detection for initiating commands.

Maintenance & Community

No specific details regarding maintainers, community channels (like Discord/Slack), or roadmaps were provided in the README. Contact is suggested via GitHub or email for feedback and support.

Licensing & Compatibility

  • License type: MIT License.
  • Compatibility notes: The MIT license generally permits commercial use and integration into closed-source projects, provided the license terms are followed. However, functionality is dependent on access to OpenAI's proprietary APIs.

Limitations & Caveats

The script requires valid OpenAI API keys and model access privileges. Initial model loading may incur a delay. The quality of TTS output and overall responsiveness are contingent upon the selected models and the system's performance capabilities. Proper microphone setup and configuration are critical for optimal operation.

Health Check
Last Commit

2 years ago

Responsiveness

Inactive

Pull Requests (30d)
0
Issues (30d)
0
Star History
0 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.