This repository provides a free, hands-on course for learning about Large Language Models (LLMs), LLMOps, and vector databases. It guides users through designing, training, and deploying a real-time financial advisor LLM system, targeting engineers and researchers interested in practical GenAI implementation.

How It Works

The course utilizes a three-pipeline architecture: a training pipeline for fine-tuning an LLM with QLoRA on a proprietary dataset, logging experiments with Comet ML, and deploying via Beam; a streaming pipeline for ingesting financial news from Alpaca, embedding it with Bytewax, and storing it in Qdrant; and an inference pipeline using LangChain to query the vector DB, enhance prompts with context, and serve financial advice via a Gradio UI, also deployed on Beam.

Quick Start & Requirements

• Install/Run: Module-specific setup and execution. Refer to individual module READMEs.
• Prerequisites: Python, Poetry, Beam CLI, AWS CLI, Comet ML account, Qdrant account, Alpaca account.
• Hardware: Minimum 10 GiB VRAM for local training/inference, or utilize serverless options (Beam, AWS).
• Links: [Video Lectures](https://www.youtube.com/playlist?list=PLf-p_r_j4a_00h013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z013z0