python-aiplatform  by googleapis

Python SDK for Vertex AI, an end-to-end platform for data science and ML

created 4 years ago
776 stars

Top 45.9% on sourcepulse

GitHubView on GitHub
1 Expert Loves This Project
Project Summary

This Python SDK provides a comprehensive interface for interacting with Google Cloud's Vertex AI platform, enabling users to manage datasets, train custom and AutoML models, deploy models, perform batch predictions, and orchestrate ML pipelines. It is designed for data scientists and ML engineers who need to build and manage machine learning workflows on Google Cloud.

How It Works

The SDK leverages Google's GAPIC (Google API CodeGen) library, which generates client code from service proto files. It offers a higher-level, more user-friendly abstraction over the raw GAPIC interfaces, simplifying common ML tasks. The library is organized into modules for datasets, training jobs (custom and AutoML), model management, batch predictions, endpoints, and pipelines, providing a structured approach to ML operations.

Quick Start & Requirements

  • Install via pip: pip install google-cloud-aiplatform
  • Prerequisites: Python >= 3.9, Google Cloud project with Vertex AI API enabled, billing enabled, and authentication configured.
  • Setup: Requires virtual environment setup and authentication configuration.
  • Documentation: Client Library Documentation, Product Documentation

Highlighted Details

  • Supports custom training with Python scripts, packages, or containers, reading data from environment variables.
  • Facilitates AutoML training for tabular, image, text, video, and forecasting tasks with configurable optimization objectives.
  • Enables model deployment to endpoints with options for replica scaling and accelerator types.
  • Provides functionality for batch predictions, model evaluation retrieval, and Explainable AI metadata generation.
  • Integrates with Cloud Profiler for debugging training jobs via Vertex AI TensorBoard.

Maintenance & Community

The library is part of the googleapis/google-cloud-python ecosystem, indicating active maintenance by Google. Links to community resources like Discord/Slack are not explicitly provided in the README.

Licensing & Compatibility

The library is released under a permissive license, allowing for commercial use and integration with closed-source applications.

Limitations & Caveats

The SDK is primarily focused on Vertex AI services; features not exposed through the Vertex AI API will not be available. While it supports various ML tasks, users must adhere to specific contracts for custom training scripts regarding data input and model artifact output. The README notes that for Gemini API and Generative AI on Vertex AI, users should refer to the separate "Vertex Generative AI SDK for Python."

Health Check
Last commit

1 day ago

Responsiveness

1 week

Pull Requests (30d)
96
Issues (30d)
201
Star History
52 stars in the last 90 days

Explore Similar Projects

Feedback? Help us improve.