Grendel-GS  by nyu-systems

Research paper on distributed training system for 3D Gaussian Splatting

created 1 year ago
571 stars

Top 57.3% on sourcepulse

GitHubView on GitHub
Project Summary

Grendel-GS provides a distributed training system for 3D Gaussian Splatting (3DGS), enabling faster training, support for more Gaussians, and reconstruction of larger, higher-resolution scenes. It's designed as a drop-in replacement for existing 3DGS workflows, targeting researchers and practitioners needing to scale 3DGS capabilities.

How It Works

Grendel-GS extends the original 3DGS implementation with distributed training capabilities using PyTorch's torchrun. It supports larger batch sizes and leverages multiple GPUs to accelerate training and reduce memory per GPU. The system maintains the core 3DGS algorithm, ensuring compatibility while offering performance gains.

Quick Start & Requirements

  • Install: Clone with --recursive and use conda env create --file environment.yml.
  • Prerequisites: Conda, compatible GPU drivers, CUDA environment, PyTorch >= 1.10. Requires compiling custom CUDA kernels for diff-gaussian-rasterization and simple-knn.
  • Dataset: COLMAP format datasets (e.g., Mip360, Tanks&Temples).
  • Links: Paper, Project Page

Highlighted Details

  • Achieves >3.5x faster training on Mip360 with 4 GPUs and batch size 4.
  • Enables training large-scale 4K scenes with >40 million Gaussians without OOM.
  • Trains scenes like "Truck" from Tanks&Temples to PSNR 23.79 in 45 seconds (7k iterations) on 4 GPUs.
  • Supports gsplat as an alternative CUDA backend.

Maintenance & Community

  • Actively developed by NYU Systems.
  • Contact: hz3496@nyu.edu for collaboration/contributions.

Licensing & Compatibility

  • Apache License Version 2.0.
  • Compatible with commercial use and closed-source linking.

Limitations & Caveats

The repository currently focuses on training and rendering; it does not include interactive or network viewers found in the original 3DGS codebase. Support for additional features is under development.

Health Check
Last commit

1 month ago

Responsiveness

1 day

Pull Requests (30d)
0
Issues (30d)
3
Star History
55 stars in the last 90 days

Explore Similar Projects

Starred by Tri Dao Tri Dao(Chief Scientist at Together AI), Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and
1 more.

oslo by tunib-ai

0%
309
Framework for large-scale transformer optimization
created 3 years ago
updated 2 years ago
Starred by Jeff Hammerbacher Jeff Hammerbacher(Cofounder of Cloudera) and Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake).

InternEvo by InternLM

1.0%
402
Lightweight training framework for model pre-training
created 1 year ago
updated 1 week ago
Starred by Aravind Srinivas Aravind Srinivas(Cofounder of Perplexity), Stas Bekman Stas Bekman(Author of Machine Learning Engineering Open Book; Research Engineer at Snowflake), and
12 more.

DeepSpeed by deepspeedai

0.2%
40k
Deep learning optimization library for distributed training and inference
created 5 years ago
updated 1 day ago
Feedback? Help us improve.