jetson-examples  by Seeed-Projects

One-line AI model deployment for NVIDIA Jetson devices

Created 1 year ago
252 stars

Top 99.6% on SourcePulse

GitHubView on GitHub
Project Summary

The jetson-examples repository by Seeed Studio simplifies the deployment of advanced AI and Generative AI models on NVIDIA Jetson devices. It targets developers and researchers working with edge AI hardware, offering a one-line command interface to run complex models, thereby accelerating development and experimentation.

How It Works

This project builds upon jetson-containers to provide pre-configured Docker images and simplified execution commands. Users can deploy a variety of AI applications, including computer vision, text generation, and image generation, by running a single reComputer run <example_name> command. This approach abstracts away complex setup and dependency management, enabling rapid prototyping and deployment on Jetson platforms.

Quick Start & Requirements

  • Installation: pip3 install jetson-examples
  • Running Examples: Use the reComputer run <example_name> command (e.g., reComputer run llava).
  • Prerequisites: NVIDIA Jetson devices. Sufficient disk space is required; for instance, LLaVA requires approximately 27.4GB.
  • Documentation: Installation details can be found at ./docs/install.md, and more examples are listed in ./docs/examples.md.

Highlighted Details

  • Supports a wide range of AI applications: Computer Vision (e.g., Ultralytics-yolo, Yolov10, Depth-Anything), Generative AI (e.g., Stable-diffusion-webui), and Large Language Models (e.g., Llama3, LLaVA).
  • Provides pre-built Docker images for various examples, with sizes ranging from approximately 5.74GB (Yolov10) to 20.3GB (Live LLaVA).
  • Includes examples for specialized tasks like face-swapping (Deep-Live-Cam) and vector databases (Nanodb).

Maintenance & Community

  • A Discord community is available via Discord.
  • The project actively encourages contributions, offering a $250 cash bonus for submitted examples, with a clear development guide and contributor project board.

Licensing & Compatibility

  • The project is licensed under the MIT License, which permits commercial use and modification.

Limitations & Caveats

  • The project has several outstanding TODO items, including automatic host environment detection, explicit JetPack version support checking, and pre-run disk space verification.
  • Some examples are marked as "new" (🆕), suggesting ongoing development or recent additions.
Health Check
Last Commit

4 months ago

Responsiveness

Inactive

Pull Requests (30d)
1
Issues (30d)
0
Star History
6 stars in the last 30 days

Explore Similar Projects

Feedback? Help us improve.