Summary HoloAgent is a unified embodied-agent framework for general-purpose robots, addressing autonomous task execution through multi-modal perception, 3D spatial memory, and intelligent interaction. It provides a foundation for robots capable of complex navigation, manipulation, and user engagement, targeting researchers and engineers in advanced robotics.

How It Works The framework integrates Embodied AgentOS for high-level task planning and closed-loop execution, a 3D Spatial Memory for grounding robot reasoning in physical-world representations, and Embodied Skills to translate agent decisions into executable robot actions. AgentOS orchestrates a feedback loop encompassing spatial retrieval, execution monitoring, memory updates, and recovery. The FSR-VLN module enhances navigation via a Hierarchical Multi-modal Scene Graph, enabling efficient long-range spatial reasoning.

Quick Start & Requirements Refer to docs/user_guide/Intruduction.md for system introduction, dependency preparation, build instructions, runtime configuration, and deployment. A Docker image is available.

• Project Page: https://horizonrobotics.github.io/robot_lab/holoagent/
• arXiv Paper: https://arxiv.org/abs/2606.23565
• Dataset: https://huggingface.co/datasets/HorizonRobotics/fsrvln_datasets
• Docker Image: https://github.com/users/zhaoyu199201/packages/container/package/holoagent

Highlighted Details

• Features extensive real-robot demonstrations: navigation, long-horizon mobile manipulation, active exploration, interactive command execution.
• FSR-VLN component employs a Hierarchical Multi-modal Scene Graph for efficient, long-range vision-language navigation.
• Integrates Doubao LLM for enhanced chatbot speech interaction.
• AgentOS Harness supports secure isolation for background processes and skill triggering via Skill/Blueprint mechanisms.

Maintenance & Community HoloAgent-0 released June 2026; HoloAgent-1 expected end of 2026. Project lists completed HoloAgent-0 features; ongoing development for HoloBrain, HoloMotion, and vision-only autonomy. Key inspirations: OVO, HOV-SG, rerun, dimos, openclaw. No direct community links provided.

Licensing & Compatibility Licensed under Apache License 2.0, permissive for commercial use and closed-source integration.

Limitations & Caveats HoloAgent-0 code is under preparation, release imminent. Future components like HoloAgent-1, HoloBrain (dexterous manipulation), HoloMotion (whole-body manipulation), and vision-only autonomy are planned but not yet available.