PANORAMA: The Rise of Omnidirectional Vision in the Embodied AI Era
Omnidirectional vision, using 360-degree vision to understand the
environment, has become increasingly critical across domains like robotics,
industrial inspection, and environmental monitoring. Compared to traditional
pinhole vision, omnidirectional vision provides holistic environmental
awareness, significantly enhancing the completeness of scene perception and the
reliability of decision-making. However, foundational research in this area has
historically lagged behind traditional pinhole vision. This talk presents an
emerging trend in the embodied AI era: the rapid development of omnidirectional
vision, driven by growing industrial demand and academic interest. We highlight
recent breakthroughs in omnidirectional generation, omnidirectional perception,
omnidirectional understanding, and related datasets. Drawing on insights from
both academia and industry, we propose an ideal panoramic system architecture
in the embodied AI era, PANORAMA, which consists of four key subsystems.
Moreover, we offer in-depth opinions related to emerging trends and
cross-community impacts at the intersection of panoramic vision and embodied
AI, along with the future roadmap and open challenges. This overview
synthesizes state-of-the-art advancements and outlines challenges and
opportunities for future research in building robust, general-purpose
omnidirectional AI systems in the embodied AI era.
68cbc9354d15e6fae7acb379
Xu Zheng
68cbc9354d15e6fae7acb37a
Chenfei Liao
68cbc9354d15e6fae7acb37b
Ziqiao Weng
68cbc9354d15e6fae7acb37c
Kaiyu Lei
68cbc9354d15e6fae7acb37d
Zihao Dongfang
68cbc9354d15e6fae7acb37e
Haocong He
68cbc9354d15e6fae7acb37f
Yuanhuiyi Lyu
68cbc9354d15e6fae7acb380
Lutao Jiang
claimed_verified
2025-09-18T13:25:42.443Z
65d61d8fd484956b5acc89fe
/avatars/47954232c90780ffe898a5a445f7fb0a.svg
Lutao Jiang
user
LutaoJiang
68cbc9354d15e6fae7acb381
Lu Qi
68cbc9354d15e6fae7acb382
Li Chen
68cbc9354d15e6fae7acb383
Danda Pani Paudel
68cbc9354d15e6fae7acb384
Kailun Yang
68cbc9354d15e6fae7acb385
Linfeng Zhang
68cbc9354d15e6fae7acb386
Luc Van Gool
68cbc9354d15e6fae7acb387
Xuming Hu
PANORAMA: The Rise of Omnidirectional Vision in the Embodied AI Era
Omnidirectional vision, using 360-degree vision to understand the
environment, has become increasingly critical across domains like robotics,
industrial inspection, and environmental monitoring. Compared to traditional
pinhole vision, omnidirectional vision provides holistic environmental
awareness, significantly enhancing the completeness of scene perception and the
reliability of decision-making. However, foundational research in this area has
historically lagged behind traditional pinhole vision. This talk presents an
emerging trend in the embodied AI era: the rapid development of omnidirectional
vision, driven by growing industrial demand and academic interest. We highlight
recent breakthroughs in omnidirectional generation, omnidirectional perception,
omnidirectional understanding, and related datasets. Drawing on insights from
both academia and industry, we propose an ideal panoramic system architecture
in the embodied AI era, PANORAMA, which consists of four key subsystems.
Moreover, we offer in-depth opinions related to emerging trends and
cross-community impacts at the intersection of panoramic vision and embodied
AI, along with the future roadmap and open challenges. This overview
synthesizes state-of-the-art advancements and outlines challenges and
opportunities for future research in building robust, general-purpose
omnidirectional AI systems in the embodied AI era.
Recent advancements in omnidirectional vision, driven by industrial and academic interest, have led to breakthroughs in generation, perception, and understanding, with the proposal of a new system architecture called PANORAMA.
omnidirectional vision 360-degree vision pinhole vision omnidirectional generation omnidirectional perception omnidirectional understanding panoramic system architecture PANORAMA embodied AI