Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using
  Sparse RGB Cameras
In this paper, we present a low-budget and high-authenticity bidirectional
telepresence system, Tele-Aloha, targeting peer-to-peer communication
scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse
RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve
high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms)
and robust distant communication. As the core of Tele-Aloha, we propose an
efficient novel view synthesis algorithm for upper-body. Firstly, we design a
cascaded disparity estimator for obtaining a robust geometry cue. Additionally
a neural rasterizer via Gaussian Splatting is introduced to project latent
features onto target view and to decode them into a reduced resolution.
Further, given the high-quality captured data, we leverage weighted blending
mechanism to refine the decoded image into the final resolution of 2K.
Exploiting world-leading autostereoscopic display and low-latency iris
tracking, users are able to experience a strong three-dimensional sense even
without any wearable head-mounted display device. Altogether, our telepresence
system demonstrates the sense of co-presence in real-life experiments,
inspiring the next generation of communication.
6650a2c5607894ea804c6f8c
Hanzhang Tu
6650a2c5607894ea804c6f8d
Ruizhi Shao
admin_assigned
2024-05-24T15:10:07.128Z
64785ad575a9a0cfabcf5083
/avatars/5b8526bf2d8389310ca1799655cbbcd8.svg
Ruizhi Shao
user
DSaurus
6650a2c5607894ea804c6f8e
Xue Dong
6650a2c5607894ea804c6f8f
Shunyuan Zheng
6650a2c5607894ea804c6f90
Hao Zhang
6650a2c5607894ea804c6f91
Lili Chen
6650a2c5607894ea804c6f92
Meili Wang
admin_assigned
2024-05-24T15:11:45.224Z
661f35f65113774d1d21be17
/avatars/5f3c502c28a256c191363bc2d6886905.svg
Wang Meiling
user
Amling2024
6650a2c5607894ea804c6f93
Wenyu Li
6650a2c5607894ea804c6f94
Siyan Ma
6650a2c5607894ea804c6f95
Shengping Zhang
6650a2c5607894ea804c6f96
Boyao Zhou
6650a2c5607894ea804c6f97
Yebin Liu
admin_assigned
2024-05-24T15:12:55.947Z
62e14dbe4db2175cd2735a80
/avatars/e6385dcedcb97e1b36281b49210321aa.svg
Yebin Liu
user
YebinLiu
Tele-Aloha: A Low-budget and High-authenticity Telepresence System Using
  Sparse RGB Cameras
In this paper, we present a low-budget and high-authenticity bidirectional
telepresence system, Tele-Aloha, targeting peer-to-peer communication
scenarios. Compared to previous systems, Tele-Aloha utilizes only four sparse
RGB cameras, one consumer-grade GPU, and one autostereoscopic screen to achieve
high-resolution (2048x2048), real-time (30 fps), low-latency (less than 150ms)
and robust distant communication. As the core of Tele-Aloha, we propose an
efficient novel view synthesis algorithm for upper-body. Firstly, we design a
cascaded disparity estimator for obtaining a robust geometry cue. Additionally
a neural rasterizer via Gaussian Splatting is introduced to project latent
features onto target view and to decode them into a reduced resolution.
Further, given the high-quality captured data, we leverage weighted blending
mechanism to refine the decoded image into the final resolution of 2K.
Exploiting world-leading autostereoscopic display and low-latency iris
tracking, users are able to experience a strong three-dimensional sense even
without any wearable head-mounted display device. Altogether, our telepresence
system demonstrates the sense of co-presence in real-life experiments,
inspiring the next generation of communication.
Tele-Aloha, a low-budget telepresence system, uses a novel view synthesis algorithm with cascaded disparity estimation and Gaussian Splatting for high-quality, real-time 3D communication without head-mounted displays.
cascaded disparity estimator neural rasterizer Gaussian Splatting weighted blending autostereoscopic display three-dimensional sense co-presence