Real-Time Realistic Telepresence using a 360 ° Camera and a Virtual Reality Box

Full Text (PDF, 665KB), PP.46-52

Views: 0 Downloads: 0

Author(s)

Dan Vincent G. Alcabaza 1,* Marvin E. Legaspi 1 Trisha Leinelle Muyot 1 Kate Louise C. Ofren 1 Johsua Angelo D. Panganiban 1 Roselito E. Tolentino 1

1. Polytechnic University of the Philippines – Santa Rosa Campus

* Corresponding author.

DOI: https://doi.org/10.5815/ijitcs.2019.03.05

Received: 7 May 2018 / Revised: 1 Jun. 2018 / Accepted: 11 Jun. 2018 / Published: 8 Mar. 2019

Index Terms

Real-Time, Telepresence, Virtual Reality, 360° Camera, Head Mounted Display

Abstract

This study focuses on the transmission of live 360 video using Ricoh Theta S which is transmitted to Android phone mounted in BoboVR. The proposed solution is to use a 360 camera that captures the scene in all direction and create an application which streams the captured 360 live video from Laptop (Server) into the Android Phone (Client). The Android phone’s IMU sensor is responsible for the corresponding viewport selected from the 360 environment. The viewport is subject for Stereoscopic SBS to show the 3D effect in accordance with the user’s perception The viewport is subject for Stereoscopic SBS to show the 3D effect in accordance with the user’s perception. A 3D video can be produced by applying the Stereogram SBS. Also, depth can be perceived due to the varying distance between the focal baseline and focal length.

Cite This Paper

Dan Vincent G. Alcabaza, Marvin E. Legaspi, Trisha Leinelle Muyot, Kate Louise C. Ofren, Johsua Angelo D. Panganiban, Roselito E. Tolentino, "Real-Time Realistic Telepresence using a 360° Camera and a Virtual Reality Box", International Journal of Information Technology and Computer Science(IJITCS), Vol.11, No.3, pp.46-52, 2019. DOI:10.5815/ijitcs.2019.03.05

Reference

[1]Bergeon, Y., Doskočil, R., et. al. Stereo Vision for Teleoperated Robot: Experiments and Results. Ministry of Defence of the Czech Republic.

[2]Ha, V., Nguyen, T., et. al. (2016) Real-time video streaming with multi-camera for a telepresence wheelchair. 2016 14th International Conference on Control, Automation, Robotics and Vision (ICARCV).

[3]Huang, J., Chen, Z., et. al. (2017). 6-DOF VR Videos with a Single 360-Camera. 2017 IEEE Virtual Reality (VR).

[4]Moon, B., Choi, J., et. al. (2017). Connecting Motion Control Mobile Robot and VR Content. 2017 14th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[5]Nguyen, M., Tran, H., et. al. (2017) Exploration of the 3D World on the Internet Using Commodity Virtual Reality Devices. Multimodal Technologies and Interact 2017.

[6]Pathak, S., Moro, M., et. al. (2016). A Decoupled Virtual Camera Using Spherical Optical Flow. Cross-ministerial Strategic Innovation Promotion Program (SIP), Infrastructure Maintenance, Renovation, and Management’, Council for Science Technology and Innovation.

[7]Ren, Y., and Fuchs, H. (2016). Faster Feedback for Remote Scene Viewing with Pan-Tilt Stereo Camera. IEEE Virtual Reality Conference 2016.

[8]Ricoh Imaging Company, LTD. (2016). RICOH Live Streaming Driver (THETA UVC Blender) with Equirectangular Output.

[9]Shanyuan Teng (2016). RICOH THETA 360 Video (From File) Unity Tutorial.