Multiple datasets can be acquired by detecting the surrounding environment using multiple sensors. In this study, we propose an approach for implementing a third person view for a remote control natural user interface by integrating multiple datasets to reconstruct a three-dimensional (3D) scene. The datasets detected by multiple sensors include 3D point clouds, two-dimensional images, and GPS data. A 3D scene reconstructed in a virtual environment can be viewed from various points based on a third person view so users can execute remote control more easily.