“Cinematized Reality: Cinematographic Camera Control in 3D Videos” by Sakamoto, Kitahara, Satomi, Tanaka and Kogure

As the proverb goes “Truth is stranger than fiction”. Our daily life is filled with unexpected moments. Cinematized Reality is aiming to record those unexpected moments and create a movie as if it was created footage. However, nobody knows when the particular moment is going to take place, thus it is not guaranteed to capture the moment. Without a cameraman who works for 24 hours a day to capture your life, it is not possible to capture all the moments we desire to capture. On the other hand, photographic equipments, such as an environmental camera, can capture our daily life without sleeping or resting. However it might be difficult to make a strong impression on audiences since the film is not produced. Moreover, to browse multiple videos for long hours is surely exhaustive operation. “Grammar of the film language” describes rules of film making to produce easily understandable and attractive footage for audiences[Arijon 1991].
Cinematographic camera control is a principal technology of the rules. Virtualized Reality[Kanade et al. 1997] is a technique to generate 3D free viewpoint videos by merging multiple videos using a computer vision algorithm. The key concept of Cinematized Reality is to capture unexpected moments in our daily life by environmental cameras, and by applying Virtualized Reality technique, reconstructs film footage with a sequence of shots taken by virtual camera in the scene following the grammar of film language and applying expert knowledge.

Arijon, D. 1991. Grammar of the Film Language. Silman-James Press.
Kanade, T., Rander, P., And Narayanan, P. J. 1997. Virtualized reality: Constructing virtual worlds from real scenes. IEEE MultiMedia 4, 1, 34–47.