Method of synthesis of "live" pictures
DOI:
https://doi.org/10.34185/1562-9945-6-131-2020-14Keywords:
жива картина, доповнена реальність, розпізнавання маркеру AR, трекінг маркеру AR, кути ЕйлераAbstract
Augmented reality (AR) computer technologies have become widely spread in many ar-eas of human life over the last years. The term "livе" picture in the paper refers to an image of a real picture viewed through a smartphone or a camera of some other digital device. The image is augmented by virtual animation elements that are absent in the real world. In the field of art, augmented reality has become the tool for expanding an artist’s idea in a natural way.
The paper describes a streamlined sequence of steps required for the synthesis of a live picture. The sequence includes the following steps: creation of a digital animation, generation of an AR marker, staging the picture and the marker on a gallery’s plane; capturing a video stream; AR marker tracking; positioning augmented reality objects relative to the marker; displaying the animation on a screen.
The authors show that application of the given sequence of computer vision algorithms makes it possible to recognize the marker reliably, while the usage of methods of projective geometry provides a way to determine the size of AR marker together with the coefficients of a plane holding the animation.
In general case, AR tracking technology that uses single camera has no yield of the distance from the camera to the marker. In the context of the method of synthesis of live pictures, z component of the marker is defined basing on the considerations of the animation author. Calculated Euler angles establish the position of a three-dimensional local coordinate system with xOy plane being coincident with the marker’s plane.
The implementation of a software system for live pictures synthesis was made in the form of a web application. Web application paradigm made it possible to have a single base of a program code ready to be executed both on a personal computer and on a mobile device.
References
Kato H. Marker Tracking and HMD Calibration for a Video-based Augmented Reality Conferencing System / H. Kato, M. Billinghurst. –Proceedings of the 2nd IEEE and ACM International Workshop on Augmented Reality ’99. –1999. – P. 85-94.
Bezpalko O.S. Doslidzhennia system rozpiznavannia markeriv dopovnenoi realnosti / O.S. Bezpalko. – System Research & Information Technologies. – 2020. – № 2(2020). – P. 55-66.
Milgram P., Kishino F. A taxonomy of mixed reality visual displays / P. Milgram, F. Kishino. – IEICE TRANSACTIONS on Information and Systems. –1994. Vol. 77 (12) – P. 1321-1329.
Siltanen S. Theory and applications of marker-based augmented reality / Siltanen S. – VTT Science 3. – Espoo 2012. – 198 p. + app. 43 p.
Kessenich J., Sellers G., Shreiner D. OpenGL Programming Guide: The Official 5. Guide to Learning OpenGL, Version 4.5 / Kessenich J., Sellers G., Shreiner D. – Addison-Wesley Professional, 2016. – 976 p.
Sedov S.A. Individualnyie video-sredstva / S.A. Sedov. – K.: Naukova dumka, 1990. – 752 p.
Gonsales R. Tsifrovaya obrabotka izobrazheniy / R. Gonsales, R. Vuds — M: Tehnosfera, 2012 – 1104 p.
Vovk S.M. Metody obrobky zobrazhen ta kompiuternyi zir : navch. posib. / S.M. Vovk, V.V. Hnatushenko, M.V. Bondarenko. – D. : LIRA, 2016. – 148 p.
Douglas D. and T. Peucker Algorithms for the reduction of the number of points required to represent a digitized line or its caricature / D. Douglas, T. Peucker. – Cartographica: The International Journal for Geographic Information and Geovisualization. – 1973. – Vol.10. – P.112-122.
Numerical Recipes in C: The Art of Scientific Computing / W. Press, S.Teukolsky, W. Vetterling, B. Flannery. – Cambridge univ. press. – 994 p.
