Extended reality technology – a new component in industrial engineering and production systems
https://doi.org/10.32362/2500-316X-2020-8-4-46-65
Abstract
Extended (virtual, augmented and mixed) reality technology gets considered as a new universal component of production (industrial) engineering’s methodological basis, receiving the possibilities for wide use in both extensive and intensive development of carrying and other branches of the fourth, fifth and the forming nucleus of the sixth technological wave. The article gives grounds for the role and place of this kind of technology in contemporary technological processes and production systems (including the flexible, small-volume and discrete production), and in the context of cyberphysical systems and the incoming fourth industrial revolution. The authors describe underline the set of tasks that are universal for a wide range of branches in any national economy, that can be most efficiently completed in terms of the current and prognosed level of development of man-machine interaction can be provided for as a result of using VR, AR and MR technologies. Based on the comparison of implementation principles and examples of applied implementation, the article gives grounds for term correspondence and opportunities of use of “extended reality technology”. The authors have made and explained the conclusion on practicability of integrating extended reality technology based on a universal hardwaresoftware complex that provides VR, AR and MR services corresponding to the composition of a given task within the technological process or the operating mode chosen by a user. The article gives descriptions of task assignments, terms of conduct and results of experiments on designing and testing extended reality interactive environments performed at the institute of information technology RTU MIREA in 2019–2020.
About the Authors
A. S. Zuev
MIREA – Russian Technological University
Russian Federation
Russian Federation
Andrey S. Zuev, Cand. Sci. (Engineering), Associate Professor, Head of the Institute of Information Technologies
78, Vernadskogo pr., Moscow 119454
M. A. Makushchenko
MIREA – Russian Technological University
Russian Federation
Russian Federation
Maksim A. Makushchenko, Programmer of Specialized Educational and Scientific Laboratories of Multimedia Technologies, Institute of Information Technologies
78, Vernadskogo pr., Moscow 119454
M. E. Ivanov
MIREA – Russian Technological University
Russian Federation
Russian Federation
Mikhail E. Ivanov, Head of the Specialized Educational And Scientific Laboratory of Information Technologies of the Internet of Things, Institute of Information Technologies
78, Vernadskogo pr., Moscow 119454
E. S. Merkulov
MIREA – Russian Technological University
Russian Federation
Russian Federation
Egor S. Merkulov, Programmer of Specialized Educational and Scientific Laboratories of Multimedia Technologies, Institute of Information Technologies
78, Vernadskogo pr., Moscow 119454
References
1. Glazʼev S.Yu. Ryvok v budushchee. Rossiya v novykh tekhnologicheskom i mirokhozyaistvennom ukladakh (Jerk into the future. Russia in the new technological and world economic structures). Moscow: Knizhnyi mir; 2018. 768 p. (in Russ.). ISBN 978-5-6041071-1-9
2. Glazʼev S.Yu. Strategiya operezhayushchego razvitiya Rossii v usloviyakh global'nogo krizisa (Strategy for the rapid development of Russia in the context of global crisis). Мoscow: Ekonomika; 2010. 255 p. (in Russ). ISBN 978-5-282-03056-3
3. Glazʼev S.Yu. Teoriya dolgosrochnogo tekhniko-ekonomicheskogo razvitiya (Theory of long-term technical and economic development). Moscow: VlaDar Publ.; 1993. 310 p. (in Russ) ISBN 5-86209-003-7
4. Kablov E.N. Sixth technological structure. Nauka i zhiznʼ = Science and life. 2010;4. [Electronic resource]. (in Russ). URL: https://www.nkj.ru/archive/articles/17800/
5. Salvendy G. Handbook of Industrial Engineering. Third edition. V. 3. New York: John Wiley & Sons Ltd.; 2007. 2836 p. ISBN: 978-0470241820
6. Badiru A.B. Handbook of Industrial and Systems Engineering. Second edition. CRC Press LLC; 2013. 1476 p. ISBN: 978-1-4665-1504-8
7. Sassani F. Industrial Engineering Foundations: Bridging the Gap between Engineering and Management. Dulles: Mercury Learning & Information; 2016. 250 p. ISBN: 978-1942270867
8. Programma «Tsifrovaya ekonomika Rossiiskoi Federatsii», utverzhdennaya rasporyazheniem Pravitel'stva Rossiiskoi Federatsii ot 28 iyulya 2017 g. № 1632-R (The program «Digital economy of the Russian Federation», approved by the order of the Government of the Russian Federation dated July 28, 2017 No. 1632-R [Electronic resource]. (in Russ). URL: http://static.government.ru/media/files/9gFM4FHj4PsB79I5v7yLVuPgu4bvR7M0.pdf
9. Shvab K. Chetvertaya promyshlennaya revolyutsiya (The fourth industrial revolution: trans. from Engl.). Мoscow: Eksmo; 2019. 209 p. (in Russ). ISBN 978-5-699-90556-0
10. Fast-Berglund A., Gong L., Li D. Testing and validating Extended Reality (xR) technologies in manufacturing. Procedia Manuf. 2018;25:31-38. https://doi.org/10.1016/j.promfg.2018.06.054
11. Glaz՚ev S.Yu., Dement՚ev V.E., Elkin S.V., Kryanev A.V., Rostovskii N.S., Firstov Yu.P., Kharitonov V.V. Nanotekhnologii kak klyuchevoi faktor novogo tekhnologicheskogo uklada v ekonomike (Nanotechnologies as a key factor of the new technological order in Economics, S.Yu. Glaz'ev, V.V. Kharitonov (Eds.). Мoscow: Trovant; 2009. 304 p. (in Russ).
12. Sadovnichii V.A., Akaev A.A., Korotaev A.V., Malkov S.Yu. Modelirovanie i prognozirovanie mirovoi dinamiki (Modeling and forecasting of world dynamics / Scientific Council for the Fund Program. research. Presidium of the Russian Academy of Sciences «Economics and sociology of knowledge»). Moscow: ISPI RAN Publ.; 2012. 359 p. (in Russ). ISBN 978-5-7556-0456-7
13. Hermann M., Pentek T., Otto B. Design Principles for Industrie 4.0 Scenarios. In: 49th Hawaii International Conference on System Sciences (HICSS), Koloa, HI. 2016. P. 3928-3937. https://doi.org/10.1109/HICSS.2016.488
14. Going C.B. Principles of Industrial Engineering. New York: McGraw-Hill; 1911. 174 p.
15. Lehrer R.N. The Nature of Industrial Engineering. The Journal of Industrial Engineering. 1954;5(1):4.
16. Urwick L.F. Development of Industrial Engineering. In: Industrial Engineering Handbook, H.B. Maynard (Еd.). New York: McGraw Hill; 1963. P. 1.3-1.16.
17. Sawada P.N. A Concept of Industrial Engineering. Int. J. Prod. Res. 1977;15(6):511-522. https://doi.org/10.1080/00207547708943146
18. Savory P. Details and Description of Industrial Engineering // Industrial and Management Systems Engineering Faculty Publications. 2005. 13 р. [Electronic resource]. URL: https://digitalcommons.unl.edu/imsefacpub/33
19. Darwish H., van Dyk L. The industrial engineering identity: from historic skills to modern values, duties, and roles. S. Afr. J. Ind. Eng. 2016;27(3):50-63. https://doi.org/10.7166/27-3-1638
20. Cupek R., Drewniak M., Ziębiński A., Fojcik M. «Digital Twins» for Highly Customized Electronic Devices Case Study on a Rework Operation. IEEE Access. 2019;7:164127-164143. https://doi.org/10.1109/ACCESS.2019.2950955
21. Casla P., Larreina J., Fletcher S. et al. Human-centered factories from theory to industrial practice. Lessons learned and recommendations. ACE Factories Cluster White Paper; 2019. 51 p. http://ace-factories.eu/wp-content/uploads/ACE-Factories-White-Paper.pdf
22. Vnedrenie i razvitie Industrii 4.0. Osnovy, modelirovanie i primery iz praktiki, pod red. Armina Rota (Introduction and development of Industry 4.0. Fundamentals, modeling and examples from practice, Armin Roth (Ed.). Moscow: TEKhNOSFERA Publ., 2017. 294 p. (in Russ). ISBN 978-5-94836-482-7
23. Zuev A.S., Zueva A.N. The digital economy and the development of print media. Izvestiya vysshikh uchebnykh zavedenii. Problemy poligrafii i izdatel'skogo dela = Proceedings of the institutions of higher education. Issues of the graphic arts and publishing. 2019;1:50-56 (in Russ.).
24. Sharp H., Preece J., Rogers Y. Interaction Design: Beyond Human-Computer Interaction. 5th ed. New York: John Wiley & Sons Ltd; 2019. 636 p. ISBN 978-1-119-54725-9
25. Dorozhnaya karta razvitiya «skvoznoi» tsifrovoi tekhnologii «Tekhnologii virtual'noi i dopolnennoi real'nosti», utverzhdennaya 10 oktyabrya 2019 goda (Roadmap for the development of «end-to-end» digital technology «Virtual and augmented reality Technologies», approved on October 10, 2019. (in Russ). [Electronic resource]. URL: https://digital.gov.ru/ru/documents/6654/
26. Foreman N., Korallo L. Past and Future Applications of 3-D (Virtual Reality) Technology. Nauchno-tekhnicheskii vestnik informatsionnykh tekhnologii, mekhaniki i optiki = Sci. Tech. J. Inf. Technol. Mech. Opt. 2014;6(94):1-8 (in Russ.).
27. Cipresso P., Giglioli I.A.C., Raya V.L.A., Riva G. The Past, Present, and Future of Virtual and Augmented Reality Research: A Network and Cluster Analysis of the Literature. Frontiers in Psychology. 2018;9: Article 2086. https://doi.org/10.3389/fpsyg.2018.02086
28. Sangsu C., Jung K., Noh S.D. Virtual reality applications in manufacturing industries: Past research, present findings, and future directions. Concurr. Eng. Res. Appl. 2015;23(1):1-24. https://doi.org/10.1177%2F1063293X14568814
29. Yu F., Zhang J.-F., Zhao Y., Tan C., Luan R.-P. The Research and Application of Virtual Reality (VR) Technology in Agriculture Science. In: Li D., Zhao C. (Eds). Computer and Computing Technologies in Agriculture III. 2009. P. 546-550. https://doi.org/10.1007/978-3-642-12220-0_79
30. Wang P. et al. A Critical Review of the Use of Virtual Reality in Construction Engineering Education and Training. Int. J. Environ. Res. Public Health. 2018;15(6):Article 1204. https://doi.org/10.3390/ijerph15061204
31. Wolfartsberger J., Zenisek J., Sievi C. Chances and Limitations of a Virtual Reality-supported Tool for Decision Making in Industrial Engineering. IFAC- PapersOnLine. 2018;51(11):637-642. https://doi.org/10.1016/j.ifacol.2018.08.390
32. Veligodskii D.V. Experience in using the simulator «Virtual inspection of the scene » in the special course «Information and reference support of legal proceedings» for training lawyers. In: Materialy VII Mezhdunarodnoi nauchno-prakticheskoi konferentsii «Ugolovnoe proizvodstvo: protsessualʼnaya teoriya i kriminalisticheskaya praktika». Simferopolʼ (Proc.of the VII International scientific and practical conference «Criminal proceedings: procedural theory and criminalistic practice», Simferopol.); 2019. P. 14-15 (in Russ.).
33. Papagiannis Kh. Dopolnennaya real'nostʼ. Vse, chto vy khoteli uznatʼo tekhnologii budushchego (Augmented reality. Everything you wanted to know about future technology). Мoscow: Eksmo; 2019. 288 p. (in Russ.). ISBN: 978-5-04-089971-5
34. Mourtzis D., Zogopoulos V., Xanthi F. Augmented reality application to support the assembly of highly customized products and to adapt to production re-scheduling. Int. J. Adv. Manuf. Technol. 2019;105:3899-3910. https://doi.org/10.1007/s00170-019-03941-6
35. Boccaccio A. et al. Exploiting Augmented Reality to Display Technical Information on Industry 4.0 P&ID. In: Cavas-Martínez F. et al. (Eds.). Advances on Mechanics, Design Engineering and Manufacturing II. Lecture Notes in Mechanical Engineering. Springer, Cham., 2019. P. 282-291. https://doi.org/10.1007/978-3-030-12346-8_28
36. Mourtzis D., Zogopoulos V., Katagis I., Lagios P. Augmented Reality based Visualization of CAM Instructions towards Industry 4.0 paradigm: a CNC Bending Machine case study. Procedia CIRP. 2018;70:368-373. https://doi.org/10.1016/j.procir.2018.02.045
37. Speicher M., Hall B.D., Nebeling M. What is Mixed Reality? In: Proc. of the 2019 CHI Conference on Human Factors in Computing Systems. Glasgow, Scotland, UK, 2019. Paper No: 537. P. 1-15. https://doi.org/10.1145/3290605.3300767
38. Wang X., Schnabel M.A. (eds.) Mixed Reality in Architecture, Design, and Construction. Springer Science; 2009. 274 p. ISBN: 978-1-4020-9087-5
39. Wang X. (Ed.). Mixed Reality and Human-Robot Interaction. ISCA. V. 47. Springer Science; 2011. 175 p. ISBN: 978-007-0581-4
40. Shumaker R. (Ed.). Virtual and Mixed Reality – Systems and Applications. International Conference, Virtual and Mixed Reality 2011. Proceedings, Part II. Orlando, FL, USA; 2011. 455 p. ISBN 978-3-642-22023-4 https://doi.org/10.1007/978-3-642-22024-1
41. Rubio-Tamayo J.L. Extended Reality, Interactivity and Immersive 3D Environments: Literature Review and Projections. In: VII Congreso Internacional Ciudades Creativas. Universidad Tecnológica de Bolívar, Cartagena de Indias, Colombia, 2019. Р. 396-414.
42. Mann S., Havens J.C., Iorio J., Yuan Y., Furness T. All Reality: Values, taxonomy, and continuum, for Virtual, Augmented, eXtended/MiXed (X), Mediated (X,Y), and Multimediated Reality/Intelligence. Presented at the AWE 2018, Santa Clara, CA, USA. [Electronic resource]. URL: http://wearcam.org/all.pdf
43. Chuah S.H-W. Why and Who Will Adopt Extended Reality Technology? Literature Review, Synthesis, and Future Research Agenda (December 13, 2018). [Electronic resource]. URL: https://dx.doi.org/10.2139/ssrn.3300469
44. Barfield W. Fundamentals of Wearable Computers and Augmented Reality. 2nd Edition. Boca Raton: CRC Press; 2015. 739 p. ISBN: 978-1-4822-4351-2
45. Chuah S.H-W. Wearable XR-technology: literature review, conceptual framework and future research directions. Int. J. Tech. Market. 2019;13(3/4):205-259. https://doi.org/10.1504/IJTMKT.2019.104586
46. Smart contact lens for augmented reality and methods of manufacturing and operating the same: Pat. KR20160037008A, South Korea. Appl. № KR1020140129517A; appl. 2014.09.26; publ. 2016.04.05. URL: https://patents.google.com/patent/KR20160037008A/en?q=lens&q=smart&assignee=samsung&oq=samsung+lens+smart
47. Racat M., Capelli S. Haptic Sensation and Consumer Behaviour: The Influence of Tactile Stimulation in Physical and Online Environments. Spriger: Palgrave Pivot; 2020. 125 p. ISBN: 978-3-030-36921-7
48. Zuev A.S., Bolbakov R.G. On prospects of development of telecommunication systems and services based on virtual reality technology. Rossiiskii tekhnologicheskii zhurnal = Russian Technological Journal. 2017;5(6):3-10 (in Russ). https://doi.org/10.32362/2500-316X-2017-5-6-3-10
49. Zuev A.S., Zueva A.N., Leonov D.A. Augmented reality technology as a new source of competitive strengths in engineering products. Rossiiskii tekhnologicheskii zhurnal = Russian Technological Journal. 2020;8(1):9-20 (in Russ). https://doi.org/10.32362/2500-316X-2020-8-1-9-20
50. Akaev A.A., Sadovnichii V.A. On a new methodology for long-term cyclical forecasting of the dynamics of the world system and Russia. In: Prognoz i modelirovanie krizisov i mirovoi dinamikii (Forecast and modeling of crises and global dynamics). Moscow: LKI Publishing House; 2010. P. 5-69 (in Russ.).
Supplementary files
|
|
1. Zuev_Fig.1 | |
| Subject | ||
| Type | Research Results | |
View
(70KB)
|
Indexing metadata ▾ | |
The authors describe the set of tasks that are universal for a wide range of sectors in any national economy, that can be most efficiently completed in terms of the current and prognosed level of development of man-machine interaction and can be provided for as a result of using VR, AR and MR technologies. Based on the comparison of implementation principles and examples of applied implementation, the article gives grounds for term correspondence and opportunities of use of “extended reality technology”. The authors have made and explained the conclusion on practicability of integrating extended reality technology based on a universal hardware-software complex that provides VR, AR and MR services corresponding to the composition of a given task within the technological process or the operating mode chosen by a user.
Review
For citations:
Zuev A.S., Makushchenko M.A., Ivanov M.E., Merkulov E.S. Extended reality technology – a new component in industrial engineering and production systems. Russian Technological Journal. 2020;8(4):46-65. (In Russ.) https://doi.org/10.32362/2500-316X-2020-8-4-46-65
Views:
1406
Email this article 