A Study on the Plan of Activation of Library by Utilizing the Virtual Reality and Augmented Reality

The difference between the virtual reality and the augmented reality is that, while the former allows one to experience the contents which are disconnected from the real world via an immersive device, the latters presents the contents which are infused with the real world (Yoon, 2019). Recently, as an extension of the augmented reality, mixed reality, where the combination of the virtual world and the real world becomes even more natural, the technology for maximizing the user's immersive experience is undergoing development.

The core technologies of the virtual reality include the immersion visualization technology, sensory interaction technology, and the virtual reality environment creation and simulation technology, and as for the core technology of the augmented reality, real and virtual images are synthesized and matched to a three-dimensional real space. The sensing and tracking technologies, image synthesis technology, and the real-time augmented reality interaction technology may be selected among the core technologies since it ought to be possible to interact on a real time basis (Kim, 2019).

Table 1.

Core Technologies of the VR and AR

As for the virtual reality (VR) and augmented reality (AR) related policies, the main policy status of Europe, the US, China, and Korea are, when examined, as follows.

First, advanced economies such as Europe and the United States have designated VR and AR among the 10 key future strategic technologies, and are actively investing in their research and development. The United States has the best technologies in the field of basic research related to VR and AR, and while private companies are primarily conducting the R&D focused on their commercialization and industrialization, experimental commercialization has also been underway through the various content production supports in the field of virtual training including national defense. In Europe, countries are promoting a comprehensive plan which encompasses a variety of R&D policies, from basic research to the infrastructure maintenance and commercialization, and through a national research institute, virtual engineering technologies applied for the automobile industry have been developed and applied for the automobile industry such as BMW and Mercedes Benz. Furthermore, VR and AR were selected among the research projects for “Horizon 2020,” and VR was designated among the 9 largest technologies for “Industry 4.0” of Germany. The United Kingdom has invested 58 million Euros in the immersive technology (2018-2019), and tax deductions are provided. To secure leadership of the VR industry, in 2016, the State Council announced the “White Paper on the VR Industry Development,” which specified the current and future policy directions for the VR industry, and announced policies related to the industrial promotion by and for each ministry, thereby creating an environment for the development of the VR industry and leading companies to make their active investments. Selected among the 9 largest strategic emerging industries, digital creative industry was selected, and the R&D investments utilizing VR and AR is stressed, while the VR and AR utilization program undergoing implementation via the 5G industrial development action plan. As for Japan, VR and AR were chosen among the “strategic technologies to usher in the future of 2030,” and a fund of 200 billion won for the public and private sector collaboration is formed via the “VR Techno Japan” policy.

Table 2.

Status of the Major Policy Support for the Areas of VR and AR by and at Major Countries.

In the case of Korea, approximately KRW 244 billion of government R&D investments have been made in the areas of VR and AR for 3 years (2018-2020). It was selected among the 13 largest areas of innovative growth engines (December 2017), and the expansion of inter-ministerial R&D investments has accelerated. Following the commercialization of 5G as an opportunity, an announcement was made on the VR and AR related fostering strategy, and other announcements followed on the 3 largest innovative strategies for the contents industry (September 2019), with the strategy for activating the immersive content industry (October 2019 by the Information and Communication Strategy Committee), and the Pan-Government Immersive Contents Policy Council was formed and has been in operation.

In August 2020, a phased-in regulatory innovation roadmap was devised to predict the technological development of the VR and AR and the scenario of service application and expansion by sector (jointly by the ministries, 2020b). In terms of the usability (interface) and the system advancement (platform, intelligence), the evolutionary direction for the VR and AR technology was derived into 3 stages.

Table 3.

Status of the Major Policy Support for the Areas of VR and AR by and at Major Countries.

As for the major fields of application following the technological development and commercialization, 1) entertainment and culture, 2) education, 3) general industries such as manufacturing, 4) transportation, 5) medical care, and 6) public (security, fire, and defense) were derived. First, the field of entertainment and culture was consisted of rht 5 tasks of the rationalization of virtual reality (VR) motion simulator’s conformity evaluation, relaxation of the virtual reality (VR) simulator scale standards for the expansion of installation in the downtown, and the improvement of the facility standards for the video viewing provision business to provide virtual reality (VR) movies, respectively. Second, the area of education was consisted of the 5 tasks of the preparation of the guidelines on the use of virtual and augmented reality (VR and AR) devices and contents for the area of education, relaxation of the restrictions on the use of the online networks and platforms in schools, and the improvement of the digital textbook review system. Third, the general industrial areas such as manufacturing was consisted of the 5 tasks of the preparation of the standards on the utilization of the virtual and augmented reality (VR and AR) utilized remote safety inspection and examination, preparation of the standards for the data collection and use from the site, and the preparation of highly sophisticated technology and training device standards and guidelines. Fourth, the area of transportation was consisted of the 2 tasks of the expansion of the types of video display devices (wearables) and the preparation of the safety technology standards for video display devices such as HUD and smart glass. Fifth, the area of medical treatment was consisted of the 4 tasks of the establishment of the virtual and augmented reality (VR and AR) medical device items, and the utilization of the augmented reality (AR) for the contactless medical treatment service for the expatriats overseas. Sixth, the area of public service (police, firefighting, and national defense) was consisted of the 4 tasks of the preparation of provisions on the use of augmented reality (AR) for the police work, and systemic development for the safe utilization of the national defense data.

Through which, and based on the expansion of the VR and AR, they seek to build a contactless social and economic system early, and take a leap towards a powerhouse for the immersive contents, while further expanding the immersive contents market and pursue the development and growth of the immersive contents specialized companies economically, and further advancing the contactless and hyper-connected society and building a stable infrastructures even in the event of national emergencies and crises such as pandemics.

Immersive contents are utilized as a tool for innovations across the economy and society, thereby creating the newly added values (Lee, 2020c). It is expected that the immersive contents will also contribute to the economic growth as the era of popularization in which immersive contents are utilized for personal lives and industries has advented.

In the case of the overseas, and in terms of investments, major countries including the US, European Union, and China have established and are pursuing the national VR and AR development strategies, and the privately led investments in the area of devices is making progress very aggressively. Facebook has invested approximately 600 billion won or more in the VR since acquiring Oculus in 2014, while HTC officially announced that it will stop developing smartphones, and instead, will focus on the VR devices. In terms of the products, companies such as Facebook (the US) and HTC (Taiwan) are launching their 2nd and 3rd generation products for the VR, and the high performance and multi-functional MS ‘Hololens2’ product best represents the AR. Furthermore, the small and medium-sized startups are developing the AR devices, specializing in the demand by industry (manufacturing, medical care, and sports, etc.).

In terms of dissemination, the products are released and distributed primarily by the large companies capturing the market. For the VR, Oculust and HTC are pursuing the strategies to further grow their market share in conjunction with related platforms (Facebook and Steam, etc.). While for the AR, Microsoft is executing a B2C strategy targeting companies of the areas of demand including the industries, manufacturing, and national defense, and Nreal, etc., have pursued their strategies of targeting the real life consumers. As for the limitations, various products are released overseas, yet there exist difficulties in expanding the devices given such issues as the gap with consumer needs and the lack of relevant contents.

In the case of Korea, the “5G+ Strategy for the Realization of Innovative Growth” was announced with the goal of securing global leadership for the 5G based new industries and of realizing a leading country for the fourth industrial revolution by integrating 5G for both Korea’s economy and society (Beom, Kim, & Kim, 2019). Based on the maximized immersion and realism, the immersive contents, which have emerged as high performing contents for the 5G era, were selected among the top 10 largest industries even for the “5G+ Strategy for the Realization of Innovative Growth.”

In terms of the investments, the government has endeavored to focus on fostering the immersive contents industry by taking advantage of the world’s first commercialization of 5G (April 2019) as an opportunity, however, investments in the area of devices are yet insufficient. In terms of the products, Samsung's VR devices, “Gear VR” and “Odyssey+” etc., are the sole products released in the market, however, the additional development plan is yet unclear even for them, and hence, the reliance on foreign products has intensified. There are some cases of the AR development such as the “Pin Mirror” glasses of the optical system company called Retinal, and the development of the AR device for cancer surgery (2020). However, there are currently no domestically finished products in the market. In terms of the distribution, the device market is yet immature, and the products and related investments in the market have been minimal at best, and hence, they are entirely dependent on the foreign products. In Korea, the growth of the area of devices continues to be stagnant due to such issues as the lack of investments, lack of market launched products, and the low consumer interest and perception.

Recently, as “contactless” has emerged to be important since the expansion of COVID-19, the demand for contactless services including video conferencing and remote education linked with the VR and AR devices has exploded. Spatial, a US company dedicated to the VR and AR collaboration platform development, announced that the use of related solutions, such as the augmented reality meetings, has grown by over 10 times due to COVID-19. It is also possible to realize the large capacity and high quality contents by utilizing the ultra low latency characteristics, along with the production of high performance and ultra light devices by utilizing 5G edge Cloud since the advent of 5G. In the case of Korea, the “5G MEC Test Bed’ (2020-2022, Pangyo, NIPA) which performs functions such as providing the 5G MEC test network and infrastructures is undergoing development.

Visual Capitalist, which is a global market research institute, presents the scope of future application of the AR and VR technologies by classifying them into the industrial and consumer aspects. From the industrial aspect, the utilization is expected to grow in the order of medical care, manufacturing, and defense, respectively, and from the consumer aspect, it is expected to develop with a focus on the entertainment such as games and movies, followed by the utilization in and for the areas of medical treatment and distribution. The cases of application of the virtual reality and augmented reality domestic and abroad, when classified into and examined as the ① area of entertainment, ② area of manufacturing industry, ③ area of education, ④ area of medical treatment, and the ⑤ area of transportation, etc., are as follows (Lee, 2019).

1) Field of Entertainment

By combining the 5G communication technology and sensor technology which recognizes precise movements, the AR and VR games are developing into the games which may be enjoyed with the 5 senses beyond a simple provision of visual pleasures. Lotte World VR Theme Park is expected to be converted into a highly advanced theme park utilizing the virtual reality and augmented reality technologies for the theme parks, water parks, aquariums, kids’ parks, and observatories. The New York Times has developed the NYT VR, a VR contents platform, and is making its transition from the reading media to the visual, auditory, and experiential media.

2) Field of Manufacturing Industry

In the manufacturing sector, following the utilization of the AR and VR technologies, the product design, manufacturing environment, and the purchasing methods have changed. Designers and engineers can virtually create exteriors and test real products in a virtual space without the need to create multiple models, thereby saving much time, energy and costs. Furthermore, as the AR and VR technologies are integrated with the product manuals, the users can check in the product manuals with a sense of realism with their smartphones. MAXST, a Korean AR source technology company, already developed a Hyundai Genesis vehicle manual application in 2016. Through which, the consumers can examine the inside of the vehicles and engine rooms, while rotating the camera 360 degrees, and can also check the information on the maintenance methods through the three dimensional simulations.

3) Area of Education

It has emerged as an innovative technology for and in the area of education in terms of the increased reality in education and learning, replacement of high risk and high cost, and the safety and efficiency secured.

As for the case for the elementary education, the VR and AR contents are provided, such as life in the past, unfolding courses of wars, principles of natural phenomena, and space exploration in the social studies and science subjects, and a program of conducting virtual experience across famed regions of the globe by utilizing Cardboard, a low-cost VR device developed by Google. As for the case of the junior high and high school education, there are situational experience where it is difficult or dangerous to experience the real world in a virtual space blocked away from the real space through the VR, and the utilization of the AR for the basic programming subjects, among others. As for the cases of the college and university education, the VR Educational Library of Hanyang University developed and distributed the VR educational contents which may be simulated for safe and various experiments, and developed a “virtual dissection table” by utilizing the 3D technology to place organs such as heart or stomach and kidneys in the air at will, allowing them for observation.

4) Area of Medical Treatment

While the market share of the area of medical treatment is yet small among the AR and VR applications, it is a rapidly growing area, and is also primarily utilized to treat such mental disorders as trauma. The Alzheimer's Research Institute of the United Kingdom utilizes the AR and VR contents to educate caregivers for the Alzheimer's disease patients, thereby allowing them to experience what it is like to suffer from Alzheimer’s via the virtual experience. Emercy Care of the UK is utilizing the VR to provide treatments to help reduce stress and anxiety by showing 3D images of places they have often visited in the past or memories they want to retain. Neurable of the UK plans to develop a VR headset which is capable of manipulating movements by using the brain waves, and is expected to be used as an assistive device for the users with movement disorders such as the patients of cerebral palsy. Samsung officially announced (2018) “Relúmĭno,” an application dedicated for the Gear VR for the users with visual impairments, providing an environment where the visually impaired can see the screen with clarity.

5) Area of Transportation

Its utilization is expected for the area of transportation as well. Oppo, a Chinese smartphone manufacturer, uncovered the first AR walking navigation system in China in 2018, which is a service by which a virtual character guides the user in the real world by combining the location recognition and the map generation (SLAM) technologies based on the GPS, mobile phone camera, sensors, and the artificial intelligence (AI). Furthermore, as the AR pathfinding service, Korea piloted the AR pathfinding service during the 2018 Pyeongchang Winter Olympics. The navigation app “AR Waze” has the indoor spatial information and precision positioning technology applied, and hence, the user can check the routes of the major Olympics related facilities through the AR by displaying guidance signs on the real road on the smartphone screen.

Table 4.

Cases of the Major Utilization of the AR and VR by Area

1) Cases of Application for the Virtual Reality of Library

Most of the services at the library are the rental services related to the virtual reality and augmented reality, such as Oculus Rift VR Simulators, HTC Vive, Samsung Gear VR, and Microsoft HoloLens. Some of the libraries also provide virtual reality exhibitions which satisfy the five senses by utilizing the virtual reality devices. Bibliothèque et Archives nationales du Québec (BAnQ) provides the virtual reality exhibition by utilizing the virtual reality devices, which, as part of a project called “The Library at Night (La bibliotheque, la nuit)” led by BAnQ, provided services for the users to experience 10 libraries around the world with the virtual reality devices. Furthermore, public libraries and university libraries are utilizing the VR in terms of education (Kim et al., 2017).

Table 5.

Virtual Reality and the Reading Activity

2) Cases of Application of the Augmented Reality for Library

The “Experiential Fairy Tale Story,” which is installed at 39 national and public libraries, including the National Children’s Library, provides learning via experiential learning by blending live videos of the learners with the virtual worlds such as other countries or worlds in the fairy tales. Furthermore, the augmented reality based educational contents are in service, and the cases of utilization of the augmented reality for reading are as follows.

Table 6.

Augmented Reality and the Reading Activity

In addition, examining the cases of the AR and VR based application of library, there are the virtual library tour service, library information service experience via the virtual reality and augmented reality, and the augmented reality program which allows the users to experience the world renowned tourist destinations.

Table 7.

Domestic and Foreign Cases of the AR and VR Based Application of Library