Effects of Virtual-real fusion on immersion, presence, and learning performance in laboratory education

Abstract

Background

Virtual-reality (VR) fusion techniques have become increasingly popular in recent years, and several previous studies have applied them to laboratory education. However, without a basis for evaluating the effects of virtual-real fusion on VR in education, many developers have chosen to abandon this expensive and complex set of techniques.

Methods

In this study, we experimentally investigate the effects of virtual-real fusion on immersion, presence, and learning performance. Each participant was randomly assigned to one of three conditions: a PC environment (PCE) operated by mouse; a VR environment (VRE) operated by controllers; or a VR environment running virtual-real fusion (VR-VRFE), operated by real hands.

Results

The analysis of variance (ANOVA) and t-test results for presence and self-efficacy show significant differences between the PCE*VR-VRFE condition pair. Furthermore, the results show significant differences in the intrinsic value of learning performance for pairs PCE*VR-VRFE and VRE*VR-VRFE, and a marginally significant difference was found for the immersion group.

Conclusions

The results suggest that virtual-real fusion can offer improved immersion, presence, and self-efficacy compared to traditional PC environments, as well as a better intrinsic value of learning performance compared to both PC and VR environments. The results also suggest that virtual-real fusion offers a lower sense of presence compared to traditional VR environments.

Keyword

Education ; Immersion ; Presence ; Virtual-Real Fusion ; Virtual Reality

Cite this article

Jingcheng QIAN, Yancong MA, Zhigeng PAN, Xubo YANG. Effects of Virtual-real fusion on immersion, presence, and learning performance in laboratory education. Virtual Reality & Intelligent Hardware, 2020, 2(6): 569-584 DOI:10.1016/j.vrih.2020.07.010

References

1. Shin D. Empathy and embodied experience in virtual environment: To what extent can virtual reality stimulate empathy and embodied experience? Computers in Human Behavior, 2018, 78: 64‒73 DOI:10.1016/j.chb.2017.09.012

2. Shin D, Biocca F. Exploring immersive experience in journalism. 2018, 20(8):2800‒2823 DOI:10.1177/1461444817733133

3. Shin D-H. The role of affordance in the experience of virtual reality learning: Technological and affective affordances in virtual reality. Telematics and Informatics, 2017, 34(8):1826‒1836 DOI:10.1016/j.tele.2017.05.013

4. Pantelidis V. Reasons to use virtual reality in education and training courses and a model to determine when to use virtual reality. Themes in Science and Technology Education, 2009, 2(1): 59–70

5. Dalgarno B, Bishop A G, Adlong W, Bedgood D R. Effectiveness of a virtual laboratory as a preparatory resource for distance education chemistry students. Computers & Education, 2009, 53(3): 853–865

6. Kilteni K, Normand J M, Sanchez-Vives M V, Slater M. Extending body space in immersive virtual reality: a very long arm illusion. PLoS One, 2012, 7(7): e40867 DOI:10.1371/journal.pone.0040867

7. Benko H, Holz C, Sinclair M, Ofek E. Normaltouch and texturetouch: High-fidelity 3D haptic shape rendering on handheld virtual reality controllers. In Proceedings of the 29th ACM Symposium on UIST, ACM, New York, NY, USA, 2016, 717–728 DOI:10.1016/j.compedu.2009.05.005

8. Haluck R S, Krummel T M. Computers and virtual reality for surgical education in the 21st century. Archives of Surgery, 2000, 135(7): 786–792

9. Cecil J, Ramanathan P, Mwavita M. Virtual Learning Environments in engineering and STEM education. 2013 IEEE Frontiers in Education Conference (FIE), 2013, 502–507 DOI:10.1109/fie.2013.6684874

10. Aziz E S S, Chang Y Z, Esche S K, Chassapis C. A multi-user virtual laboratory environment for gear train design. Computer Applications in Engineering Education, 2014, 22(4): 788–802 DOI:10.1002/cae.21573

11. Shin D, Park S. 3D learning spaces and activities fostering users' learning, acceptance, and creativity. Journal of Computing in Higher Education, 2019, 31(1): 210–228 DOI:10.1007/s12528-019-09205-2

12. Georgiou J, Dimitropoulos K, Manitsaris A. A virtual reality laboratory for distance education in chemistry. 2007, 2(1):34–41

13. Limniou M, Roberts D, Papadopoulos N. Full immersive virtual environment CAVETM in chemistry education. Computers & Education, 2008, 51(2): 584–593 DOI:10.1016/j.compedu.2007.06.014

14. Liu H J, Wei X L, Chai J X, Ha I, Rhee T. Realtime human motion control with a small number of inertial sensors. In: Symposium on Interactive 3D Graphics and Games on-I3D'11. San Francisco, California, New York, ACM Press, 2011, 133–140 DOI:10.1145/1944745.1944768

15. Liu H X, Xie X, Millar M, Edmonds M, Gao F, Zhu Y X, Santos V J, Rothrock B, Zhu S C. A glove-based system for studying hand-object manipulation via joint pose and force sensing. In: 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS). Vancouver, BC, Canada, IEEE, 2017, 6617–6624 DOI:10.1109/iros.2017.8206575

16. Sharp T, Wei Y C, Freedman D, Kohli P, Krupka E, Fitzgibbon A, Izadi S, Keskin C, Robertson D, Taylor J, Shotton J, Kim D, Rhemann C, Leichter I, Vinnikov A. Accurate, robust, and flexible real-time hand tracking. In: Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems-CHI'15. Seoul, Republic of Korea, NewYork, Press ACM, 2015, 3633–3642 DOI:10.1145/2702123.2702179

17. Dong S, Lu K Q, Sun J Q, Rudolph K. Adaptive force regulation of muscle strengthening rehabilitation device with magnetorheological fluids. IEEE Transactions on Neural Systems and Rehabilitation Engineering, 2006, 14(1): 55–63 DOI:10.1109/tnsre.2005.863839

18. Bouzit M, Burdea G, Popescu G, Boian R. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on Mechatronics, 2002, 7(2): 256–263 DOI:10.1109/tmech.2002.1011262

19. Blake J, Gurocak H B. Haptic glove with MR brakes for virtual reality. ASME Transactions on Mechatronics, 2009, 14(5): 606–615 DOI:10.1109/tmech.2008.2010934

20. Lopes P, You S J, Cheng L P, Marwecki S, Baudisch P. Providing haptics to walls & heavy objects in virtual reality by means of electrical muscle stimulation. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems. Denver Colorado USA, New York, NY, USA, ACM, 2017, 1471–1482 DOI:10.1145/3025453.3025600

21. Newcombe R A, Izadi S, Hilliges O, Molyneaux D, Kim D, Davison A J, Kohi P, Shotton J, Hodges S, Fitzgibbon A. KinectFusion: Real-time dense surface mapping and tracking. In: 2011 10th IEEE International Symposium on Mixed and Augmented Reality. Basel, Switzerland, IEEE, 2011, 127–136 DOI:10.1109/ismar.2011.6092378

22. Garon M, Laurendeau D, Lalonde J F. A framework for evaluating 6-DOF object trackers. In: Computer Vision–ECCV 2018. Cham: Springer International Publishing, 2018, 608–623 DOI:10.1007/978-3-030-01252-6_36

23. Duncan I, Miller A, Jiang S Y. A taxonomy of virtual worlds usage in education. British Journal of Educational Technology, 2012, 43(6): 949–964 DOI:10.1111/j.1467-8535.2011.01263.x

24. Duran M. An academic survey concerning high school and university students' attitudes and approaches to problem solving in chemistry. The International Journal of Environmental and Science Education, 2016, 11(5): 819‒837 DOI:10.12973/ijese.2016.407a

25. Papastergiou M. Digital Game-Based Learning in high school Computer Science education: Impact on educational effectiveness and student motivation. Computers & Education, 2009, 52(1): 1‒12 DOI:10.1016/j.compedu.2008.06.004

26. Makransky G, Petersen G B. Investigating the process of learning with desktop virtual reality: a structural equation modeling approach. Computers & Education, 2019, 134: 15–30 DOI:10.1016/j.compedu.2019.02.002

27. Ray D. Computation of Nonlinear Structures: Extremely Large Elements for Frames, Plates and Shells. John Wiley & Sons, 2015

28. Jennett C, Cox A L, Cairns P, Dhoparee S, Epps A, Tijs T, Walton A. Measuring and defining the experience of immersion in games. International Journal of Human-Computer Studies, 2008, 66(9): 641–661 DOI:10.1016/j.ijhcs.2008.04.004

29. Witmer B G, Singer M J. Measuring presence in virtual environments: a presence questionnaire. Presence: Teleoperators and Virtual Environments, 1998, 7(3): 225–240 DOI:10.1162/105474698565686

30. Shin D. How does immersion work in augmented reality games? A user-centric view of immersion and engagement. Information, Communication & Society, 2017, 22(9): 1212–1229 DOI:10.1080/1369118x.2017.1411519

31. Pintrich P R, de Groot E V. Motivational and self-regulated learning components of classroom academic performance. Journal of Educational Psychology, 1990, 82(1): 33–40 DOI:10.1037/0022-0663.82.1.33

32. Pintrich P R. A manual for the use of the Motivated Strategies for Learning Questionnaire (MSLQ). 1991

1. Jie GUO, Dongdong WENG, Yue LIU, Qiyong CHEN, Yongtian WANG, Analysis of teenagers' preferences and concerns regarding HMDs in education Virtual Reality & Intelligent Hardware 2021, 3(5): 369-382

2. Hongxin ZHANG, Jin ZHANG, Xue YIN, Kan ZHOU, Zhigeng PAN, Abdennour EI RHALIBI, Cloud-to-end rendering and storage management for virtual reality in experimental education Virtual Reality & Intelligent Hardware 2020, 2(4): 368-380

3. Na ZHANG, Liwen TAN, Fengying LI, Bing HAN, Yifa XU, Development and application of digital assistive teaching system for anatomy Virtual Reality & Intelligent Hardware 2021, 3(4): 315-335

4. Zhuoluo MA, Yue LIU, Lu ZHAO, Effect of haptic feedback on a virtual lab about friction Virtual Reality & Intelligent Hardware 2019, 1(4): 428-434

5. Mohib ULLAH, Sareer Ul AMIN, Muhammad MUNSIF, Muhammad Mudassar YAMIN, Utkurbek SAFAEV, Habib KHAN, Salman KHAN, Habib ULLAH, Serious games in science education: a systematic literature review Virtual Reality & Intelligent Hardware 2022, 4(3): 189-209

6. Tao ZENG, Keyu WEI, Yanlin YU, Yi ZHAO, Eye-around vibration haptics on VR immersion improvement Virtual Reality & Intelligent Hardware 2019, 1(2): 176-184

7. Yang LI, Dong WU, Jin HUANG, Feng TIAN, Hong'an WANG, Guozhong DAI, Influence of multi-modality on moving target selection in virtual reality Virtual Reality & Intelligent Hardware 2019, 1(3): 303-315

8. Yang LI, Jin HUANG, Feng TIAN, Hong-An WANG, Guo-Zhong DAI, Gesture interaction in virtual reality Virtual Reality & Intelligent Hardware 2019, 1(1): 84-112

9. Athirah SYAMIMI, Yiwei GONG, Ryan LIEW, VR industrial applications―A singapore perspective Virtual Reality & Intelligent Hardware 2020, 2(5): 409-420

10. Yijun LI, Miao WANG, Derong JIN, Frank STEINICKE, Qinping ZHAO, Effects of virtual environment and self-representations on perception and physical performance in redirected jumping Virtual Reality & Intelligent Hardware 2021, 3(6): 451-469

11. Susu HUANG, Daqing QI, Jiabin YUAN, Huawei TU, Review of studies on target acquisition in virtual reality based on the crossing paradigm Virtual Reality & Intelligent Hardware 2019, 1(3): 251-264

12. Yukang YAN, Xin YI, Chun YU, Yuanchun SHI, Gesture-based target acquisition in virtual and augmented reality Virtual Reality & Intelligent Hardware 2019, 1(3): 276-289

13. Yuan GAO, Le XIE, A review on the application of augmented reality in craniomaxillofacial surgery Virtual Reality & Intelligent Hardware 2019, 1(1): 113-120

14. Yuan CHANG, Guo-Ping WANG, A review on image-based rendering Virtual Reality & Intelligent Hardware 2019, 1(1): 39-54

15. Shiguang QIU, Shuntao LIU, Deshuai KONG, Qichang HE, Three-dimensional virtual-real mapping of aircraft autom-atic spray operation and online simulation monitoring Virtual Reality & Intelligent Hardware 2019, 1(6): 611-621

16. Xu PENG, Zhenyu GAO, Yitong DING, Dongfeng ZHAO, Xiaoyu CHI, Study of ghost image suppression in polarized catadioptric virtual reality optical systems Virtual Reality & Intelligent Hardware 2020, 2(1): 70-78

17. Zhiming HU, Sheng LI, Meng GAI, Temporal continuity of visual attention for future gaze prediction in immersive virtual reality Virtual Reality & Intelligent Hardware 2020, 2(2): 142-152

18. Lihui HUANG, Siti Faatihah Binte Mohd TAIB, Ryan Aung BA, Zhe An GOH, Mengshan XU, Virtual reality research and development in NTU Virtual Reality & Intelligent Hardware 2020, 2(5): 394-408

19. Stéphanie PHILIPPE, Alexis D. SOUCHET, Petros LAMERAS, Panagiotis PETRIDIS, Julien CAPORAL, Gildas COLDEBOEUF, Hadrien DUZAN, Multimodal teaching, learning and training in virtual reality: a review and case study Virtual Reality & Intelligent Hardware 2020, 2(5): 421-442

20. Jia Ming LEE, Xinxing XIA, Clemen OW, Felix CHUA, Yunqing GUAN, VEGO: A novel design towards customizable and adjustable head-mounted display for VR Virtual Reality & Intelligent Hardware 2020, 2(5): 443-453

21. Hengwei XU, Siru LI, Wenpeng SONG, Jiajun SUN, Xinli WU, Xiaoqi WANG, Wenzhen YANG, Zhigeng PAN, Abdennour EI RHALIBI, Thermal perception method of virtual chemistry experiments Virtual Reality & Intelligent Hardware 2020, 2(4): 305-315

22. TJ MATTHEWS, Feng TIAN, Tom DOLBY, Interaction design for paediatric emergency VR training Virtual Reality & Intelligent Hardware 2020, 2(4): 330-344

23. Xiang ZHOU, Liyu TANG, Ding LIN, Wei HAN, Virtual & augmented reality for biological microscope in experiment education Virtual Reality & Intelligent Hardware 2020, 2(4): 316-329

24. Haoyu WANG, Jianhuang WU, A virtual reality based surgical skills training simulator for catheter ablation with real-time and robust interaction Virtual Reality & Intelligent Hardware 2021, 3(4): 302-314

25. Daniel VANKOV, David JANKOVSZKY, Effects of using headset-delivered virtual reality in road safety research: A systematic review of empirical studies Virtual Reality & Intelligent Hardware 2021, 3(5): 351-368

26. Xiaolong LIU, Lili WANG, Redirected jumping in virtual scenes with alleys Virtual Reality & Intelligent Hardware 2021, 3(6): 470-483

27. Liming WANG, Xianwei CHEN, Tianyang DONG, Jing FAN, Virtual climbing: An immersive upslope walking system using passive haptics Virtual Reality & Intelligent Hardware 2021, 3(6): 435-450

28. Muhammad IRFAN, Muhammad MUNSIF, Deepdive: a learning-based approach for virtual camera in immersive contents Virtual Reality & Intelligent Hardware 2022, 4(3): 247-262

29. Dangxiao WANG, Yuan GUO, Shiyi LIU, Yuru ZHANG, Weiliang XU, Jing XIAO, Haptic display for virtual reality: progress and challenges Virtual Reality & Intelligent Hardware 2019, 1(2): 136-162

30. Aiguo SONG, Liyue FU, Multi-dimensional force sensor for haptic interaction: a review Virtual Reality & Intelligent Hardware 2019, 1(2): 121-135

31. Wenmin ZHU, Xiumin FAN, Yanxin ZHANG, Applications and research trends of digital human models in the manufacturing industry Virtual Reality & Intelligent Hardware 2019, 1(6): 558-579

32. Mohammad Mahmudul ALAM, S. M. Mahbubur RAHMAN, Affine transformation of virtual 3D object using 2D localization of fingertips Virtual Reality & Intelligent Hardware 2020, 2(6): 534-555

33. Yuan WEI, Dongdong GUAN, Qiuchen WANG, Xiangxian LI, Yulong BIAN, Pu QIN, Yanning XU, Chenglei YANG, Virtual fire drill system supporting co-located collaboration Virtual Reality & Intelligent Hardware 2019, 1(3): 290-302

34. Xiaoxiong FAN, Yun CAI, Yufei YANG, Tianxing XU, Yike Li, Songhai ZHANG, Fanglue ZHANG, Detection of scene-irrelevant head movements via eye-head coordination information Virtual Reality & Intelligent Hardware 2021, 3(6): 501-514

35. Haochen HU, Yue LIU, Kang YUE, Yongtian WANG, Navigation in virtual and real environment using brain computer interface:a progress report Virtual Reality & Intelligent Hardware 2022, 4(2): 89-114

36. Hayat ULLAH, Sitara AFZAL, Imran Ullah KHAN, Perceptual quality assessment of panoramic stitched contents for immersive applications: a prospective survey Virtual Reality & Intelligent Hardware 2022, 4(3): 223-246