Home About the Journal Latest Work Current Issue Archive Special Issues Editorial Board
<< Previous Next >>

2019, 1(3): 290-302

Published Date:2019-6-20 DOI: 10.3724/SP.J.2096-5796.2019.0012

Virtual fire drill system supporting co-located collaboration

Abstract

Background
Due to the restriction of display mode, in most of the virtual reality systems with multiple people in the same physical space, the program renders the scene based on the position and perspective of the one user, so that other users just see the same scene, resulting in vision disorder.
Methods
To improve experience of multi-user co-located collaboration, in this study, we propose a fire drill system supporting co-located collaboration, in which three co-located users can collaborate to complete the virtual firefighting mission. Firstly, with multi-view stereoscopic projective display technology and ultra wideband (UWB) technology, co-located users can roam independently and watch virtual scenes through the correct perspective view based on their own position by wearing dedicated shutter glasses, thus carrying out different virtual tasks, which improves the flexibility of co-located collaboration. Secondly, we design simulated firefighting water-gun using the micro-electromechanical system sensor, through which users can interact with virtual environment, and thus provide a better interactive experience. Finally, we develop a workbench including a holographic display module and multi-touch operation module for virtual scene assembly and virtual environment control.
Results
The controller can use the workbench to adjust the virtual layout in real time, and control the virtual task process to increase the flexibility and playability of system.
Conclusions
Our work can be employed in a wide range of related virtual reality applications.

Keyword

Virtual reality ; Co-located collaboration ; Multi-view display ; Ultra wideband ; Simulated firefighting water-gun

Cite this article

Yuan WEI, Dongdong GUAN, Qiuchen WANG, Xiangxian LI, Yulong BIAN, Pu QIN, Yanning XU, Chenglei YANG. Virtual fire drill system supporting co-located collaboration. Virtual Reality & Intelligent Hardware, 2019, 1(3): 290-302 DOI:10.3724/SP.J.2096-5796.2019.0012

References

1. Guan D D, Meng X X, Yang C L, Sun W S, Wei Y, Gai W, Bian Y L, Liu J, Sun Q H, Zhao S W. Two kinds of novel multi-user immersive display systems. In: Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. 2018 DOI:10.1145/3173574.3174173

2. Galambos P, Weidig C, Baranyi P, Aurich J C, Hamann B, Kreylos O. VirCA NET: A case study for collaboration in shared virtual space. In: 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom). Kosice, Slovakia, IEEE, 2012 DOI:10.1109/coginfocom.2012.6421993

3. Czernuszenko M, Pape D, Sandin D, DeFanti T, Dawe G L, Brown M D. The ImmersaDesk and Infinity Wall projection-based virtual reality displays. ACM SIGGRAPH Computer Graphics, 1997, 31(2): 46–49 DOI:10.1145/271283.271303

4. Simon A. First-person experience and usability of co-located interaction in a projection-based virtual environment. In: Proceedings of the ACM symposium on Virtual reality software and technology. Monterey, CA, USA, ACM, 2005 DOI:10.1145/1101616.1101622

5. Gugenheimer J, Stemasov E, Frommel J, Rukzio E. ShareVR. In: Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, 2017 DOI:10.1145/3025453.3025683

6. Chen W Y, Ladeveze N, Clavel C, Mestre D, Bourdot P. User cohabitation in multi-stereoscopic immersive virtual environ-ment for individual navigation tasks. In: 2015 IEEE Virtual Reality (VR). Arles, Camargue Provence, France, IEEE, 2015 DOI:10.1109/vr.2015.7223323

7. Chen W Y, Ladeveze N, Clavel C, Bourdot P. Refined experiment of the altered human joystick for user cohabitation in multi-stereocopic immersive CVEs. In: 2016 IEEE Third VR International Workshop on Collaborative Virtual Environments (3DCVE). Greenville, SC, USA, IEEE, 2016 DOI:10.1109/3dcve.2016.7563558

8. Yu H D, Li H Y, Sun W S, Gai W, Cui T T, Wang C T, Guan D D, Yang Y J, Yang C L. A two-view VR shooting theater system. In: 13th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry. Shenzhen, China, 2014, 223–226 DOI:10.1145/2670473.2670497

9. Agrawala M, Beers A C, McDowall I, Fröhlich B, Bolas M, Hanrahan P. The two-user responsive workbench. In: Proceedings of the 24th annual conference on Computer graphics and interactive techniques, 1997, 327–332 DOI:10.1145/258734.258875

10. Kulik A, Kunert A, Beck S, Reichel R, Froehlich B. C1×6: A stereoscopic six-user display for co-located collaboration in shared virtual environments. ACM Transactions on Graphics, 2011, 30: 188 DOI:10.1145/2070781.2024222

11. Hegarty C J. The global positioning system (GPS)// Springer Handbook of Global Navigation Satellite Systems. Cham: Springer International Publishing, 2017: 197–218 DOI:10.1007/978-3-319-42928-1_7

12. Xiao J H, Liu Z, Yang Y, Liu D, Han X. Comparison and analysis of indoor wireless positioning techniques. In: 2011 International Conference on Computer Science and Service System (CSSS). Nanjing, China, 2011 DOI:10.1109/csss.2011.5972088

13. Salous S, Ridene T, Newton J, Chendeb S. Study of geometric dispatching of four-kinect tracking module inside a Cave. In: SharkeyP M, ParetoL, BroerenJ, RydmarkM, eds. Proceedings of the 10th International Conference on Disability. Virtual Reality and Associated Technologies, 2014, 369–372

14. Sevrin L, Noury N, Abouchi N, Jumel F, Massot B, Saraydaryan J. Preliminary results on algorithms for multi-kinect trajectory fusion in a living lab. IRBM, 2015, 36(6): 361–366 DOI:10.1016/j.irbm.2015.10.003

15. Mara J, Morgan S, Pumpa K, Thompson K. The accuracy and reliability of a new optical player tracking system for measuring displacement of soccer players. International Journal of Computer Science in Sport, 2017, 16(3): 175–184 DOI:10.1515/ijcss-2017-0013

16. Zeng Z Q, Liu S, Wang W, Wang L. Infrastructure-free indoor pedestrian tracking based on foot mounted UWB/IMU sensor fusion. In: 2017 11th International Conference on Signal Processing and Communication Systems (ICSPCS). Surfers Paradise, QLD, 2017 DOI:10.1109/icspcs.2017.8270492

17. Liu C. Firearm Design of Virtual Shooting System Based on MEMS Sensor. Computer Simulation, 2013, 30(9): 415–418(in Chinese)

18. Qin P, Yang C L, Li H Y, Bian Y L, Wang Q C, Liu J, Wang Y C, Meng X X. Virtual reality shooting recognition device and system using MEMS sensor. Journal of Computer-Aided Design & Computer Graphics, 2017, 29(11): 2083–2090(in Chinese)

19. Lin C, Sun X W, Yue C L, Yang C L, Gai W, Qin P, Liu J, Meng X X. A novel workbench for collaboratively constructing 3D virtual environment. Procedia Computer Science, 2018, 129: 270–276 DOI:10.1016/j.procs.2018.03.075

20. Sun X W, Meng X X, Wang Y F, de Melo G, Gai W, Shi Y L, Zhao L, Bian Y L, Liu J, Yang C L. Enabling participatory design of 3D virtual scenes on mobile devices. In: Proceedings of the 26th International Conference on World Wide Web Companion. 2017 DOI:10.1145/3041021.3054173

21. Gai W, Lin C, Yang C L, BianY L, Shen C A, Meng X X, Wang L, Liu J, Dong M D, Niu C J. Supporting easy physical-to-virtual creation of mobile VR maze games: a new genre. In: 2017 CHI Conference on Human Factors in Computing Systems. Denver, Colorado, 2017, 5016–5028 DOI: 10.1145/3025453.3025494

22. Wang Q C. The design and implementation of the fire drill system based on the simulation interactive extinguisher. Jinan: Shandong University, 2018

23. Bian Y L, Yang C L, Gao F Q, Li H Y, Zhou S S, Li H C, Sun X W, Meng X X. A framework for physiological indicators of flow in VR games: construction and preliminary evaluation. Personal and Ubiquitous Computing, 2016, 20(5): 821–832 DOI:10.1007/s00779-016-0953-5

Related

1. Yang LI, Dong WU, Jin HUANG, Feng TIAN, Hong'an WANG, Guozhong DAI, Influence of multi-modality on moving target selection in virtual reality Virtual Reality & Intelligent Hardware 2019, 1(3): 303-315

2. Yang LI, Jin HUANG, Feng TIAN, Hong-An WANG, Guo-Zhong DAI, Gesture interaction in virtual reality Virtual Reality & Intelligent Hardware 2019, 1(1): 84-112

3. Athirah SYAMIMI, Yiwei GONG, Ryan LIEW, VR industrial applicationsA singapore perspective Virtual Reality & Intelligent Hardware 2020, 2(5): 409-420

4. Jie GUO, Dongdong WENG, Yue LIU, Qiyong CHEN, Yongtian WANG, Analysis of teenagers' preferences and concerns regarding HMDs in education Virtual Reality & Intelligent Hardware 2021, 3(5): 369-382

5. Susu HUANG, Daqing QI, Jiabin YUAN, Huawei TU, Review of studies on target acquisition in virtual reality based on the crossing paradigm Virtual Reality & Intelligent Hardware 2019, 1(3): 251-264

6. Yukang YAN, Xin YI, Chun YU, Yuanchun SHI, Gesture-based target acquisition in virtual and augmented reality Virtual Reality & Intelligent Hardware 2019, 1(3): 276-289

7. Yuan GAO, Le XIE, A review on the application of augmented reality in craniomaxillofacial surgery Virtual Reality & Intelligent Hardware 2019, 1(1): 113-120

8. Yuan CHANG, Guo-Ping WANG, A review on image-based rendering Virtual Reality & Intelligent Hardware 2019, 1(1): 39-54

9. Shiguang QIU, Shuntao LIU, Deshuai KONG, Qichang HE, Three-dimensional virtual-real mapping of aircraft autom-atic spray operation and online simulation monitoring Virtual Reality & Intelligent Hardware 2019, 1(6): 611-621

10. Xu PENG, Zhenyu GAO, Yitong DING, Dongfeng ZHAO, Xiaoyu CHI, Study of ghost image suppression in polarized catadioptric virtual reality optical systems Virtual Reality & Intelligent Hardware 2020, 2(1): 70-78

11. Zhiming HU, Sheng LI, Meng GAI, Temporal continuity of visual attention for future gaze prediction in immersive virtual reality Virtual Reality & Intelligent Hardware 2020, 2(2): 142-152

12. Lihui HUANG, Siti Faatihah Binte Mohd TAIB, Ryan Aung BA, Zhe An GOH, Mengshan XU, Virtual reality research and development in NTU Virtual Reality & Intelligent Hardware 2020, 2(5): 394-408

13. Stéphanie PHILIPPE, Alexis D. SOUCHET, Petros LAMERAS, Panagiotis PETRIDIS, Julien CAPORAL, Gildas COLDEBOEUF, Hadrien DUZAN, Multimodal teaching, learning and training in virtual reality: a review and case study Virtual Reality & Intelligent Hardware 2020, 2(5): 421-442

14. Jia Ming LEE, Xinxing XIA, Clemen OW, Felix CHUA, Yunqing GUAN, VEGO: A novel design towards customizable and adjustable head-mounted display for VR Virtual Reality & Intelligent Hardware 2020, 2(5): 443-453

15. Jingcheng QIAN, Yancong MA, Zhigeng PAN, Xubo YANG, Effects of Virtual-real fusion on immersion, presence, and learning performance in laboratory education Virtual Reality & Intelligent Hardware 2020, 2(6): 569-584

16. Hengwei XU, Siru LI, Wenpeng SONG, Jiajun SUN, Xinli WU, Xiaoqi WANG, Wenzhen YANG, Zhigeng PAN, Abdennour EI RHALIBI, Thermal perception method of virtual chemistry experiments Virtual Reality & Intelligent Hardware 2020, 2(4): 305-315

17. TJ MATTHEWS, Feng TIAN, Tom DOLBY, Interaction design for paediatric emergency VR training Virtual Reality & Intelligent Hardware 2020, 2(4): 330-344

18. Hongxin ZHANG, Jin ZHANG, Xue YIN, Kan ZHOU, Zhigeng PAN, Abdennour EI RHALIBI, Cloud-to-end rendering and storage management for virtual reality in experimental education Virtual Reality & Intelligent Hardware 2020, 2(4): 368-380

19. Xiang ZHOU, Liyu TANG, Ding LIN, Wei HAN, Virtual & augmented reality for biological microscope in experiment education Virtual Reality & Intelligent Hardware 2020, 2(4): 316-329

20. Haoyu WANG, Jianhuang WU, A virtual reality based surgical skills training simulator for catheter ablation with real-time and robust interaction Virtual Reality & Intelligent Hardware 2021, 3(4): 302-314

21. Na ZHANG, Liwen TAN, Fengying LI, Bing HAN, Yifa XU, Development and application of digital assistive teaching system for anatomy Virtual Reality & Intelligent Hardware 2021, 3(4): 315-335

22. Daniel VANKOV, David JANKOVSZKY, Effects of using headset-delivered virtual reality in road safety research: A systematic review of empirical studies Virtual Reality & Intelligent Hardware 2021, 3(5): 351-368

23. Dangxiao WANG, Yuan GUO, Shiyi LIU, Yuru ZHANG, Weiliang XU, Jing XIAO, Haptic display for virtual reality: progress and challenges Virtual Reality & Intelligent Hardware 2019, 1(2): 136-162

24. Aiguo SONG, Liyue FU, Multi-dimensional force sensor for haptic interaction: a review Virtual Reality & Intelligent Hardware 2019, 1(2): 121-135

25. Wenmin ZHU, Xiumin FAN, Yanxin ZHANG, Applications and research trends of digital human models in the manufacturing industry Virtual Reality & Intelligent Hardware 2019, 1(6): 558-579

26. Mohammad Mahmudul ALAM, S. M. Mahbubur RAHMAN, Affine transformation of virtual 3D object using 2D localization of fingertips Virtual Reality & Intelligent Hardware 2020, 2(6): 534-555