An intelligent navigation experimental system based on multi-mode fusion

Rui HAN ^1,² , Zhiquan FENG ^1,² , Jinglan TIAN ^1,² , Xue FAN ^1,² , Xiaohui YANG ^1,² , Qingbei GUO ^1,²

1. School of Information Science and Engineering, University of Jinan, Jinan 250022, China

2. Shandong Provincial Key Laboratory of Network Based Intelligent Computing, Jinan 250022, China

Abstract

At present, most experimental teaching systems lack guidance of an operator, and thus users often do not know what to do during an experiment. The user load is therefore increased, and the learning efficiency of the students is decreased. To solve the problem of insufficient system interactivity and guidance, an experimental navigation system based on multi-mode fusion is proposed in this paper. The system first obtains user information by sensing the hardware devices, intelligently perceives the user intention and progress of the experiment according to the information acquired, and finally carries out a multi-modal intelligent navigation process for users. As an innovative aspect of this study, an intelligent multi-mode navigation system is used to guide users in conducting experiments, thereby reducing the user load and enabling the users to effectively complete their experiments. The results prove that this system can guide users in completing their experiments, and can effectively reduce the user load during the interaction process and improve the efficiency.

Keyword

Navigation interaction ; Chemical experiment system ; Multi-mode fusion

Cite this article

Rui HAN, Zhiquan FENG, Jinglan TIAN, Xue FAN, Xiaohui YANG, Qingbei GUO. An intelligent navigation experimental system based on multi-mode fusion. Virtual Reality & Intelligent Hardware, 2020, 2(4): 345-353 DOI:10.1016/j.vrih.2020.07.007

References

1. Lesta L, Yacef K. An intelligent teaching assistant system for logic. In: Intelligent Tutoring Systems. Berlin, Heidelberg, Springer, 2002, 421–431 DOI:10.1007/3-540-47987-2_45

2. Zhao T L, Jia L, Lu Y F, Han S P, Li C L. An automatic pronunciation teaching system for Chinese to learn English. In: IEEE International Conference on Robotics, Intelligent Systems and Signal Processing. Changsha, Hunan, China, IEEE, 2003, 1157–1161 DOI:10.1109/rissp.2003.1285754

3. Huang F, Zhou Y, Yu Y, Wang Z Q, Du S D. Piano AR: a markerless augmented reality based piano teaching system. In: 2011 Third International Conference on Intelligent Human-Machine Systems and Cybernetics. Zhejiang, China, IEEE, 2011, 47–52 DOI:10.1109/ihmsc.2011.82

4. Özyurt H, Baki A. Design and development of an innovative individualized adaptive and intelligent e-learning system for teaching-learning of probability unit: details of UZWEBMAT. Expert Systems with Applications, 2013, 40(8): 2914–2940 DOI:10.1016/j.eswa.2012.12.008

5. Yan H, Hu H Y. Research and realization of ISIC-CDIO teaching experimental system based on RFID technology of web of things. Journal of Bionanoscience, 2013, 7(6): 696–702 DOI:10.1166/jbns.2013.1172

6. GAO J, Zhang Z, Song Q, Ding Y, Li Q, Lin Y. Design and practice of visualized teaching system in polymer chemistry. Polymer Bulletin, 2013, 35(2): 94–98

7. Sun Q, Liu S, Sunaoka K, Hiki S. Visual displays of the voice pitch pattern for the CAI self-teaching system to discriminate Chinese tones. Journal of the Acoustical Society of America, 2012, 131(4): 060007 DOI:10.1121/1.4887505

8. Xie J. Design of electronic fault principle and maintenance teaching system for missile equipment. In: China Conference on System Simulation Technology And its Application. 2014

9. Lin H I, Lin Y H. A novel teaching system for industrial robots. Sensors (Basel, Switzerland), 2014, 14(4): 6012–6031 DOI:10.3390/s140406012

10. Luan F. Development of hydraulic transmission virtual simulation teaching system based on Unity3D. 2015

11. Li J, Su Z, Huang Y, Gou X. Adaptive network teaching system design based on learning analysis. Modern Education Technology, 2016, 26 (6): 113–118

12. Hsiao H S, Chang C S, Lin C Y, Chen B, Wu C H, Lin C Y. The development and evaluation of listening and speaking diagnosis and remedial teaching system. British Journal of Educational Technology, 2016, 47(2): 372–389 DOI:10.1111/bjet.12237

13. Chen G, Chen N. Motion simulation in virtual basketball shooting teaching system. International Journal of Online Engineering (IJOE), 2016, 12(2): 55–57 DOI:10.3991/ijoe.v12i02.5049

14. Wang B, Li Y, Yang L. Design of micro-course teaching system for electronic majors based on JSP. Henan Science And Technology, 2017 (5): 15–18

15. Lou M Y. A virtual reality teaching system for graphic design course. International Journal of Emerging Technologies in Learning (IJET), 2017, 12(9): 117 DOI:10.3991/ijet.v12i09.7492

16. Deng L M. Design of English teaching system for human-computer dialogue based on cloud computing. In: 2018 International Conference on Intelligent Transportation, Big Data & Smart City (ICITBS). Xiamen, China, IEEE, 2018, 283–286 DOI:10.1109/icitbs.2018.00079

17. Feng J, Zhang D, Li W, Dong L. Design of an auxiliary teaching system based on virtual reality. China Science And Technology Information, 2018 (1): 57–58

18. Liu T, Min P, Xiao H. Design and implementation of elementary school mathematics teaching system for arithmetic based on JAVA. Computer and Digital Engineering, 2018, 46(4): 655–658

19. Li Y X, Zhang D, Guo H X, Shen J Y. A novel virtual simulation teaching system for numerically controlled machining. The International Journal of Mechanical Engineering Education, 2018, 46(1): 64–82 DOI:10.1177/0306419017715426

20. Gao B, Liu Z, Huo K, Jiao F. Development of experimental teaching system for maintenance technology of high-speed emu based on virtual simulation. Experimental Technology and Management, 2020, 37 (3): 139–142

Full Text

8 PDF

787 HTML

EXPORT

EndNote ProCite Reference Manager BibTex RefWorks

SHARE ON

ARTICLES BY AUTHORS

VRIH

BAIDU SCHOLAR

WANFANG DATA

CNKI