Virtual simulation experiment of the design and manufacture of a beer bottle-defect detection system

Yuxiang ZHAO ¹ , Xiaowei AN ² , Nongliang SUN ¹

1. College of Electronic and Information Engineering, Shandong University of Science and Technology, Qingdao 266590, China

2. College of Electrical Engineering and Automation, Shandong University of Science and Technology, Qingdao 266590, China

Abstract

Background

Machine learning-based beer bottle-defect detection is a complex technology that runs automatically; however, it consumes considerable memory, is expensive, and poses a certain danger when training novice operators. Moreover, some topics are difficult to learn from experimental lectures, such as digital image processing and computer vision. However, virtual simulation experiments have been widely used to good effect within education. A virtual simulation of the design and manufacture of a beer bottle-defect detection system will not only help the students to increase their image-processing knowledge, but also improve their ability to solve complex engineering problems and design complex systems.

Methods

The hardware models for the experiment (camera, light source, conveyor belt, power supply, manipulator, and computer) were built using the 3DS MAX modeling and animation software. The Unreal Engine 4 (UE4) game engine was utilized to build a virtual design room, design the interactive operations, and simulate the system operation.

Results

The results showed that the virtual-simulation system received much better experimental feedback, which facilitated the design and manufacture of a beer bottle-defect detection system. The specialized functions of the functional modules in the detection system, including a basic experimental operation menu, power switch, image shooting, image processing, and manipulator grasping, allowed students (or virtual designers) to easily build a detection system by retrieving basic models from the model library, and creating the beer-bottle transportation, image shooting, image processing, defect detection, and defective-product removal. The virtual simulation experiment was completed with image processing as the main body.

Conclusions

By mainly focusing on bottle mouth-defect detection, the detection system dedicates more attention to the user and the task. With more detailed tasks available, the virtual system will eventually yield much better results as a training tool for image-processing education. In addition, a novel visual perception-thinking pedagogical framework enables better comprehension than the traditional lecture-tutorial style.

Keyword

Virtual simulation experiment ; Beer bottle defect detection ; Image processing ; Training tool

Cite this article

Yuxiang ZHAO, Xiaowei AN, Nongliang SUN. Virtual simulation experiment of the design and manufacture of a beer bottle-defect detection system. Virtual Reality & Intelligent Hardware, 2020, 2(4): 354-367 DOI:10.1016/j.vrih.2020.07.002

References

1. Lamb R, Antonenko P, Etopio E, Seccia A. Comparison of virtual reality and hands on activities in science education via functional near infrared spectroscopy. Computers & Education, 2018, 124: 14–26 DOI:10.1016/j.compedu.2018.05.014

2. Zhang G H, Ren M. Design of image processing experimental system based on Matlab GUI. Journal of Hebei North University (Natural Science Edition ), 2018, 34(5): 24–28 DOI:10.3969/j.issn.1673-1492.2018.05.005

3. Lu T, Deng H L, Wang T, Cheng H, Cheng L Q, Liu L Q, Xue F. Design and implementation of image processing system. Computer Engineering & Software, 2020, 41(1): 74–78 DOI:10.3969/j.issn.1003-6970.2020.01.016

4. Guo Y Z, Li J Y, Wan B X, Zhang W W. Design of virtual experiment platform about "digital image processing" course. Techniques of Automation & Applications, 2018, 37(12): 168–170

5. Zhang G C, Wan S P, He J R. Development & design of digital image processing system based on Matlab GUI. Computer Engineering & Software, 2019, 40(11): 123–127 DOI:10.3969/j.issn.1003-6970.2019.11.027

6. Wang W C, Li J, Wang R L, Wu X J, Sun X Y. Design and development to f simulation platform for digital image processing based on Matlab GUI. Experimental Technology and Management, 2019, 36(2): 141–144 DOI:10.16791/j.cnki.sjg.2019.02.034

7. Raes A, Vanneste P, Pieters M, Windey I, van den Noortgate W, Depaepe F. Learning and instruction in the hybrid virtual classroom: an investigation of students' engagement and the effect of quizzes. Computers & Education, 2020, 143: 103682 DOI:10.1016/j.compedu.2019.103682

8. Gong L H, Zhu Q B, Zhou Z H, Zhou N R. Comprehensive design experiment for digital image processing based on Matlab. Experimental Technology and Management, 2018, 35(11): 48–53 DOI:10.16791/j.cnki.sjg.2018.11.011

9. Ma H L, Zha S L, Wu Y H, Zhu Z, Jiang J L. Experimental teaching research of digital image processing based on LabView and Matlab. Journal of Anqing Normal University(Natural Science Edition), 2018, 24(3): 107–109 DOI:10.13757/j.cnki.cn34-1328/n.2018.03.026

10. Yuan R, Luo M, Sun Z, Shi S Y, Xiao P, Xie Q G. RayPlus: a web-based platform for medical image processing. Journal of Digital Imaging, 2017, 30(2): 197–203 DOI:10.1007/s10278-016-9920-y

11. Zhao Q P. Overview of virtual reality. Chinese Science: Information Science, 2009, 39(1): 2–46 DOI：CNKI:SUN:PZKX.0.2009-01-003

12. Guo Q, Zhang L, Zhang F Y, Liu S D, Sun N L. Research on ultra-fast laser experiment simulation system based on virtual reality. Experiment Science and Technology, 2018, 16(6): 124–128 DOI:10.3969/j.issn.1672-4550.2018.06.030

13. Towey D, Walker J, Austin C, Kwong C F, Wei S. Developing virtual reality open educational resources in a sino-foreign higher education institution: challenges and strategies. In: 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE). Wollongong, NSW, Australia, IEEE, 2018, 416–422 DOI:10.1109/tale.2018.8615167

14. Huang Y L, Zhai X, Ali S, Liu R Q. Design and implementation of traditional Chinese medicine education visualization platform based on virtual reality technology. In: 2016 8th International Conference on Information Technology in Medicine and Education (ITME). Fuzhou, China, IEEE, 2016, 499–502 DOI:10.1109/itme.2016.0119

15. Kvasznicza Z. Teaching electrical machines in a 3D virtual space. In: 2017 8th IEEE International Conference on Cognitive Info communications (CogInfoCom). Debrecen, Hungary, IEEE, 2017, 000385–000388 DOI:10.1109/coginfocom.2017.8268276

16. Sakamoto M, Hori M, Shinoda T, Ishizu T, Akino T, Takei A, Ito T. A study on applications for scientific experiments using the VR technology. In: 2018 International Conference on Information and Communication Technology Robotics (ICT-ROBOT). Busan, South Korea, IEEE, 2018, 1–4 DOI:10.1109/ict-robot.2018.8549868

17. Wang J S, Zhao Y Y, Zhong D P, Yan J J. Construction and practice of virtual simulation experiment teaching for thermal power unit. Higher Engineering Education Research, 2019, S1:201–203

18. Schalkoff R J. Digital image processing and computer vision. New York, Wiley, 1989

19. Huang B, Ma S L, Wang P, Wang H J, Yang J F, Guo X Y, Zhang W D, Wang H Q. Research and implementation of machine vision technologies for empty bottle inspection systems. Engineering Science and Technology, an International Journal, 2018, 21(1): 159–169 DOI:10.1016/j.jestch.2018.01.004

20. Liu H J, Wang Y N. Development of glass bottle inspector based on machine vision. In: 2008 10th International Conference on Control, Automation, Robotics and Vision. Hanoi, Vietnam, IEEE, 2008, 785–790 DOI:10.1109/icarcv.2008.4795617

21. EPIC. UE4[EB /OL]. https://docs.unrealengine.com/latest/CHN/index.Html, 2018

Full Text

3 PDF

981 HTML

EXPORT

EndNote ProCite Reference Manager BibTex RefWorks

SHARE ON

ARTICLES BY AUTHORS

VRIH

BAIDU SCHOLAR

WANFANG DATA

CNKI