ระบบแบ่งปันสูตรการทำอาหารและค้นหาสูตรการทำอาหารจากภาพวัตถุดิบด้วยเทคนิคการเรียนรู้เชิงลึก(A System for Cooking Recipe Sharing and Cooking Recipe Finding by an Image of Ingredients using Deep Learning Technique)
Keywords:
Deep learning, YOLO algorithm, Image recognition, Image classification, Mobile applicationAbstract
Abstract
Nowadays, healthy eating is very popular. People start to cook their own food from existing cooking ingredients. However, sometimes they do not know what food can be cooked from existing ingredients. Therefore, they cook the same food, resulting in monotonous eating and not enjoy cooking. This research article presents the design and development of a system for cooking recipe sharing and cooking recipe finding by an image of ingredients using deep learning techniques. Users can use the application on mobile devices to share cooking recipes. Moreover, users can take a picture of ingredients that users already have in the kitchen such as garlic, pork, vegetables, etc. and send that picture into the system to search for cooking recipes from existing ingredients. This process will make users convenient for searching cooking recipes. The main components of the system include (1) A mobile application for general users developed with React Native, which users can add cooking recipes and search for cooking recipes by entering the ingredient names. Also, the user can use the mobile device to take a picture of ingredients to find cooking recipes, (2) Web application developed on the MERN stack for system administrators, which system administrators can add keywords of the search term for ingredients and test the model that has been created, and (3) Deep convolutional neural network using the YOLO algorithm through the Darknet library for creating the image recognition model. The model has taught to be able to recognize 20 types of ingredients using 100 images of each type of ingredient. After training our model for 36,000 rounds, the model has an average loss of 0.0408 with the precision, recall and F1-score at 0.96, 0.98 and 0.97 respectively.
References
[2] G. Karatas, O. Demir and O. Koray Sahingoz, "Deep Learning in Intrusion Detection Systems", 2018 International Congress on Big Data, Deep Learning and Fighting Cyber Terrorism (IBIGDELFT), ANKARA, Turkey, 2018, pp. 113-116.
[3] J. Deng, W. Dong, R. Socher, L.-J. Li, K. Li, L. Fei-Fei, "ImageNet: A large-scale hierarchical image database", CVPR, 2009.
[4] M. A. Subhi and S. Md. Ali, "A Deep Convolutional Neural Network for Food Detection and Recognition", 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), Sarawak, Malaysia, 2018, pp. 284-287.
[5] M. Chen, L. Zhang and J. P. Allebach, "Learning Deep Features For Image Emotion Classification", 2015 IEEE International Conference on Image Processing (ICIP), Quebec City, QC, 2015, pp. 4491-4495.
[6] C. Huang, "Combining Convolutional Neural Networks For Emotion Recognition", 2017 IEEE MIT Undergraduate Research Technology Conference (URTC), Cambridge, MA, 2017, pp. 1-4.
[7] G. A. R. Kumar, R. K. Kumar and G. Sanyal, "Discriminating Real From Fake Smile Using Convolution Neural Network", 2017 International Conference on Computational Intelligence in Data Science(ICCIDS), Chennai, 2017, pp. 1-6.
[8] Mongodb, [online] Available: http://www. mongodb.org/, 21 May 2019.
[9] React, [online] Available: https://reactjs.org/, 21 May 2019.
[10] Node.js [online] Available: https://nodejs.org/, 21 May 2019.
[11] React Native, [online] Available: https:// facebook .github.io/react-native/, 21 May 2019.
[12] J. Redmon, S. Divvala, R. Girshick and A. Farhadi, "You Only Look Once: Unified, Real-Time Object Detection," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016, pp. 779-788.
[13] R. Shaoqing, H. Kaiming, G. Ross and S. Jian, “Faster R-CNN: Towards Real-time Object Detection with Region Proposal Networks”, Advances in Neural Information Processing System 28, Curran Associates, Inc., 2015, pp. 91-99.
[14] J. Redmon and A. Farhadi, “YOLO9000: Better, Faster, Stronger”, CoRR, 2016.
[15] J. Redmon and A. Farhadi, “YOLOv3: An Incremental Improvement”, CoRR, 2018.
[16] L. Pan, S. Pouyanfar, H. Chen, J. Qin and S. Chen, "DeepFood: Automatic Multi-Class Classification of Food Ingredients Using Deep Learning", 2017 IEEE 3rd International Conference on Collaboration and Internet Computing (CIC), San Jose, CA, 2017, pp. 181-189.
[17] N. Hnoohom and S. Yuenyong, "Thai Fast Food Image Classification Using Deep Learning", 2018 International ECTI Northern Section Conference on Electrical, Electronics, Computer and Tele-communications Engineering (ECTI-NCON), Chiang Rai, 2018, pp. 116-119.
[18] Darknet, [online] Available: https://github.com/ pjreddie/darknet, 21 May 2019.
