Classification of durian maturity using a convolutional neural network

Main Article Content

Yingyos Thipsrirach
Monika Kosacka-Olejnik
Kanisorn Poonikom

Abstract

The maturity of a durian fruit is one of the important factors that are considered when assessing the appropriate quality of fruit for export worldwide. In order to verify the maturity, a high level of professional expertise and long-term experience are required. The best current method for classifying images is a convolutional neural network (CNN), a branch of deep learning. In this study, a CNN method is proposed to classify and predict the stages of maturity of durian fruit. In this experiment, durians were separated into five classes based on the harvesting period: (i) 96 days; (ii) 103 days; (iii) 110 days; (iv) 117 days; and (v) 124 days. Following this, the durian fruits were analyzed to define the dry weight and to allow the stages of maturity to be inspected. The results showed that the average dry weights were 11.31%, 17.76%, 26.65%, 38.94% and 42.13%, respectively. Mature durians have a dry weight of 32% or more, meaning that durians harvested at 117 and 124 days can be classified as mature, while the rest are classified as immature. Data were then collected for all five classes of durian, with 300 images per class, giving a total of 1,500 images. This study mainly focused on comparing three CNN architectures: LeNet-5, AlexNet, and DuNet-12 (our proposed CNN architecture). We also compared two activation functions, tanh and ReLU, and four optimization algorithms: AdaGrad, AdaDelta, RMSProp and Adam. The DuNet-12 architecture with the ReLU activation function and Adam optimizer was the most effective method over a training period of 350 epochs, and yielded a testing accuracy of 98.96%. It had the highest prediction accuracy of 100%. However, the results also demonstrated the efficiency of the proposed durian classification method, and the findings of our experiment could be used to develop equipment for the durian export industry in the future.

Article Details

How to Cite
Thipsrirach, Y., Kosacka-Olejnik, M., & Poonikom, K. (2023). Classification of durian maturity using a convolutional neural network. Engineering and Applied Science Research, 50(3), 233–243. Retrieved from https://ph01.tci-thaijo.org/index.php/easr/article/view/251591
Section
ORIGINAL RESEARCH

References

Ketsa S. Durian-Durio zibethinus. In: Rodrigues S, Oliveira SE, Brito ES, editors. Exotic fruits reference guide. United Kingdom: Andre Gerhard Wolff; 2018. p. 169-80.

Subhadrabandhu S, Ketsa S. Area of production and economic importance. In: Subhadrabandhu S, Ketsa S, editors. Durian-King of tropical fruit. New Zealand: CABI; 2001. p. 11-24.

Siriphanich J. Durian (Durio zibethinus Merr.). In: Yahia EM, editor. Postharvest biology and technology of tropical and subtropical fruits volume 2. United Kingdom: Woodhead Publishing; 2011. p. 80e-116e.

Gasik L. Trends in Asian and Western durian consumer behavior, attitudes, and motivations. Acta Horticulture. 2017;1186:215-22.

Charoenkiatkul S, Thiyajai P, Judprasong K. Nutrients and bioactive compounds in popular and indigenous durian (Durio zibethinus murr.). Food Chem. 2016;193:181-6.

Yee SYY. Medicinal properties of bioactive of bioactive compounds and antioxidant activity in Durio zibethinus. Malays J Sustain Agric. 2021;5(2):82-9.

Aziz NAA, Jalil AMM. Bioactive compounds, nutritional value, and potential health benefits of indigenous durian (Durio Zibethinus Murr.): a review. Foods. 2019;8(3):1-18.

Ali MM, Hashim N, Aziz SA, Lasekan O. Exploring the chemical composition, emerging applications, potential uses, and health benefits of durian: a review. Food Control. 2020;113:107189.

Rueangrit P, Jatuporn C, Suvanvihok V, Wanaset A. Forecasting production and export of Thailand’s durian fruit: an empirical study using the box-jenkins approach. Humanit Soc Sci Lett. 2020;8(4):430-7.

Office of Agricultural Economics. Durian [Internet]. 2022 [cited 2022 May 7]. Available from: http://impexp.oae.go.th/service/ export.php?S_YEAR=2554&E_YEAR=2562&PRODUCT_GROUP=5252&PRODUCT_ID=4977&wf_search=&WF_SEARCH=Y.

Thardphaiboon P, Aungsuratana AO, Wanichkul K, Aroonrungsikul C. Farmers’ perception on durian innovation: a case study of GAD-certified orchards in Chanthaburi province, eastern Thailand. Kasetsart J (Soc Sci). 2013;34:152-61.

Datepumee N, Sukprasert P, Jatuporn C, Thongkaew S. Factors affecting the production of export quality durian by farmers in Chanthaburi province, Thailand. J Sustain Sci Manag. 2019;14(4):94-105.

National Bureau of Agricultural Commodity and Food Standards. Thai Agricultural Standard TAS 3-2013; Durian [Internet]. 2022 [cited 2022 May 7]. Available from: http://patricklepetit.jalbum.net/RAYONG/LIBRARY/durian-TIS.pdf.

ASEAN. ASEAN Standard for Durian [Internet]. 2022 [cited 2022 May 7]. Available from: https://asean.org/wp-content/uploads/2012/05/1-ASEAN-STANDARD-FOR-DURIAN-REV-2012.pdf.

Timkhum P, Terdwongworakul A. Non-destructive classification of durian maturity of ‘Monthong’ cultivar by means of visible spectroscopy of the spine. J Food Eng. 2012;112(4):263-7.

Somton W, Pathaveerat S, Terdwongworakul A. Application of near infrared spectroscopy for indirect evaluation of “Monthong” durian maturity. Int J Food Prop. 2015;18(6):1155-68.

Yantarasri T, Kalayanamitra K, Saranwong S, Sornsrivichai J. Evaluation of the maturity index for durian fruit by various destructive and non-destructive techniques. Proceeding of Quality Assurance in Agricultural Produce; 1999 Nov 9-12; Ho Chi Minh City, Vietnam. Canberra: ACIAR Australia; 1999. p. 700-5.

Kongrattanaprasert W, Arunrungrusmi S, Pungsiri B, Chamnongthai K, Okuda M. Nondestructive maturity determination of durian by force vibration and ultrasonic. Int J Uncertain Fuzziness Knowledge-Based Syst. 2001;9(6):703-19.

Rutpralom T, Kumhom P, Chamnongthai K. Nondestructive maturity determination of durian by using microwave moisture sensing. Proceedings of IEEE International Conference on Industrial and Technology (ICIT); 2002 Dec 11-14; Bangkok, Thailand. USA: IEEE; 2002. p. 155-8.

Sawetmethikul P, Nimkerdphol K. Non-Destructive classification of Thai Cha-Nee durian maturity with near-field reflection mode measurement using at 3.4 -GHz microwove sensor. Proceedings of the 6th UPI International Conference on TVET 2020 (TVET 2020); 2020 Sep 16-17; Bandung, Indonesia. Netherlands: Atlantis Press; 2020. p. 285-91.

Cheepsomsong T, Siriphanich J. Durian volume determination using short-range coded-light three-dimensional scanner. Agr Nat Resour. 2022;56(1):113-20.

Lecun Y, Bottou L, Bengio Y, Haffner P. Gradient-based learning applied to document recognition. Proc IEEE. 1998;86(11):2278-324.

Krizhevsky A, Sutskever I, Hinton GE. ImageNet classification with deep convolutional neural networks [Internet]. 2021 [cited 2021 Jan 12]. Available from: https://proceedings.neurips.cc/paper/2012/file/c399862d3b9d6b76c8436e924a68c45b-Paper.pdf.

Rustam Z, Hartini S, Pratama RY, Yunus RE, Hidayat R. Analysis of architecture combining convolutional neural network (CNN) and kernel K-means clustering for lung cancer diagnosis. Int J Adv Sci Eng Inf Technol. 2020;10(3):1200-6.

Sriwiboon N. Improvement the performance of the chest X-ray image classification with convolutional neural network model by using image augmentation technique for COVID-19 Diagnosis. J KMUTNB. 2021;31(1):109-117. (In Thai)

Angkoso CV, Tjahyaningtijas HPA, Purnomo MH, Purnama IKE. Multiplane convolutional neural network (Mp-CNN) for Alzheimer’s disease classification. Int J Intell Eng Syst. 2022;15(1):329-40.

Raghavan J, Ahmadi M. A modified CNN-Based face recognition system. Int J Artif Intell Appl. 2021;12(2):1-20.

Cheng WC, Hsiao HC, Lee DW. Face recognition system with feature normalization. Int J Appl Sci Eng. 2020;18(1):1-9.

Ahmed AA, Reddy GH. A mobile-based system for detecting plant leaf disease using deep learning. AgriEng. 2021;3(3):478-93.

Tan L, Lu J, Jiang H. Tomato leaf disease classification based on leaf images: a comparison between classical machine learning and deep learning methods. AgriEng. 2021;3(3):542-58.

Rahmat H, Wahjuni S, Rahmawan H. Performance analysis of deep learning-based object detectors on raspberry pi for detecting melon leaf abnormality. Int J Adv Sci Eng Inf Technol. 2022;12(2):572-9.

Khatun M, Ali F, Turzo NA, Nine J, Sarker P. Fruits classification using convolutional neural network. Global Res Dev J Eng. 2020;5(8):1-6.

Risdin F, Mondal PK, Hassan KM. Convolutional neural network (CNN) for detecting fruit information using machine learning techniques. IOSR J Comput Eng. 2020;22(2):1-13.

Pathak R. Classification of fruits using convolutional neural network and transfer learning models. J Manag Inf Decis Sci. 2021;24(S3):1-12.

Yang M, Cho SI. Fruit classification using convolutional neural network (CNN). Precis Agric Sci Technol. 2021;3(1):1-8.

Azizah LMR, Umayah SF, Riyadi S, Damarjati C, Utama NA. Deep learning implementation using convolutional neural network in mangosteen surface defect detection. The 7th IEEE International Conference on Control System, Computing and Engineering (ICCSCE); 2017 Nov 24-26; Penang, Malaysia. USA: IEEE; 2017. p. 242-6.

Mohtar IA, Ramli NSS, Ahmad Z. Automatic classification of mangosteen ripening stage using deep learning. The 1st International Conference on Artificial Intelligence and Data Science (AiDAS); 2019 Sep 19; Perak, Malaysia. USA: IEEE; 2019. p. 44-7.

Kunakornvong P, Asriny DM. Apple image classification using convolutional neural network. The 34th International Technical Conference o Circuits/Systems, Computers and Communications (ITC-CSCC); 2019 Jun 23-26; Jeju Island, Korea. p. 1-4.

Rhamadiyanti DT, Suyanto S. Robustness of convolutional neural network in classifying apple images. International Seminar on Intelligent Technology and Its Applications (ISITIA); 2021 Jul 21-22; Sarabaya, Indonesia. USA: IEEE; 2021. p. 226-31.

Benmouna B, Garcia-Mateos G, Sabzi S, Fernandez-Beltran R, Parras-Burgos D, Molina-Martínez JM. Convolutional neural network for estimating the ripening state of Fuji apples using visible and near-infrared spectroscopy. Food Bioprocess Technol. 2022;15:2226-36.

Zeng X, Miao Y, Ubaid S, Gao X, Zhuang S. Detection and classification of bruised of pears based on thermal images. Postharvest Biol Technol. 2020;161:111090.

Asriny DM, Rani S, Hidayatullah AF. Orange fruit images classification using convolutional neural networks. IOP Conf Ser: Mater Sci Eng. 2020;803:012020.

Lim GM, Chuah JH. Durian type recognition using deep learning techniques. The 9th IEEE Control and System Graduate Research Colloquium (ICSGRC); 2018 Aug 3-4; Shah Alam, Malaysia. USA: IEEE; 2018. p. 183-7.

Kharamat W, Wongsaisuwan M, Wattanamongkhol N. Durian ripeness classification from the knocking sounds using convolutional neural network. 8th International Electrical Engineering Congress (iEECON); 2020 Mar 4-6; Chiang Mai, Thailand. USA: IEEE; 2020. p. 1-4.

Uy JN, Villaverde JF. A durian variety identifier using canny edge and CNN. IEEE 7th International Conference on Control Science and Systems Engineering (ICCSSE); 2021 Jul 30-Aug 1; Qingdao, China. USA: IEEE; 2021. p. 293-7.

Honsho C, Yonemori K, Sugiura A, Somsri S, Subhadrabandhu S. Durian floral differentiation and flowering habit. J Amer Soc Hort Sci. 2004;129(1):42-5.

Sangwanangkul P, Siriphanich J. Growth and maturation of durian fruit cv. Monthong. Thai J Agric Sci. 2000;33:75-82.

Haryanto B, Budiastra IW. Study of relationship between ripeness and specific gravity of durian. Agritech. 2000;20(4):179-82. (In Indonesia)

Nwankpa C, Ijomah W, Gachagan A, Marshall S. Activation functions: comparison of trends in practice and research for deep learning [Internet]. 2021 [cited 2021 Jan 12]. Available from: https://arxiv.org/pdf/1811.03378.pdf.

Dubey SR, Singh SK, Chaudhuri BB. Activation functions in deep learning: a comprehensive survey and benchmark. Neurocomputing. 2022;503:92-108.

Soydaner D. A comparison of optimization algorithms for deep learning. Int J Pattern Recognit Artif Intell. 2020;34(13):1-26.

Zaheer R, Shaziya H. A study of the optimization algorithms in deep learning. The 3rd International Conference on Inventive Systems and Control (ICISC). 2019 Jan 10-11; Coimbatore, India. USA: IEEE; 2019. p. 536-9.