Thai Antipyretic Medicinal Plant Recognition Using CNNs Integrated into a LINE Chatbot

Main Article Content

Walairach Nunsong
Surasit Sakda
Taravichet Titijaroonroj
Donyarut Kakanopas

Abstract

This study developed a leaf-image recognition system for Thai antipyretic medicinal plants using deep convolutional neural networks (CNNs). Recognizing medicinal plants can be difficult because several species have similar leaf shapes and textures. An automatic recognition tool may help non-expert users identify medicinal plants more consistently. The main contributions are the collection of a 20-species Thai antipyretic herb leaf dataset, the evaluation of eight CNN architectures, and the integration of the selected model into a LINE Chatbot prototype.
A new dataset of leaves from 20 medicinal plants for antipyretics found in southern Thailand was created.
Data augmentation was applied to increase the number and variability of training images. Eight CNN architectures, namely AlexNet, ResNet, VGG, DenseNet, GoogLeNet, EfficientNet, MobileNet, and SqueezeNet, were evaluated for recognizing 20 Thai antipyretic herb species. Lastly, a CNN architecture, which is the best performing, was integrated with a LINE Chatbot for practical application. The experimental results showed that SqueezeNet achieved the highest accuracy of 92.8% with a processing time of 0.004 seconds per image. The SqueezeNet model was therefore selected for integration into the LINE Chatbot prototype.

Article Details

Section
Research Article

References

D. Barhate, S. Pathak, B. K. Singh, A. Jain, and A. K. Dubey, “A systematic review of machine learning and deep learning approaches in plant species detection,” Smart Agric. Technol., vol. 9, 2024, Art. no. 100605, doi: 10.1016/j.atech.2024.100605.

H. Wu, L. Fang, Q. Yu, and C. Yang, “Composite descriptor based on contour and appearance for plant species identification,” Eng. Appl. Artif. Intell., vol. 133, 2024, Art. no. 108291, doi: 10.1016/j.engappai.2024.108291.

C. Yang, “Plant leaf recognition by integrating shape and texture features,” Pattern Recognit., vol. 112, 2021, Art. no. 107809, doi: 10.1016/j.patcog.2020.107809.

P. P. Kaur, S. Singh, and M. Pathak, “Review of machine learning herbal plant recognition system,” unpublished manuscript, 2020, doi: 10.2139/ssrn.3565850.

E. F. Simanjuntak, Y. S. Sipahutar, M. J. Pasaribu, and A. Saleh, “Herbal plant classification using multi-feature extraction and multilayer perceptron,” J. Comput. Sci. Inf. Technol. Telecommun. Eng., vol. 5, no. 2, pp. 607–614, Sep. 2024.

A. H. Vo, H. T. Dang, B. T. Nguyen, and V.-H. Pham, “Vietnamese herbal plant recognition using deep convolutional features,” Int. J. Mach. Learn., vol. 9, no. 3, pp. 363–367, Jun. 2019.

I. A. Md Zin, Z. Ibrahim, D. Isa, S. Aliman, N. Sabri, and N. N. A. Mangshor, “Herbal plant recognition using deep convolutional neural network,” Bull. Elect. Eng. Inform., vol. 9, no. 5, pp. 2198–2205, Oct. 2020.

S. Sangwan, Kanupriya, A. Kaur, V. Mittal, and V. Kumar, “Identification of medicinal plants by visual characteristics of leaves,” Tuijin Jishu/J. Propulsion Technol., vol. 45, no. 2, pp. 931–937, 2024, doi: 10.52783/tjjpt.v45.i02.5988.

A. Fauzi, B. Soerowirdjo, and E. Haryatmi, “Herbal plant leaves classification for traditional medicine using convolutional neural network,” IAES Int. J. Artif. Intell., vol. 13, no. 3, pp. 3322–3329, Sep. 2024, doi: 10.11591/ijai.v13.i3.pp3322-3329.

K. Saputra S, D. Y. Niska, I. Taufik, M. Hidayat, and D. F. Dharma, “Classification of herbal plants based on leaf images using convolutional neural network,” in Proc. 4th Int. Conf. Innov. Educ. Sci. Culture (ICIESC), Medan, Indonesia, Oct. 2022, doi: 10.4108/eai.11-10-2022.2325271.

N. Mettripun, “Thai herb leaves classification based on properties of image regions,” in Proc. 59th Annu. Conf. Soc. Instrum. Control Engineers Jpn. (SICE), Chiang Mai, Thailand, Sep. 2020, pp. 372–377, doi: 10.23919/SICE48898.2020.9240256.

C. Pornpanomchai, S. Rimdusit, P. Tanasap, and C. Chaiyod, “Thai herb leaf image recognition system (THLIRS),” Agric. Nat. Resour., vol. 45, no. 3, pp. 551–562, Jun. 2011.

S. Pornudomthap, R. Rattanatamma, and P. Sangkloy, “Overcoming data limitations in Thai herb classification with data augmentation and transfer learning,” J. Adv. Comput. Intell. Intell. Inform., vol. 28, no. 3, pp. 511–519, 2024.

N. Ruangrungsi and T. Mangkhalakup, Thai Herbs, vol. 1. Bangkok, Thailand: B Healthy (in Thai), 2004.

W. Chuakul, “Indigenous medicinal plants used as antipyretics,” (in Thai), Thai Pharmaceutical Health Sci. J., vol. 4, no. 4, pp. 435–449, Oct.–Dec. 2009. [Online]. Available: https://ejournals.swu.ac.th/index.php/pharm/article/download/2774/2786/9058

I. K. Nti, O. Nyarko-Boateng, and J. Aning, “Performance of machine learning algorithms with different K values in K-fold cross-validation,” Int. J. Inf. Technol. Comput. Sci., vol. 13, no. 6, pp. 61–71, Dec. 2021. doi: 10.5815/ijitcs.2021.06.05.

A. Krizhevsky, I. Sutskever, and G. E. Hinton, “ImageNet classification with deep convolutional neural networks,” Commun. ACM, vol. 60, no. 6, pp. 84–90, 2017, doi: 10.1145/3065386.

K. He, X. Zhang, S. Ren, and J. Sun, “Deep residual learning for image recognition,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Las Vegas, NV, USA, Jun. 2016, pp. 770–778. doi: 10.1109/CVPR.2016.90.

K. Simonyan and A. Zisserman, “Very deep convolutional networks for large-scale image recognition,” presented at the 3rd Int. Conf. Learn. Representations (ICLR), San Diego, CA, USA, May 7–9, 2015.

F. N. Iandola, S. Han, M. W. Moskewicz, K. Ashraf, W. J. Dally, and K. Keutzer, “SqueezeNet: AlexNet-level accuracy with 50x fewer parameters and <0.5 MB model size,” 2016, arXiv:1602.07360.

G. Huang, Z. Liu, L. Van Der Maaten, and K. Q. Weinberger, “Densely connected convolutional networks,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Honolulu, HI, USA, Jul. 2017, pp. 2261–2269, doi: 10.1109/CVPR.2017.243.

C. Szegedy et al., “Going deeper with convolutions,” in Proc. IEEE Conf. Comput. Vis. Pattern Recognit. (CVPR), Boston, MA, USA, Jun. 2015, pp. 1–9, doi: 10.1109/CVPR.2015.7298594.

A. G. Howard et al., “MobileNets: Efficient convolutional neural networks for mobile vision applications,” 2017, arXiv:1704.04861.

M. Tan and Q. V. Le, “EfficientNet: Rethinking model scaling for convolutional neural networks,” in Proc. 36th Int. Conf. Mach. Learn. (ICML), Long Beach, CA, USA, Jun. 2019, pp. 6105–6114.

IT-Online. “Chatbots will appeal to modern workers.” ITONLINE.co.za. Accessed: Aug. 16, 2026. [Online]. Available: https://itonline.co.za/2019/08/06/chatbots-will-appeal-to-modern-workers/

K. M. Ting, “Confusion matrix,” in Encyclopedia of Machine Learning, C. Sammut and G. I. Webb, Eds. Boston, MA, USA: Springer, 2011, p. 209.

R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra, “Grad-CAM: Visual explanations from deep networks via gradient-based localization,” in Proc. IEEE Int. Conf. Comput. Vis. (ICCV), Venice, Italy, Oct. 2017, pp. 618–626, doi: 10.1109/ICCV.2017.74.

D. Sugiarto, J. Siswantoro, M. F. Naufal, and B. Idrus, “Mobile application for medicinal plants recognition from leaf image using convolutional neural network,” Indonesian J. Inf. Syst., vol. 5, no. 2, pp. 43–56, Feb. 2023, doi: 10.24002/ijis.v5i2.6633.

B. R. Pushpa and N. S. Rani, “Ayur-PlantNet: An unbiased light weight deep convolutional neural network for Indian Ayurvedic plant species classification,” J. Appl. Res. Med. Aromatic Plants, vol. 34, Apr. 2023, Art. no. 100459, doi: 10.1016/j.jarmap.2023.100459.