Ensemble Transfer Learning for Image Classification
Article Sidebar
Main Article Content
Abstract
The deep learning (DL) techniques used for image classification might not deliver the desired level of classification accuracy as some features belonging to some class of a dataset are missed during feature extraction. The ensemble learning (EL) based model improves classification accuracy by combining the strengths of individual classifiers. As a result, those features that were missed during feature extraction by a specific DL technique will be taken care of by another DL technique in an ensemble DL approach. In this paper, averaging EL (AENet), weighted averaging EL (WAENet), and stacking EL (StackedNet) approaches are proposed, considering the DenseNet201, EcientNetB0, and ResNetRS101 as base models. The predictions of the base models are averaged to generate the AENet. The WAENet is constructed by assigning weights to each base model based on their prediction and then taking their average. Similarly, the Stacked-Net is developed by considering the DenseNet201, EcientNetB0, and ResNetRS101 as base-learners and ResNetRS101 as meta-learner. Analysed performance of the considered pre-trained base models and the developed EL models on the standard and application-specific datasets such as MiniImageNet, CIFAR10, CIFAR100, Plant Village (PV), Tomato, Covid-19 and 9IndianFood. 80% of the datasets were used to train and 20% to test the base and proposed models. The models are trained for an epoch of 30, considering a learning rate of 0.001 and adam optimizer. The stackedNet delivered better results than others.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
N. K. Sarkar, M. M. Singh and U. Nandi, “Recent researches on image classification using deep learning approach,” International Journal of Computing and Digital Systems, vol. 12, no. 1, pp. 1357–1374, 2022.
F. Zhuang et al., “A Comprehensive Survey on Transfer Learning,” in Proceedings of the IEEE, vol. 109, no. 1, pp. 43-76, Jan. 2021.
M. Iman, H. R.Arabnia and K. Rasheed, “A review of deep transfer learning and recent advancements,” Technologies vol. 11, no. 2, 2023.
E. Deniz et al., “Transfer learning based histopathologic image classification for breast cancer detection,” Health information science and systems, vol. 6, no.1:18, pp. 1–7, 2018.
G. Huang, Z. Liu, L. V. D. Maaten and K. Q. Weinberger, “Densely connected convolutional networks,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 4700–4708, 2017.
M. Tan and Q. V. Le, “Efficientnet: Rethinking model scaling for convolutional neural networks,” in International Conference on Machine Learning, pp. 6105–6114, 2019.
K. He, X. Zhang, S. Ren and J. Sun, “Deep residual learning for image recognition,” in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778, 2016.
S. K. Upadhyay and A. Kumar, “A novel approach for rice plant diseases classification with deep convolutional neural network,” International Journal of Information Technology, vol. 14, no. 1, pp. 185–199, 2022.
O. Attallah, “Tomato leaf disease classification via compact convolutional neural networks with transfer learning and feature selection,” Horti culturae, vol. 9, no.2:149, 2023.
F. A. Shah et al., “Towards intelligent detection and classification of rice plant diseases based on leaf image dataset,” Computer Systems Science & Engineering, vol. 47, no. 2, 2023.
N. K. Sarkar, M. M. Singh and U. Nandi, “A novel deep neural network model using network deconvolution with attention based activation for crop disease classification,” Multimedia Tools and Applications, vol. 83, no. 6, pp. 17025–17045, 2023.
Z. Zhang, Q. Gao, L. Liu and Y. He, “A High-Quality Rice Leaf Disease Image Data Augmentation Method Based on a Dual GAN,” in IEEE Access, vol. 11, pp. 21176-21191, 2023.
Q. Pan, M. Gao, P. Wu, J. Yan and M. A. AbdelRahman, “Image classification of wheat rust based on ensemble learning,” Sensors, vol. 22, no. 16:6047, 2022.
T. Aboneh, A. Rorissa and R. Srinivasagan, “Stacking-based ensemble learning method for multi-spectral image classification,” Technologies, vol. 10, no. 1:17, 2022.
H.-T. Vo, L.-D. Quach and T. N. Hoang, “Ensemble of deep learning models for multi-plant disease classification in smart farming,” International Journal of Advanced Computer Science and Applications, vol. 14, no. 5, 2023.
Z. Rahman, M. S. Hossain, M. R. Islam and M. M. Hasan and R. A. Hridhee, “An approach for multiclass skin lesion classification based on ensemble learning,” Informatics in Medicine Unlocked, vol. 25, no. 100659, 2021.
Y. Zheng et al., “Application of transfer learning and ensemble learning in image-level classification for breast histopathology,” Intelligent Medicine, vol. 3, no. 2, pp. 115–128, 2023.
D. M¨uller, I. Soto-Rey and F. Kramer, “An Analysis on Ensemble Learning Optimized Medical Image Classification With Deep Convolutional Neural Networks,” in IEEE Access, vol. 10, pp. 66467-66480, 2022.
A. K. Das, S. Ghosh, S. Thunder, R. Dutta, S. Agarwal and A. Chakrabarti, “Automatic covid-19 detection from x-ray images using ensemble learning with convolutional neural network,” Pattern Analysis and Applications, vol. 24, pp. 1111–1124, 2021.
S. Balasubramaniam and K. S. Kumar, “Optimal ensemble learning model for covid-19 detection using chest x-ray images,” Biomedical Signal Processing and Control, vol. 81, no. 104392, 2023.
G. Batchuluun, S. H.Nam and K. R.Park, “Deep learning-based plantimage classification using a small training dataset,” Mathematics, vol. 10, no. 17:3091, 2022.
S. M. Javidan, A. Banakar, K. A. Vakilian and Y. Ampatzidis, “Tomato leaf diseases classification using image processing and weighted ensemble learning,” Agronomy Journal, vol. 116, no. 3, pp. 1029-1049, 2023.
J. Chen, A. Zeb, Y. Nanehkaran and D. Zhang, “Stacking ensemble model of deep learning for plant disease recognition,” Journal of Ambient Intelligence and Humanized Computing, vol. 14, no. 9, pp. 12359–12372, 2023.
G. VijayaKumari, P. Vutkur and P. Vishwanath, “Food classification using transfer learning technique,” Global transitions proceedings, vol. 3, no. 1, pp. 225–229, 2022.
F. S. Konstantakopoulos, E. I. Georga and D. I. Fotiadis, “A review of imagebased food recognition and volume estimation artificial intelligence systems,” IEEE Reviews in Biomedical Engineering, vol. 14, pp. 136-152, 2024.
Y. Kumar et al., “Automated detection and recognition system for chewable food items using advanced deep learning models,” Scientific Reports, vol. 14, no. 6589, 2024.
D. Xue et al., “An Application of Transfer Learning and Ensemble Learning Techniques for Cervical Histopathology Image Classification,” in IEEE Access, vol. 8, pp. 104603-104618, 2020.
D. Arpit, H. Wang, Y. Zhou and C. Xiong, “Ensemble of averages: Improving model selection and boosting performance in domain generalization,” Advances in Neural Information Processing Systems, vol. 35, pp. 8265–8277, 2022.
[Online]. Available:https://www.cs.toronto.edu/kriz/cifar.html[Accessed: May 10, 2024].
[Online]. Available:https://www.kaggle.com/datasets/arjunashok33/miniimagenet[Accessed:].
[Online]. Available:https://www.kaggle.com/datasets/mohitsingh1804/plantvillage. [Accessed: April 25, 2024].
[Online]. Available:https://www.kaggle.com/datasets/jigarsharp/indian-food-9-class. [Accessed: May 13, 2024].
[Online]. Available:https://www.kaggle.com/datasets/tawsifurrahman/covid19-radiographydatabase.[Accessed:May 13, 2024].
H.-T. Vo, L.-D. Quach and H. T. Ngoc, “Ensemble of Deep Learning Models for Multi-plant Disease Classification in Smart Farming,” International Journal of Advanced Computer Science and Applications(IJACSA), vol. 14, no. 5, 2023.
H. Uluta¸s and V. Aslanta¸s, “Design of efficient methods for the detection of tomato leaf disease utilizing proposed ensemble cnn model,” Electronics, vol. 12, no. 4:827, 2023.
P. Kaur et al., “DELM: Deep Ensemble Learning Model for Multiclass Classification of Super Resolution Leaf Disease Images,” Turkish Journal of Agriculture and Forestry, vol. 47, no. 5:12, pp. 727-745, 2023.
M. Astani, M. Hasheminejad and M. Vaghefi, “A diverse ensemble classifier for tomato dis-
ease recognition,” Computers and Electronics in Agriculture, vol. 198, no. 107054, 2022.
E. Saraswathi and J. FarithaBanu, “A Novel Ensemble Classification Model for Plant Disease Detection Based on Leaf Images,” 2023 International Conference on Artificial Intelligence and Knowledge Discovery in Concurrent Engineering (ICECONF), Chennai, India, pp. 1-7, 2023.
M. R. Ahmed et al., “Towards Automated Detection of Tomato Leaf Diseases,” 2024 6th International Conference on Electrical Engineering and Information & Communication Technology (ICEEICT), Dhaka, Bangladesh, pp. 387-392, 2024.
J. Patel and K. Modi, “Indian food image classification and recognition with transfer learning technique using mobilenetv3 and data augmentation,” Engineering Proceedings vol. 56, no.1:197, 2023.
H. H. Eldawoudy, M. A. Mohamed and E. AbdElhalim, “An Ensemble DNN Model for Automatic Detection of COVID-19 from CXR Scans,” Mansoura Engineering Journal, vol. 49 , no.1:10, 2023.
M. Azam, A. Yousaf, F. Zafar, M. S. Munir and M. I. Saeed, “A Realtime Data Analysis Approach for Predicting COVID-19 Outcomes using Heterogeneous Ensemble Learning,” 2023 International Conference on Engineering and Emerging Technologies (ICEET), Istanbul, Turkiye, pp. 1-6, 2023.
T. H. Bui, K. Hamamoto, L. K. Bui and M. P. Paing, “Multi-Disease Classification of COVID-19 in Chest Radiographs using Ensemble of Optimized Deep Learning Models,” 2023 15th Biomedical Engineering International Conference (BMEiCON), Tokyo, Japan, pp. 1-5, 2023.
S. Jain, P. Jaidka and V. Jain, “Deep Learning Ensemble Method for Plant Disease Classification,” 2023 International Conference on Communication, Security and Artificial Intelligence (ICCSAI), Greater Noida, India, pp. 383-387, 2023.
V. Pandiyaraju et al., “Improved tomato leaf disease classification through adaptive ensemble models with exponential moving average fusion and enhanced weighted gradient optimization,” Frontiers in Plant Science, vol. 15, 2024.
P. Khanarsa and S. Kitsiranuwat, “Deep Learning-based Ensemble Approach for Conventional Pap Smear Image Classification,” ECTI- CIT Transactions, vol. 18, no. 1, pp. 101–111, Feb. 2024.
N. Alabid, “Interpretation of Spatial Relationships by Objects Tracking in a Complex Streaming Video,” ECTI-CIT Transactions, vol. 15, no. 2, pp. 245–257, May 2021.
A. Dey, S. Biswas and L. Abualigah, “Efficient Violence Recognition in Video Streams using ResDLCNN-GRU Attention Network,” ECTI-CIT Transactions, vol. 18, no. 3, pp. 329–341, Jul. 2024.