Brain Tumor Detection through Image Fusion Using Cross Guided Filter and Convolutional Neural Network
Article Sidebar
Main Article Content
Abstract
This Data fusion has become a significant issue in diagnostic imaging, particularly in medical applications like radiation and guided image surgery. Medical image fusion aims to enhance the precision of tumor diagnosis, by preserving the salient information and characteristics of the original images in the fused image. It has been shown that guided filters are capable of maintaining edges well. In this paper, we propose a novel cross-guided filter-based fusion approach for multimodal medical images utilizing convolutional neural networks. The cross-guided filter is used in the proposed algorithm to extract the detailed features from the source images. Convolutional neural networks are used to generate the feature weights of source images derived from the detail layers. The weighted average rule is used to merge the source images based on these weights. We used thirty distinct types of medical images from diverse sources to compare the effectiveness of the proposed strategy to that of existing methods, both numerically and visually. The experimental findings demonstrated that, in terms of both objective evaluation and qualitative image quality, the suggested system performs better than other standard methods already in use. The quantitative results show that compared to existing methods under consideration for comparison, the proposed algorithm improves mutual information by 25%, image entropy by 9.5%, spatial frequency by 21%, standard deviation by 18.1%, structural similarity index by 30%, and edge strength of the fused image by 39%.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
L. Ali, I. Wajahat, N. A. Golilarz, F. Keshtkar and S. A. C. Bukhari, “LDA-GA-SVM: improved hepatocellular carcinoma prediction through dimensionality reduction and genetically optimized support vector machine,” Neural Computing and Applications, vol. 33, no. 7, pp. 2783- 2792, 2021.
F. S. Ahmad, L. Ali, H. A. Khattak, T. Hameed, I. Wajahat, S. Kadry and S. A. C. Bukhari, “A hybrid machine learning framework to predict mortality in paralytic ileus patients using electronic health records (EHRs),” Journal of Ambient Intelligence and Humanized Computing, vol.12, no. 3, pp. 3283-3293, 2021.
T. Meraj, H. T. Rauf, S. Zahoor, A. Hassan, M. I. Lali, L. Ali, S. A. C. Bukhari and U. Shoaib,“Lung nodules detection using semantic segmentation and classification with optimal features,” Neural Computing and Applications, vol. 33, pp. 10737-10750, 2021.
S. Kadry, Y. Nam, H. T. Rauf, V. Rajinikanth and I. A. Lawal, “Automated detection of brain abnormality using deep-learning-scheme: a study,” in Proceedings of 2021 7th International Conference On Bio Signals, Images, And Instrumentation (ICBSII), Chennai, India, pp. 1-5, 2021.
M. A. Khan, I. Ashraf, M. Alhaisoni, R. Damasevicius, R. Scherer, A. Rehman, and S. A. C. Bukhari, “Multimodal brain tumor classification using deep learning and robust feature selection: a machine learning application for radiologists,” Diagnostics, vol. 10, no. 8:565, 2020.
V. Rajinikanth, S. Kadry, R. Damasevicius, D. Taniar and H. T. Rauf, “Machine-learning-scheme to detect choroidal-neovascularization in retinal OCT image,” in Proceedings of 2021 7th International Conference on Bio Signals, Images, and Instrumentation (ICBSII), Chennai, India, pp. 1-5, 2021.
M. Srikanth, V. Prasad and K.Satya Prasad, “Brain Tumor Detection Through Modified Optimization Algorithm by Region-based Image Fusion,” ECTI-CIT Transactions, vol. 17, no. 1, pp. 117–127, Mar. 2023.
M. V. Srikanth, V. V. K. D. V. Prasad and K. S. Prasad, “Application of Novel Improved Fire-fly Algorithm for Image Fusion To Detect Brain Tumor,” ECTI-CIT Transactions, vol. 17, no. 2, pp. 292–307, Jun. 2023.
B. Meher, S. Agrawal, R. Panda and A. Abraham, “A survey on region based image fusion methods,” Information Fusion, vol. 48, pp. 119-132, 2019.
S. Li, X. Kang, L. Fang, J. Hu and H. Yin, “Pixel-level image fusion: a survey of the state of the art,” Information Fusion, vol. 33, pp. 100-112, 2017.
H. Zhang, H. Xu, X. Tian, J. Jiang and J. Ma, “Image fusion meets deep learning: a survey and perspective,” Information Fusion, vol. 76, pp. 323-336, 2021.
J. Agarwal and S. S. Bedi, “Implementation of hybrid image fusion technique for feature enhancement in medical diagnosis,” Humancentric Computing and Information Sciences, vol. 5, no. 3, 2015.
S. Aymaz and C. Kose, “Multi-focus image fusion using stationary wavelet transform (SWT) with principal component analysis (PCA),” in Proceedings of 2017 10th International Conference on Electrical and Electronics Engineering (ELECO), Bursa, Turkey, pp. 1176-1180, 2017.
D. P. Bavirisetti and R. Dhuli, “Fusion of infrared and visible sensor images based on anisotropic diffusion and Karhunen-Loeve transform,” IEEE Sensors Journal, vol. 16, no. 1, pp. 203-209, 2015.
J. Ma, Z. Zhou, B. Wang and H. Zong, “Infrared and visible image fusion based on visual saliency map and weighted least square optimization,” Infrared Physics & Technology, vol. 82, pp. 8-17, 2017.
K. Zhan, Y. Xie, H. Wang, and Y. Min, “Fast filtering image fusion,” Journal of Electronic Imaging, vol. 26, no. 6:063004, 2017.
L. Lu, X. Ren, K. H. Yeh, Z. Tan, and J. Chanussot,“Exploring coupled images fusion based on joint tensor decomposition,” Humancentric Computing and Information Sciences, vol. 10, no. 10, 2020.
X. Li, X. Guo, P. Han, X. Wang, H. Li and T. Luo, “Laplacian Redecomposition for Multi-modal Medical Image Fusion,” in IEEE Transactions on Instrumentation and Measurement, vol. 69, no. 9, pp. 6880-6890, Sep. 2020.
B. Goyal, D. C. Lepcha, A. Dogra, V. Bhateja and A. Lay-Ekuakille, “Measurement and analysis of multimodal image fusion metrics based on structure awareness using domain transform filtering,” Measurement, vol. 182, no. 109663, 2021.
J. Jose, N. Gautam, M. Tiwari, T. Tiwari, A. Suresh, V. Sundararaj and M. R. Rejeesh, “An image quality enhancement scheme employing adolescent identity search algorithm in the NSST domain for multimodal medical image fusion,” Biomedical Signal Processing and Control, vol. 66, article no. 102480, 2021.
M. Kaur and D. Singh, “Multi-modality medical image fusion technique using multi-objective differential evolution based deep neural networks,” Journal of Ambient Intelligence and Humanized Computing, vol. 12, no. 2, pp. 2483-2493.(2021)
M. V. Srikanth, V. V. K. D. V. Prasad and K. Satya Prasad, “A 2D Histogram-Based Image Thresholding Using Hybrid Algorithms for Brain Image Fusion,” International Journal of System Dynamics Applications (IJSDA), vol. 11, no. 6, 2021.
M. V. Srikanth, V. V. K. D. V. Prasad and K. Satya Prasad, “An improved firefly algorithm-based 2-D image thresholding for brain image fusion,” International Journal of CognitiveInformatics and Natural Intelligence (IJCINI), vol. 14, no. 3, 2020.
S. Li, X. Kang and J. Hu, “Image Fusion With Guided Filtering,” in IEEE Transactions on Image Processing, vol. 22, no. 7, pp. 2864-2875, Jul. 2013.
H. Zhang, X. Han and R. Zhang, “Multimodal Image Fusion Method Based on Guided Filter,” International Journal of Pattern Recognition and Artificial Intelligence, vol. 36, no. 1:2254003, 2022.
Z. Wang, X. Li, H. Duan, Y. Su, X. Zhang and X. Guan, “Medical image fusion based on convolutional neural networks and non-subsampled contourlet transform,” Expert Systems with Applications, vol. 171, no. 114574, Jun. 2021.
K. Wang, M. Zheng, H. Wei, G. Qi and Y. Li, “Multi-Modality Medical Image Fusion Using Convolutional Neural Network and Contrast Pyramid,” Sensors, vol. 20, no.8:2169, Apr. 2020.
K. A. Johnson and J. Alex Becker, “The whole brain atlas,” [Online]. Available: https://www.med.harvard.edu/aanlib/.
Z. Wang, A. C. Bovik, H. R. Sheikh and E. P. Simoncelli, “Image quality assessment: from error visibility to structural similarity,” in IEEE Transactions on Image Processing, vol. 13, no. 4, pp. 600-612, Apr. 2004.
V. Petrovi´c and C. Xydeas, “Evaluation of image fusion performance with visible differences,” 8th European Conference on Computer Vision, ECCV 2004, Lecture Notes in Computer Science, vol. 3023, pp. 380–391, 2004.
C. Xydeas and V. Petrovic, “Objective image fusion performance measure,” Electronics Letters, vol. 36, no. 4, pp. 308–309, 2000.