Threshold based Image Fusion in Dual Tree Complex Wavelet Domain

Full Text (PDF, 984KB), PP.64-74

Views: 0 Downloads: 0

Author(s)

Richa Srivastava 1,* Ashish Khare 1

1. Department of Electronics and Communication, University of Allahabad, Allahabad, 211002, India

* Corresponding author.

DOI: https://doi.org/10.5815/ijigsp.2016.10.08

Received: 8 Jun. 2016 / Revised: 22 Jul. 2016 / Accepted: 26 Aug. 2016 / Published: 8 Oct. 2016

Index Terms

Image fusion, dual tree complex wavelet transform, level dependent threshold, threshold based fusion, multiresolution analysis

Abstract

Image fusion is a popular application of image processing which performs merging of two or more images into one. The merged image is of improved visual quality and carries more information content. The present work introduces a new image fusion method in complex wavelet domain. The proposed fusion rule is based on a level dependent threshold, where absolute difference of a wavelet coefficient from the threshold value is taken as fusion criteria. This absolute difference represents variation in the image intensity that resembles the salient features of image. Hence, for fusion, the coefficients that are far from threshold value are being selected. The motivation behind using dual tree complex wavelet transform is due to failure of real valued wavelet transform in many aspects. Good directional selectivity, availability of phase information and approximate shift invariant nature of dual tree complex wavelet transform make it suitable for image fusion and help to produce a high quality fused image. To prove the strength of the proposed method, it has been compared with several spatial, pyramidal, wavelet and new generation wavelet based fusion methods. The experimental results show that the proposed method outperforms all the other state-of-the-art methods visually as well as in terms of standard deviation, mutual information, edge strength, fusion factor, sharpness and average gradient. 

Cite This Paper

Richa Srivastava, Ashish Khare,"Threshold based Image Fusion in Dual Tree Complex Wavelet Domain", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.8, No.10, pp.64-74, 2016. DOI: 10.5815/ijigsp.2016.10.08

Reference

[1]Y. Liu, S. Liu and Z. Wang, "A general framework for image fusion based on multi-scale transform and sparse representation," Information fusion, vol. 24, pp. 147-164, 2015.

[2]V. Aslantas and A. N. Toprak, "A pixel based multi-focus image fusion method," Optics Communications, vol. 332, pp. 350-358, 2014.

[3]R. Singh and A. Khare, "Fusion of multimodal medical images using daubechies complex wavelet transform -A 

[4]multiresolution approach", Information fusion, vol. 19, pp. 49-60, 2014.

[5]R. Srivastava, R. Singh and A. Khare, "Fusion of multifocus noisy images using contourlet transform," Proc. 6th Int. Conf. Contemporary Computing, Noida, India, pp. 497-502, August 2013.

[6]V.P.S. Naidu and J.R. Raol, "Pixel-level image fusion using wavelets and principal component analysis," Defence Science Journal,vol. 58, pp. 338–352, 2008.

[7]C. He, Q, Liu, H. Li and H. Li, "Multimodal medical image fusion based on IHS and PCA," Procedia Engineering, vol. 7, pp. 280-285, 2010.

[8]A. A. Suraj, M. Francis, T.S. Kavya and T. M. Nirmal, "Discrete wavelet transform based image fusion and de- noising in FPGA," Journal of Electrical System and Information Technology, vol. 1, pp. 72-81, 2014.

[9]S. Li, "Multisensor remote sensing image fusion using stationary wavelet transform: effects of basis and decomposition level," International journal of wavelets, Multiresolution and Information Processing, vol. 6, pp. 37-50, 2008.

[10]J. J. Lewis, R. J. O'Callaghan, S. G. Nikolov, D. R. Bull and N Canagarajah, "Pixel- and Region-based image fusion with complex wavelets," Information Fusion, vol. 8, pp. 119-130, 2007.

[11]P.J. Burt, "A gradient pyramid basis for pattern selective image fusion," SID Technical Digest, vol. 16, pp. 467-470, 1985.

[12]H. Li, B. S. Manjunath and S. K. Mitra, "Multisensor Image fusion using wavelet transform," Graphics Models and Image Processing, vol. 57, 235-245, 1995.

[13]R. Vijayarajan and S. Muttan, "Discrete wavelet transform based principal component averaging fusion for medical images," AEU-International Journal of Electronics and Communications, vol. 69, pp. 896-902, 2015.

[14]N. Kingsbury, "The dual-tree complex wavelet transform: a new technique for shift invariance and directional filters," IEEE Digital Signal Processing Workshop, vol. 86, 1998.

[15]R. Srivastava and A. Khare, "Multifocus noisy image fusion using contourlet transform," The Imaging Science Journal, vol. 63, pp. 408-422, 2015. 

[16]Y. Liu, J. Yang and J. Sun, "PET/CT medical image fusion algorithm based on multiwavelet transform," Proc. 2nd Int. Conf. Advanced Computer Control (ICACC) 2, Shenyang, pp. 264–268, March 2010.

[17]P.J. Burt and R.J. Kolczynski, "Enhanced Image Capture Through Fusion," Proc. 4th Int. Conf Computer Vision, Berlin, pp. 173-182, May 1993.

[18]H. LU, X. HU, L. Zhang, S. Yang and S. Serikawa, "Local energy based image fusion in sharp frequency localized contourlet transform," Journal of Computational Information System, vol. 6, pp. 3997-4005, 2010.

[19]Y. Yang, S. Tong, S. Huang and P. Lin, "Log-Gabor energy based multimodal medical image fusion in NSCT domain," Computational and Mathematical Methods in Medicine, pp.1-12, 2014.

[20]T. A. Wilson, S.K. Rogers and L.R. Myers, "Perceptual based hyperspectral image fusion using multiresolution analysis," Optical Engineering, vol. 34, pp. 3154-3164, 1995.

[21]Q. Zhang and B. Guo, "Multifocus image fusion using the nonsubsampled contourlet transform," Signal Processing, vol. 89, pp. 1334–1346, 2009.

[22]A. Khare, U. S. Tiwari and M. Jeon, "Daubechies complex wavelet transform based multilevel shrinkage for deblurring of medical images in presence of noise," International Journal on Wavelets, Multiresoultion and Information Processing, vol. 7, pp. 587-604, 2009.

[23]J. Nunez, X. Otazu, O. Fors and A. Prades, "Multiresolution-based image fusion with additive wavelet decomposition," IEEE Transaction on Geoscience and Remote Science, vol. 37, pp. 1204-1211, 1999.

[24]I. W. Selesnick, R. G. Baraniuk, and N. G. Kingsbury, "The dual-tree complex wavelet transform," IEEE Signal Processing Magazine, vol. 22 , pp. 123-151, 2005.

[25]S. Li, Z. Li and J. Gong, "Multivariate statistical analysis of measure for assessing the quality of image fusion," International Journal of Image and Data Fusion, vol. 1, pp. 47-66, 2010.

[26]K. Kotwal and S. Chaudhuri, "A novel approach to quantitative evaluation of hyperspectral image fusion techniques," Information Fusion, vol. 14, pp. 5–18, 2013.

[27]T. Wan, C. Zhu and Z. Qin, "Multifocus image fusion based on robust principal component analysis," Pattern Recognition Letters, vol. 34, pp. 1001-1008, 2013.

[28]J. Tian, L. Chen, L. Ma and W. Yu., "Multi-focus image fusion using a bilateral gradient-based sharpness criterion," Optics Communication, vol. 284, pp. 80-87, 2011.

[29]J.G.P.W. Clevers and R. Zurita-Milla, "Multisensor and multiresolution image fusion using the linear mixing model," in Image Fusion: Algorithms and Applications, T. Stathaki, Ed. Academic Press, Elsevier, 2008, pp. 67–84.

[30]W. Wang and F. Chang, "A Multi-focus Image Fusion Method Based on Laplacian Pyramid," Journal of Computers, vol. 6, pp. 2559-2566, 2011.

[31]A. Deng, J. Wu and S. Yang, "An image fusion algorithm based on discrete wavelet transform and Canny operator", Proc. Int. conf. advance research on computer education, simulation and modeling, Wuhan, China, pp. 32-38, June 2011.

[32]R. Singh, M. Vatsa and A. Noore, "Multimodal medical image fusion using redundant wavelet transform," Proc. 7th Int. Conf. Advances in Pattern Recognition, Kolkata, India, pp. 232–235, February 2009.

[33]S. Kore and U.S. Tiwari, "Feature level fusion of multimodal medical images in lifting wavelet transform domain," Proc. 26th Annual Int. Conf. IEEE Engineering in Medicine and Biology Society, pp. 1479-1482, September 2004.

[34]R. Srivastava, R. Singh and A. Khare, "Image fusion based on nonsubsampled contourlet transform," Proc. Int. Conf. Informatics, Electronics & Vision, Dhaka, Bangladesh, pp. 263-266, May 2012.

[35]R. Srivastava, O. Prakash and A. Khare, "Local energy based multimodal medical image fusion in curvelet domain," IET Computer Vision, doi: 10.1049/iet-cvi.2015.0251.