International Journal of Image, Graphics and Signal Processing (IJIGSP)
IJIGSP Vol. 8, No. 12, 8 Dec. 2016
Cover page and Table of Contents: PDF (size: 663KB)
A Survey on Shadow Removal Techniques for Single Image
Full Text (PDF, 663KB), PP.38-46
Views: 0 Downloads: 0
Author(s)
Index Terms
Shadow removal, reintegration, relighting, color-transfer
Abstract
Shadows are physical phenomena that appear on a surface when direct light from a source is unable to reach the surface due to the presence of an object between the source and the surface. The formation of shadows and their various features has evolved as a topic of discussion among researchers. Though the presence of shadows can aid us in understanding the scene model, it might impair the performance of applications such as object detection. Hence, the removal of shadows from videos and images is required for the faultless working of certain image processing tasks. This paper presents a survey of notable shadow removal techniques for single image available in the literature. For the purpose of the survey, the various shadow removal algorithms are classified under five categories, namely, reintegration methods, relighting methods, patch-based methods, color transfer methods, and interactive methods. Comparative study of qualitative and quantitative performances of these works is also included. The pros and cons of various approaches are highlighted. The survey concludes with the following observations- (i) shadow removal should be performed in real time since it is usually considered as a preprocessing task, (ii) the texture and color information of the regions underlying the shadow must be recovered, (iii) there should be no hard transition between shadow and non-shadow regions after removing the shadows.
Cite This Paper
Saritha Murali, V.K. Govindan, Saidalavi Kalady,"A Survey on Shadow Removal Techniques for Single Image", International Journal of Image, Graphics and Signal Processing(IJIGSP), Vol.8, No.12, pp.38-46, 2016. DOI: 10.5815/ijigsp.2016.12.05
Reference
1]C. R. Jung, "Efficient background subtraction and shadow removal for monochromatic video sequences," IEEE Trans. Multimed., vol. 11, no. 3, pp. 571–577, 2009.
[2]H. Li, L. Zhang, and H. Shen, "An adaptive nonlocal regularized shadow removal method for aerial remote sensing images," IEEE Trans. Geosci. Remote Sens., vol. 52, no. 1, pp. 106–120, 2014.
[3]C. Fredembach and G. Finlayson, "Simple Shadow Removal," pp. 3–6.
[4]L. Xu, F. Qi, R. Jiang, Y. Hao, and G. Wu, "Shadow Detection and Removal in Real Images: A Survey," Citeseer, 2006.
[5]R. K. Sasi and V. K. Govindan, "Shadow Detection and Removal from Real Images," Proc. Third Int. Symp. Women Comput. Informatics - WCI '15, no. AUGUST, pp. 309–317, 2015.
[6]G. D. Finlayson, S. D. Hordley, and M. S. Drew, "Removing Shadows from Images," Comput. Sci., vol. 2353, pp. 823–836, 2002.
[7]G. D. Finlayson, S. D. Hordley, C. Lu, and M. S. Drew, "On the removal of shadows from images," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 59–68, 2006.
[8]Land, Edwin H. The retinex theory of color vision. Scientific America, 1977.
[9]G. D. Finlayson, S. D. Hordley, C. Lu, and M. S. Drew, "Removing Shadows From Images using Retinex," IEEE Trans. Pattern Anal. Mach. Intell., vol. 28, no. 1, pp. 59–68, 2006.
[10]G. D. Finlayson and C. Fredembach, "Fast Re-integration of Shadow Free Images.," Color Imaging Conf., vol. 2004, no. 4, pp. 117–122, 2004.
[11]C. Fredembach and G. Finlayson, "Hamiltonian Path-Based Shadow Removal," Br. Machine Vision Conference, vol. 2, pp. 502–511, 2005.
[12]E. Arbel and H. Hel-Or, "Texture-preserving shadow removal in color images containing curved surfaces," Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., 2007.
[13]Du, Zhenlong, Hai Lin, and Hujun Bao. "Shadow removal in gradient domain." In International Conference Image Analysis and Recognition, pp. 107-115. Springer Berlin Heidelberg, 2005.
[14]N. Salamati, A. Germain, and S. Süsstrunk, "Removing shadows from images using color and near-infrared," Proc. - Int. Conf. Image Process. ICIP, pp. 1713–1716, 2011.
[15]R. Guo, Q. Dai, and D. Hoiem, "Paired regions for shadow detection and removal," IEEE Trans. Pattern Anal. Mach. Intell., vol. 35, no. 12, pp. 2956–2967, 2013.
[16]T. F. Yago Vicente and D. Samaras, "Single image shadow removal via neighbor-based region relighting," Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 8927, pp. 309–320, 2015.
[17]M. Gryka, M. Terry, and G. J. Brostow, "Learning to Remove Soft Shadows," ACM Trans. Graph., vol. 34, no. 5, pp. 153:1–153:15, 2015.
[18]L. Zhang, Q. Zhang, and C. Xiao, "Shadow Remover: Image Shadow Removal Based on Illumination Recovering Optimization," IEEE Trans. Image Process., vol. 24, no. 11, pp. 4623–4636, 2015.
[19]L. Ma, J. Wang, E. Shechtman, K. Sunkavalli, and S. Hu, "Appearance Harmonization for Single Image Shadow Removal," 2016.
[20]R. K. Sasi and V. K. Govindan, "Shadow removal using sparse representation over local dictionaries," Eng. Sci. Technol. an Int. J., 2016.
[21]E. Reinhard, M. Ashikhmin, B. Gooch, and P. Shirley, "Color transfer between images," IEEE Comput. Graph. Appl., vol. 21, no. 5, pp. 34–41, 2001.
[22]T. P. Wu and C. K. Tang, "A Bayesian approach for shadow extraction from a single image," Proc. IEEE Int. Conf. Comput. Vis., vol. I, pp. 480–487, 2005.
[23]T.-P. Wu, C.-K. Tang, M. S. Brown, and H.-Y. Shum, "Natural shadow matting," ACM Trans. Graph., vol. 26, no. 2, p. 8–es, 2007.
[24]Y. Shor and D. Lischinski, "The shadow meets the mask: Pyramid-based shadow removal," Comput. Graph. Forum, vol. 27, no. 2, pp. 577–586, 2008.
[25]C. Xiao, R. She, D. Xiao, and K. L. Ma, "Fast shadow removal using adaptive multi-scale illumination transfer," Comput. Graph. Forum, vol. 32, no. 8, pp. 207–218, 2013.
[26]C. Xiao, D. Xiao, L. Zhang, and L. Chen, "Efficient shadow removal using subregion matching illumination transfer," Comput. Graph. Forum, vol. 32, no. 7, pp. 421–430, 2013.
[27]S. Khan, M. Bennamoun, F. Sohel, and R. Togneri, "Automatic Shadow Detection and Removal from a Single Image," IEEE Trans. Pattern Anal. Mach. Intell., vol. 6, no. 1, pp. 1–1, 2015.
[28]F. Liu and M. Gleicher, "Texture-consistent shadow removal," Lect. Notes Comput. Sci. (including Subser. Lect. Notes Artif. Intell. Lect. Notes Bioinformatics), vol. 5305 LNCS, no. PART 4, pp. 437–450, 2008.
[29]Miyazaki, Daisuke, Yasuyuki Matsushita, and Katsushi Ikeuchi. "Interactive shadow removal from a single image using hierarchical graph cut." In Asian Conference on Computer Vision, pp. 234-245. Springer Berlin Heidelberg, 2009.
[30]E. Arbel and H. Hel-Or, "Shadow removal using intensity surfaces and texture anchor points," IEEE Trans. Pattern Anal. Mach. Intell., vol. 33, no. 6, pp. 1202–1216, 2011.
[31]A. Nandedkar, "An interactive shadow detection and removal tool using granular reflex fuzzy min-max neural network," Proc. World Congr. Eng., vol. II, pp. 4–7, 2012.
[32]H. Gong, D. Cosker, C. Li, and M. Brown, "User-aided single image shadow removal," Proc. - IEEE Int. Conf. Multimed. Expo, pp. 2–7, 2013.
[33]Gong, Han, and D. P. Cosker. "Interactive shadow removal and ground truth for variable scene categories." In BMVC 2014-Proceedings of the British Machine Vision Conference 2014. University of Bath, 2014.
[34]Lalonde, Jean-François, Alexei A. Efros, and Srinivasa G. Narasimhan. "Detecting ground shadows in outdoor consumer photographs." In European conference on computer vision, pp. 322-335. Springer Berlin Heidelberg, 2010.
[35]J. Zhu, K. G. G. Samuel, S. Z. Masood, and M. F. Tappen, "Learning to recognize shadows in monochromatic natural images," Proc. IEEE Comput. Soc. Conf. Comput. Vis. Pattern Recognit., pp. 223–230, 2010.