Image enhancement in facial detection is a critical component of facial recognition systems. Face identification in an uncontrolled environment is affected by a multitude of difficulties such as poor light levels, low-resolution cameras, occlusions from surrounding objects, and tiny faces in distant photographs. Low signal-to-noise ratio, low brightness, and noise in low-light photographs lead to issues such as color distortion and poor visibility, which makes it challenging to identify faces. Many techniques to enhance low-light images have been developed, improving the face detection system’s accuracy. This will improve the picture at the expense of higher running costs and lower model robustness. The proposed technique, DCE-Net, uses performance-intensive deep learning and light-enhanced image properties. A non-referential deep learning technique was employed to acquire and modify the image attributes. A set of loss functions designed to perform without ground-truth images is the foundation of the deep network learning employed. Compared to the current referential methods, straightforward non-referential light estimation curve mapping minimizes the computational demand for low-light image improvement. Several experiments conducted on standard datasets demonstrated the efficacy and reduced computational requirements of the approach. The effectiveness of this method is supported by both the qualitative and quantitative outcomes. The PSNR and SSIM computation for paired images shows promising results using the proposed image enhancement technique.
Keywords
Face Detection, Image Enhancement, Deep Learning, Convolutional Neural Networks, Face Recognition.
Y. Feng, S. Yu, H. Peng, Y. -R. Li and J. Zhang, "Detect Faces Efficiently: A Survey and Evaluations," in IEEE Transactions on Biometrics, Behavior, and Identity Science, vol. 4, no. 1, pp. 1-18, Jan. 2022, doi: 10.1109/TBIOM.2021.3120412.
C. Li, C. Guo and C. C. Loy, "Learning to Enhance Low-Light Image via Zero-Reference Deep Curve Estimation," in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 44, no. 8, pp. 4225-4238, 1 Aug. 2022, doi: 10.1109/TPAMI.2021.3063604.
H. Liang, A. Yu, M. Shao, and Y. Tian, “Multi-Feature Guided Low-Light Image Enhancement,” Applied Sciences, vol. 11, no. 11, p. 5055, May 2021, doi: https://doi.org/10.3390/app11115055.
J. Bhattacharya, S. Modi, L. Gregorat, and G. Ramponi, “D2BGAN: A Dark to Bright Image Conversion Model for Quality Enhancement and Analysis Tasks Without Paired Supervision,” IEEE Access, vol. 10, pp. 57942–57961, 2022, doi: https://doi.org/10.1109/access.2022.3178698.
J. Hai et al., “R2RNet: Low-light Image Enhancement via Real-low to Real-normal Network,” Journal of Visual Communication and Image Representation, vol. 90, p. 103712, Feb. 2023, doi: https://doi.org/10.1016/j.jvcir.2022.103712.
J. Liang et al., “Recurrent Exposure Generation for Low-Light Face Detection,” IEEE Transactions on Multimedia, vol. 24, pp. 1609–1621, 2022, doi: https://doi.org/10.1109/tmm.2021.3068840.
W. Wang, W. Yang, and J. Liu, “HLA-Face: Joint High-Low Adaptation for Low Light Face Detection,” 2021 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2021, doi: https://doi.org/10.1109/cvpr46437.2021.01593.
W. Wang, X. Wang, W. Yang, and J. Liu, “Unsupervised Face Detection in the Dark,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 45, no. 1, pp. 1250–1266, Jan. 2023, doi: https://doi.org/10.1109/TPAMI.2022.3152562.
L. Ma, T. Ma, R. Liu, X. Fan, and Z. Luo, “Toward Fast, Flexible, and Robust Low-Light Image Enhancement,” 2022 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), Jun. 2022, doi: https://doi.org/10.1109/cvpr52688.2022.00555.
J. Hai, Y. Hao, F. Zou, F. Lin, and S. Han, “Advanced RetinexNet: A fully convolutional network for low-light image enhancement,” Signal Processing: Image Communication, vol. 112, p. 116916, Mar. 2023, doi: https://doi.org/10.1016/j.image.2022.116916.
H. Gasparyan, S. Hovhannisyan, S. V. Babayan, and S. S. Agaian, “Iterative Retinex-Based Decomposition Framework for Low Light Visibility Restoration,” IEEE Access, vol. 11, pp. 40298–40313, Jan. 2023, doi: https://doi.org/10.1109/access.2023.3269719.
Q. Lu and P. Gan, “Low-Light Face Recognition and Identity Verification Based on Image Enhancement,” Traitement du Signal, vol. 39, no. 2, pp. 513–519, Apr. 2022, doi: https://doi.org/10.18280/ts.390213.
S. Zhang, C. Chi, Z. Lei, and S. Z. Li, “RefineFace: Refinement Neural Network for High Performance Face Detection,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 11, pp. 4008–4020, Nov. 2021, doi: https://doi.org/10.1109/tpami.2020.2997456.
C. Li, J. Guo, F. Porikli, and Y. Pang, “LightenNet: A Convolutional Neural Network for weakly illuminated image enhancement,” Pattern Recognition Letters, vol. 104, pp. 15–22, Mar. 2018, doi: https://doi.org/10.1016/j.patrec.2018.01.010.
W. Wang, Q. Lai, H. Fu, J. Shen, H. Ling, and R. Yang, “Salient Object Detection in the Deep Learning Era: An In-depth Survey,” IEEE Transactions on Pattern Analysis and Machine Intelligence, pp. 1–1, 2021, doi: https://doi.org/10.1109/tpami.2021.3051099.
W. Yang et al., “Advancing Image Understanding in Poor Visibility Environments: A Collective Benchmark Study,” IEEE Transactions on Image Processing, vol. 29, pp. 5737–5752, 2020, doi: https://doi.org/10.1109/tip.2020.2981922.
W. Chen, W. Wang, W. Yang, and J. Liu, “Deep Retinex Decomposition for Low-Light Enhancement,” arXiv (Cornell University), p. 155, Aug. 2018, doi: https://doi.org/10.48550/arXiv.1808.04560.
A. Aakerberg, K. Nasrollahi, and T. B. Moeslund, ‘RELLISUR: a real low-light image super-resolution dataset’, in Thirty-fifth Conference on Neural Information Processing Systems-NeurIPS 2021, 2021, doi: 10.5281/zenodo.5234969.
Y. P. Loh and C. S. Chan, “Getting to know low-light images with the Exclusively Dark dataset,” Computer Vision and Image Understanding, vol. 178, pp. 30–42, Jan. 2019, doi: https://doi.org/10.1016/j.cviu.2018.10.010.
K. Zhang, Z. Zhang, Z. Li, and Y. Qiao, “Joint Face Detection and Alignment Using Multitask Cascaded Convolutional Networks,” IEEE Signal Processing Letters, vol. 23, no. 10, pp. 1499–1503, Oct. 2016, doi: https://doi.org/10.1109/lsp.2016.2603342.
Acknowledgements
Author(s) thanks to Dr.Karunakar A Kotegar for this research completion and support.
Funding
No funding was received to assist with the preparation of this manuscript.
Ethics declarations
Conflict of interest
The authors have no conflicts of interest to declare that are relevant to the content of this article.
Availability of data and materials
Data sharing is not applicable to this article as no new data were created or analysed in this study.
Author information
Contributions
All authors have equal contribution in the paper and all authors have read and agreed to the published version of the manuscript.
Corresponding author
Rajesh Gopakumar
Rajesh Gopakumar
Department of Computer Science and Engineering. Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal, Karnataka, India.
Open Access This article is licensed under a Creative Commons Attribution NoDerivs is a more restrictive license. It allows you to redistribute the material commercially or non-commercially but the user cannot make any changes whatsoever to the original, i.e. no derivatives of the original work. To view a copy of this license, visit https://creativecommons.org/licenses/by-nc-nd/4.0/
Cite this article
Rajesh Gopakumar and Karunakar A Kotegar, “An Improved Image Enhancement Technique for Low Light Images Using Deep Learning Approach”, Journal of Machine and Computing, pp. 627-637, July 2024. doi: 10.53759/7669/jmc202404060.
