TY - JOUR
T1 - Image rain removal and illumination enhancement done in one go
AU - Wan, Yecong
AU - Cheng, Yuanshuo
AU - Shao, Mingwen
AU - Gonzalez Sabate, Jordi
N1 - Publisher Copyright:
© 2022 Elsevier B.V.
PY - 2022/9/27
Y1 - 2022/9/27
N2 - Rain removal plays an important role in the restoration of degraded images. Recently, CNN-based methods have achieved remarkable success. However, these approaches neglect that the appearance of real-world rain is often accompanied by low light conditions, which will further degrade the image quality, thereby hindering the restoration mission. Therefore, it is very indispensable to jointly remove the rain and enhance illumination for real-world rain image restoration. To this end, we proposed a novel spatially-adaptive network, dubbed SANet, which can remove the rain and enhance illumination in one go with the guidance of degradation mask. Meanwhile, to fully utilize negative samples, a contrastive loss is proposed to preserve more natural textures and consistent illumination. In addition, we present a new synthetic dataset, named DarkRain, to boost the development of rain image restoration algorithms in practical scenarios. DarkRain not only contains different degrees of rain, but also considers different lighting conditions, and more realistically simulates real-world rainfall scenarios. SANet is extensively evaluated on the proposed dataset and attains new state-of-the-art performance against other combining methods. Moreover, after a simple transformation, our SANet surpasses existing the state-of-the-art algorithms in both rain removal and low-light image enhancement.
AB - Rain removal plays an important role in the restoration of degraded images. Recently, CNN-based methods have achieved remarkable success. However, these approaches neglect that the appearance of real-world rain is often accompanied by low light conditions, which will further degrade the image quality, thereby hindering the restoration mission. Therefore, it is very indispensable to jointly remove the rain and enhance illumination for real-world rain image restoration. To this end, we proposed a novel spatially-adaptive network, dubbed SANet, which can remove the rain and enhance illumination in one go with the guidance of degradation mask. Meanwhile, to fully utilize negative samples, a contrastive loss is proposed to preserve more natural textures and consistent illumination. In addition, we present a new synthetic dataset, named DarkRain, to boost the development of rain image restoration algorithms in practical scenarios. DarkRain not only contains different degrees of rain, but also considers different lighting conditions, and more realistically simulates real-world rainfall scenarios. SANet is extensively evaluated on the proposed dataset and attains new state-of-the-art performance against other combining methods. Moreover, after a simple transformation, our SANet surpasses existing the state-of-the-art algorithms in both rain removal and low-light image enhancement.
KW - Contrastive learning
KW - Low-light image enhancement
KW - Rain removal
KW - Spatially-adaptive network
UR - http://dx.doi.org/10.1016/j.knosys.2022.109244
UR - http://www.scopus.com/inward/record.url?scp=85133696088&partnerID=8YFLogxK
UR - https://www.mendeley.com/catalogue/7da662a9-6218-34e3-8933-7752a90cb0f0/
U2 - 10.1016/j.knosys.2022.109244
DO - 10.1016/j.knosys.2022.109244
M3 - Article
SN - 0950-7051
VL - 252
JO - Knowledge-Based Systems
JF - Knowledge-Based Systems
M1 - 109244
ER -