基于大气散射模型的红外图像增强方法
|
摘要
为更有效地提升红外图像的整体视觉效果并恢复出其中的场景目标,提出了一个基于大气散射模型的红外图像增强方法。首先,对红外图像进行反转操作,并引入大气散射模型对其降质机理进行描述。然后,利用四叉树分解技术将图像分割为一系列子块,并提出相应的基于子块的模型因子估计策略来恢复出场景目标。最后,结合导向全变分模型和一种基于Retinex模型的修正算法,进一步提高增强后图像的视觉效果。主观及客观对比实验结果证明了本算法具有良好的鲁棒性,及在视觉效果增强、有效信息增益方面的优势。
An infrared image enhancement method based on the atmospheric scattering model is proposed,which aims at improving the global visibility as well as increasing the scene details. The infrared image is converted into a reversed one,and the corresponding degradation mechanism is described based on the atmospheric scattering model. Then,the target image is segmented into a set of blocks using the quad-tree decomposition,and therefore the scene objects can be recovered within each blocks using the proposed model coefficients estimation strategies. Then,the guided total variation model as well as a Retinex-based algorithm are introduced to further improve the visual effect of the enhanced image. The comparison experimental results verify that the proposed method can produce results comparative to and even better than several existing state-of-the-art techniques with respect of the robustness and effectiveness.
An infrared image enhancement method based on the atmospheric scattering model is proposed,which aims at improving the global visibility as well as increasing the scene details. The infrared image is converted into a reversed one,and the corresponding degradation mechanism is described based on the atmospheric scattering model. Then,the target image is segmented into a set of blocks using the quad-tree decomposition,and therefore the scene objects can be recovered within each blocks using the proposed model coefficients estimation strategies. Then,the guided total variation model as well as a Retinex-based algorithm are introduced to further improve the visual effect of the enhanced image. The comparison experimental results verify that the proposed method can produce results comparative to and even better than several existing state-of-the-art techniques with respect of the robustness and effectiveness.
引文
[1]乔立永,徐立新,高敏.红外目标识别图像复杂度度量方法综述[J].红外技术,2013,35(2):88-96.
[2]曾锐利,李刚,林凌.智能交通监控系统中多目标跟踪算法[J].电子器件,2007,30(6):185-188.
[3]Sadeghi M,Jones S B,Philpot W D.A Linear Physically-Based Model for Remote Sensing of Soil Moisture Using Short Wave Infrared Bands[J].Remote Sens Environ,2015,164:66-76.
[4]奚吉,蒋银忠.基于物联网和视频分析技术的监狱智能监控系统[J].电子器件,2014,37(6):1183-1188.
[5]De La Escalera A,Armingol J M,Pastor J M,et al.Visual Sign Information Extraction and Identification by Deformable Models for Intelligent Vehicles[J].IEEE Trans Intell Transp Syst,2004,5(2):57-68.
[6]Stark J A.Adaptive Image Contrast Enhancement Using Generalizations of Histogram Equalization[J].IEEE Trans Image Process,2000,9(5):889-896.
[7]Li Y,Zhang Y,Geng A,et al.Infrared Image Enhancement Based on Atmospheric Scattering Model and Histogram Equalization[J].Opt Laser Technol,2016,83:99-107.
[8]Wu W,Yang X,Li H,et al.A Novel Scheme for Infrared Image Enhancement by Using Weighted Least Squares Filter and Fuzzy Plateau Histogram Equalization[J].Multimed Tools and Appl,2017,76(23):24789-24817.
[9]Rahman Z,Jobson D J,Woodell G A.Multi-Scale Retinex for Color Image Enhancement[C]//Proc of 3rd IEEE Int Conf on Image Processing.New York:IEEE,1996,3:1003-1006.
[10]Finlayson G D,Hordley S D,Drew M S.Removing Shadows from Images Using Retinex[C]//10th Color and Imaging Conference Final Program and Proceedings,2002:73-79.
[11]Wen H,Bi D,Ma S,et al.Variational Retinex Algorithm for Infrared Image Enhancement with Staircase Effect Suppression and Detail Enhancement[J].Acta Opt Sin,2016,36(9):130-139.
[12]占必超,吴一全,纪守新.基于平稳小波变换和Retinex的红外图像增强方法[J].光学学报,2010,30(10):2788-2793.
[13]Branchitta F,Diani M,Corsini,et al.New Technique for the Visualization of High Dynamic Range Infrared Images[J].Optical Engineering,2009,48(9):096401.
[14]Garcia F.Noise Removal and Real-Time Detail Enhancement of High-Dynamic-Range Infrared Images with Time Consistency[C]//International Conference on Quality Control by Artificial Vision.2015:9534R.
[15]Fan Z,Bi D,Gao S,et al.Adaptive Enhancement for Infrared Image Using Shearlet Frame[J].Journal of Optics,2016,18(8):085706.
[16]Rossi A,Acito N,Diani M,et al.High Dynamic Range Compression for Visualization of IR Images in Maritime Scenarios[C]//Proc SPIE 8541,Electro-Optical and Infrared Systems:Technology and Applications IX,2012:85410V.
[17]秦翰林,周慧鑫,刘上乾,等.基于二代小波变换的红外图像非线性增强算法[J].光学学报,2009,29(2):353-356.
[18]Starck J L,Murtagh F,Candès E J,et al.Gray and Color Image Contrast Enhancement by the Curvelet Transform[J].IEEE Trans on Image Process,2003,12(6):706-717.
[19]Liu G,Zhou H,Liang X G,et al.Image Registration Algorithm for Infrared and Visible Light Based on Non-Subsampled Contourlet Transform[J].Comput Sci,2016,16:320-323.
[20]Narasimhan S G,Nayar S K.Vision and the Atmosphere[J].International Journal of Computer Vision,2002,48(3):233-254.
[21]Narasimhan S G,Nayar S K.Chromatic Framework for Vision in Bad Weather[C]//IEEE Conference on Computer Vision and Pattern Recognition,2000,1:598-605.
[22]Narasimhan S G,Nayar S K.Contrast Restoration of Weather Degraded Images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2003,25(6):713-724.
[23]Dong X,Wang G,Pang Y,et al.Fast Efficient Algorithm for Enhancement of Low Lighting Video[C]//IEEE International Conference on Multimedia and Expo.IEEE,2011:1-6.
[24]Guo X.LIME:A Method for Low-Light IMage Enhancement[C]//Proceedings of the 24th ACM International Conference on Multimedia,2016:87-91.
[25]Baig N,Riaz M M,Ghafoor A,et al.Image Dehazing Using Quadtree Decomposition and Entropy-Based Contextual Regularization[J].IEEE Signal Processing Letters,2016,23(6):853-857.
[26]He Kai-ming,Sun Jian,Tang Xiao-ou.Single Image Haze Removal Using Dark Channel Prior[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(12):2341-2353.
[27]Zhu Qing-song,Mai Jia-ming,Shao Ling.A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior[J].IEEE Transactions on Image Processing,2015,24(11):3522-2533.
[28]Tarel J P,Hautière N.Fast Visibility Restoration from a Single Color or Gray Level Image[C]//IEEE 12th International Conference on Computer Vision,2009:2201-2208.
[29]Strobach P.Quadtree-Structured Recursive Plane Decomposition Coding of Images[J].IEEE Transactions on Signal Processing,1991,39(6):1380-1397.
[30]Gu Zhen-fei,Ju Ming-ye,Zhang Deng-yin.A Single Image Dehazing Method Using Average Saturation Prior[J].Mathematical Problems in Engineering,2017,3(5):1-17.
[31]Barnard K,Funt B.Analysis and Improvement of Multi-Scale Retinex[C]//5th Color and Imaging Conference Final Program and Proceedings,1997:221-226.
[32]曹慧,张宝辉,陈磊,等.基于伪暗原色的红外增强技术研究[J].红外技术,2016,38(6):476-480.
[33]Dong C,Loy C C,He K,et al.Learning a Deep Convolutional Network for Image Super-Resolution[C]//Proc of the European Conf on Computer Vision.Cham:Springer,2014.184-199.
[34]Ashiba H I,Awadalla K H,El-Halfawy S M,et al.Homomorphic Enhancement of Infrared Images Using the Additive Wavelet Transform[J].Prog Electromagn Res,2008,1:123-130.
[35]Zhenfei Gu,Dengyin Zhang,Mingye Ju.A Novel Retinex Image Enhancement Approach via Brightness Channel Prior and Change of Detail Prior[J].Pattern Recognition and Image Analysis,2017,27(2):234-242.
[36]Ju M,Zhang D,Wang X.Single Image Dehazing via an Improved Atmospheric Scattering Model[J/L].Visual Computer,2017,33(12):1613-1625.
[37]鞠铭烨,张登银.基于先验知识与大气散射模型的图像增强算法[J].电子学报,2017,45(5):1218-1225.
[38]Hautière N,Tarel J P,Aubert D,et al.Blind Contrast Enhancement Assessment by Gradient Ratioing at Visible Edges[J].Image Anal Stereol,2008,27(2):87-95.
[39]Choi L K,You J,Bovik A C.Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging[J].IEEE Trans Image Process,2015,24(11):3888-3901.
[2]曾锐利,李刚,林凌.智能交通监控系统中多目标跟踪算法[J].电子器件,2007,30(6):185-188.
[3]Sadeghi M,Jones S B,Philpot W D.A Linear Physically-Based Model for Remote Sensing of Soil Moisture Using Short Wave Infrared Bands[J].Remote Sens Environ,2015,164:66-76.
[4]奚吉,蒋银忠.基于物联网和视频分析技术的监狱智能监控系统[J].电子器件,2014,37(6):1183-1188.
[5]De La Escalera A,Armingol J M,Pastor J M,et al.Visual Sign Information Extraction and Identification by Deformable Models for Intelligent Vehicles[J].IEEE Trans Intell Transp Syst,2004,5(2):57-68.
[6]Stark J A.Adaptive Image Contrast Enhancement Using Generalizations of Histogram Equalization[J].IEEE Trans Image Process,2000,9(5):889-896.
[7]Li Y,Zhang Y,Geng A,et al.Infrared Image Enhancement Based on Atmospheric Scattering Model and Histogram Equalization[J].Opt Laser Technol,2016,83:99-107.
[8]Wu W,Yang X,Li H,et al.A Novel Scheme for Infrared Image Enhancement by Using Weighted Least Squares Filter and Fuzzy Plateau Histogram Equalization[J].Multimed Tools and Appl,2017,76(23):24789-24817.
[9]Rahman Z,Jobson D J,Woodell G A.Multi-Scale Retinex for Color Image Enhancement[C]//Proc of 3rd IEEE Int Conf on Image Processing.New York:IEEE,1996,3:1003-1006.
[10]Finlayson G D,Hordley S D,Drew M S.Removing Shadows from Images Using Retinex[C]//10th Color and Imaging Conference Final Program and Proceedings,2002:73-79.
[11]Wen H,Bi D,Ma S,et al.Variational Retinex Algorithm for Infrared Image Enhancement with Staircase Effect Suppression and Detail Enhancement[J].Acta Opt Sin,2016,36(9):130-139.
[12]占必超,吴一全,纪守新.基于平稳小波变换和Retinex的红外图像增强方法[J].光学学报,2010,30(10):2788-2793.
[13]Branchitta F,Diani M,Corsini,et al.New Technique for the Visualization of High Dynamic Range Infrared Images[J].Optical Engineering,2009,48(9):096401.
[14]Garcia F.Noise Removal and Real-Time Detail Enhancement of High-Dynamic-Range Infrared Images with Time Consistency[C]//International Conference on Quality Control by Artificial Vision.2015:9534R.
[15]Fan Z,Bi D,Gao S,et al.Adaptive Enhancement for Infrared Image Using Shearlet Frame[J].Journal of Optics,2016,18(8):085706.
[16]Rossi A,Acito N,Diani M,et al.High Dynamic Range Compression for Visualization of IR Images in Maritime Scenarios[C]//Proc SPIE 8541,Electro-Optical and Infrared Systems:Technology and Applications IX,2012:85410V.
[17]秦翰林,周慧鑫,刘上乾,等.基于二代小波变换的红外图像非线性增强算法[J].光学学报,2009,29(2):353-356.
[18]Starck J L,Murtagh F,Candès E J,et al.Gray and Color Image Contrast Enhancement by the Curvelet Transform[J].IEEE Trans on Image Process,2003,12(6):706-717.
[19]Liu G,Zhou H,Liang X G,et al.Image Registration Algorithm for Infrared and Visible Light Based on Non-Subsampled Contourlet Transform[J].Comput Sci,2016,16:320-323.
[20]Narasimhan S G,Nayar S K.Vision and the Atmosphere[J].International Journal of Computer Vision,2002,48(3):233-254.
[21]Narasimhan S G,Nayar S K.Chromatic Framework for Vision in Bad Weather[C]//IEEE Conference on Computer Vision and Pattern Recognition,2000,1:598-605.
[22]Narasimhan S G,Nayar S K.Contrast Restoration of Weather Degraded Images[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2003,25(6):713-724.
[23]Dong X,Wang G,Pang Y,et al.Fast Efficient Algorithm for Enhancement of Low Lighting Video[C]//IEEE International Conference on Multimedia and Expo.IEEE,2011:1-6.
[24]Guo X.LIME:A Method for Low-Light IMage Enhancement[C]//Proceedings of the 24th ACM International Conference on Multimedia,2016:87-91.
[25]Baig N,Riaz M M,Ghafoor A,et al.Image Dehazing Using Quadtree Decomposition and Entropy-Based Contextual Regularization[J].IEEE Signal Processing Letters,2016,23(6):853-857.
[26]He Kai-ming,Sun Jian,Tang Xiao-ou.Single Image Haze Removal Using Dark Channel Prior[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(12):2341-2353.
[27]Zhu Qing-song,Mai Jia-ming,Shao Ling.A Fast Single Image Haze Removal Algorithm Using Color Attenuation Prior[J].IEEE Transactions on Image Processing,2015,24(11):3522-2533.
[28]Tarel J P,Hautière N.Fast Visibility Restoration from a Single Color or Gray Level Image[C]//IEEE 12th International Conference on Computer Vision,2009:2201-2208.
[29]Strobach P.Quadtree-Structured Recursive Plane Decomposition Coding of Images[J].IEEE Transactions on Signal Processing,1991,39(6):1380-1397.
[30]Gu Zhen-fei,Ju Ming-ye,Zhang Deng-yin.A Single Image Dehazing Method Using Average Saturation Prior[J].Mathematical Problems in Engineering,2017,3(5):1-17.
[31]Barnard K,Funt B.Analysis and Improvement of Multi-Scale Retinex[C]//5th Color and Imaging Conference Final Program and Proceedings,1997:221-226.
[32]曹慧,张宝辉,陈磊,等.基于伪暗原色的红外增强技术研究[J].红外技术,2016,38(6):476-480.
[33]Dong C,Loy C C,He K,et al.Learning a Deep Convolutional Network for Image Super-Resolution[C]//Proc of the European Conf on Computer Vision.Cham:Springer,2014.184-199.
[34]Ashiba H I,Awadalla K H,El-Halfawy S M,et al.Homomorphic Enhancement of Infrared Images Using the Additive Wavelet Transform[J].Prog Electromagn Res,2008,1:123-130.
[35]Zhenfei Gu,Dengyin Zhang,Mingye Ju.A Novel Retinex Image Enhancement Approach via Brightness Channel Prior and Change of Detail Prior[J].Pattern Recognition and Image Analysis,2017,27(2):234-242.
[36]Ju M,Zhang D,Wang X.Single Image Dehazing via an Improved Atmospheric Scattering Model[J/L].Visual Computer,2017,33(12):1613-1625.
[37]鞠铭烨,张登银.基于先验知识与大气散射模型的图像增强算法[J].电子学报,2017,45(5):1218-1225.
[38]Hautière N,Tarel J P,Aubert D,et al.Blind Contrast Enhancement Assessment by Gradient Ratioing at Visible Edges[J].Image Anal Stereol,2008,27(2):87-95.
[39]Choi L K,You J,Bovik A C.Referenceless Prediction of Perceptual Fog Density and Perceptual Image Defogging[J].IEEE Trans Image Process,2015,24(11):3888-3901.