Joint Image Registration and Fusion for Multispectral Infrared Images

LI Yingjie; ZHANG Junju; CHANG Benkang; QIAN Yunsheng; LIU Lei

doi:10.11999/JEIT150479

Volume 38 Issue 1

Jan. 2016

Turn off MathJax

Article Contents

Article Navigation > Journal of Electronics & Information Technology > 2016 > 38(1): 8-14

LI Yingjie, ZHANG Junju, CHANG Benkang, QIAN Yunsheng, LIU Lei. Joint Image Registration and Fusion for Multispectral Infrared Images[J]. Journal of Electronics & Information Technology, 2016, 38(1): 8-14. doi: 10.11999/JEIT150479

Citation:

LI Yingjie, ZHANG Junju, CHANG Benkang, QIAN Yunsheng, LIU Lei. Joint Image Registration and Fusion for Multispectral Infrared Images[J]. Journal of Electronics & Information Technology, 2016, 38(1): 8-14. doi: 10.11999/JEIT150479

Citation:

PDF( 8323 KB)

Joint Image Registration and Fusion for Multispectral Infrared Images

doi: 10.11999/JEIT150479

Funds:

The National Natural Science Foundation of China (61101195), Natural Science Foundation of Jiangsu Province (SBK201343283)

Received Date: 2015-04-28
Rev Recd Date: 2015-10-10
Publish Date: 2016-01-19

Abstract

Abstract

The registration and fusion are the two essential steps to get a composed image from the multispectral infrared images in the night vision. However, at present these two processes are considered as two independent steps, where the registration error may significantly affect the fusion quality. In this paper, a novel iteration optimization method is proposed to obtain the optimal registration parameter for the following fusion process. Definition index of the region of interest in the fused image is used to improve the register process, and simulated annealing method is used to solve the joint optimization problem. The experimental results show that the proposed method provides a robust stability and performance over several other state-of-the-art methods in the registration accuracy and fusion quality.
- Image fusion,
- Image registration,
- Multispectral infrared images,
- Definition index

FullText(HTML)

References(33)

References

邓苗, 张基宏, 柳伟, 等. 基于全变分的权值优化的多尺度变换图像融合[J]. 电子与信息学报, 2013, 35(7): 1657-1663. doi: 10.3724/SP.J.1146.2012.01183.

DENG Miao, ZHANG Jihong, LIU Wei, et al. A total variation-based lowpass weight function optimization in multiscale image fusion[J]. Journal of Electronics Information Technology, 2013, 35(7): 1657-1663. doi: 10.3724/SP.J.1146.2012.01183.

LIU Yan and YU Feihong. An automatic image fusion algorithm for unregistered multiply multi-focus images[J]. Optics Communications, 2015, 341: 101-113.

黄立勤, 陈财淦. 全景图拼接中图像融合算法的研究[J]. 电子与信息学报, 2014, 36(6): 1292-1298. doi: 10.3724/ SP.J. 1146.2013.01220.

HUANG Liqin and CHEN Caigan. Study on image fusion algorithm of panoramic image stitching[J]. Journal of Electronics Information Technology, 2014, 36(6): 1292- 1298. doi: 10.3724/ SP.J.1146.2013.01220.

LEI Fei and WANG Wenxue. A fast method for image mosaic based on SURF[C]. Proceedings of the 2014 9th IEEE Conference on Industrial Electronics and Applications, Hangzhou, China, 2014: 79-82.

余先川, 吕中华, 胡丹. 遥感图像配准技术综述[J]. 光学精密工程, 2013, 21(11): 2960-2972.

YU Xianchuan, L? Zhonghua, and HU Dan. Review of remote sensing image registration technique[J]. Optics and Precision Engineering, 2013, 21(11): 2960-2972.

BENTOUTOU Y, NASREDDING T, Kidiyo K, et al. An automatic image registration for applications in remote sensing[J]. IEEE Transactions on Geoscience and Remote Sensing, 2005, 43(9): 2127-2137.

MIAO Qiguang, SHI Cheng, XU Pengfei, et al. A novel algorithm of image fusion using shearlets[J]. Optics Communications, 2011, 284(6): 1540-1547.

LI Shutao, KANG Xudong, and HU Jianwen. Image fusion with guide filtering[J]. IEEE Transactions on Image Processing, 2013, 22(7): 2864-2875.

SHI Cheng, MIAO Qiguang, and XU Pengfei. A novel algorithm of image fusion based on shearlets and PCNN[J]. Neurocomputing, 2013, 117: 47-53.

KONG Weiwei and LIU Jianpeng. Technique for image fusion based on nonsubsampled shearlet transform and improved pulse coupled neural network[J]. Optical Engineering, 2013, 52(1): 017001.

沈满德. 高分辨率中红外温度自适应夜视成像系统[J]. 强激光与粒子束, 2013, 25(5): 1144-1146.

SHEN Mande. High-resolution midwave infrared temperature-adaptive night-vision imaging system[J]. High Power Laser and Particle Beams, 2013, 25(5): 1144-1146.

柏连发, 韩静, 张毅, 等. 采用改进梯度互信息和粒子群优化算法的红外与可见光图像配准算法[J]. 红外与激光工程, 2012, 41(1): 248-254.

BAI Lianfa, HAN Jing, ZHANG Yi, et al. Registration algorithm of infrared and visible images based on improved gradient normalized mutual information and particle swarm optimization[J]. Infrared and Laser Engineering, 2012, 41(1): 248-254.

BILODEAU G A, TORABI A, and MORIN F. Visible and infrared image registration using trajectories and composite foreground images[J]. Image and Vision Computing, 2011, 29(1): 41-50.

CHEN S, GUO Q, LEUNG H, et al. A maximum likelihood approach to joint image registration and fusion[J]. IEEE Transactions on Image Processing, 2011, 20(5): 1363-1372.

ZHANG Qian, CAO Zhiguo, HU Zhongwen, et al. Joint image registration and fusion for panchromatic and multispectral images[J]. IEEE Geoscience and Remote Sensing Letters, 2015, 12(3): 467-471.

WALD L. Quality of high resolution synthesized images: Is there a simple criterion?[C]. Proceedings of International Conference on Fusion of Earth Data, Nice, France, 2000: 99-105.

KIM Y S, LEE J H, and RA J B. Multi-sensor image registration based on intensity and edge orientation information[J]. Pattern Recognition, 2008, 41(11): 3356-3365.

高绍姝, 金伟其, 王霞, 等. 可见光与红外彩色融合图像感知清晰度评价模型[J]. 光谱学与光谱分析, 2012, 32(12): 3197-3202.

GAO Shaoshu, JIN Weiqi, WANG Xia, et al. The Evaluation model of perceived definition based on visible light and infrared color fusion image[J]. Spectroscopy and Spectral Analysis, 2012, 32(12): 3197-3202.

PELI E. Contrast in complex images[J]. Journal of the Optical Society of America A, 1990, 7(10): 2032-2040.

KRKPATRIEK S, GELATT C D, and VECCHI M P. Optimization by simulated annealing[J]. Science, 1983, 220: 671-680.

BURT P J and ADELSON E H. The Laplacian pyramid

as a compact image code[J]. IEEE Transactions on Communications, 1983, 31(4): 532-540.

TOET A. Natural color mapping for multiband night vision imagery[J]. Information Fusion, 2003, 4(1): 155-166.

STUDHOLME C, HILL D L G, and HAWKES D J. An overlap in variant entropy measure of 3D medical image alignment[J]. Pattern Recognition, 1999, 32(1): 71-86.

BROWN L. A survey of image registration techniques[J]. ACM Computing Surveys, 1992, 24(4): 325-376.

XYDEAS C S and PETROVIC V. Objective image fusion performance measure[J]. Electronics Letters, 2000, 36(4): 305-309.

TRELEA I C. The particle swarm optimization algorithm: convergence analysis and parameter selection[J]. Information Processing Letters, 2003, 85(6): 317-325.

Relative Articles

Supplements(0)

Cited By

Proportional views