VISIBLE AND INFRARED IMAGE FUSION USING ENCODER-DECODER NETWORK

Date

2021-01-01

Author

Ataman, Ferhat Can
Akar, Gözde

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

67
views

0
downloads

© 2021 IEEE.The aim of multispectral image fusion is to combine object or scene features of images with different spectral characteristics to increase the perceptual quality. In this paper, we present a novel learning-based solution to image fusion problem focusing on infrared and visible spectrum images. The proposed solution utilizes only convolution and pooling layers together with a loss function using no-reference quality metrics. The analysis is performed qualitatively and quantitatively on various datasets. The results show better performance than state-of-the-art methods. Also, the size of our network enables real-time performance on embedded devices. Project codes can be found at https://github.com/ferhatcan/ pyFusionSR.

Subject Keywords

infrared, visible images, image fusion, deep learning, encoder-decoder network, Deep learning, Encoder-decoder network, Image fusion, Infrared, Visible images

URI

https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85125570182&origin=inward
https://hdl.handle.net/11511/99032

DOI

https://doi.org/10.1109/icip42928.2021.9506740

Conference Name

2021 IEEE International Conference on Image Processing, ICIP 2021

Collections

Department of Electrical and Electronics Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

Visible And Infrared Image Fusion Using Encoder-Decoder Neural Network Ataman, Ferhat Can; Akar, Gözde; Department of Electrical and Electronics Engineering (2021-9-07) The image fusion aims to gather all important information from the source images into a single image. While the data is reduced, the fusion image has a high spa- tial and spectral resolution. It includes more informative and complete information. In this work, we reviewed state-of-the-art methods in the infrared and visible spec- trum image fusion literature and we present a novel deep learning-based solution. Our proposed method is inspired by encoder-decoder network U-Net architecture [1]. Furthermore...
Image fusion for improving spatial resolution of multispectral satellite images Ünlüsoy, Deniz; Süzen, Mehmet Lütfi; Department of Geological Engineering (2013) In this study, four different image fusion techniques have been applied to high spectral and low spatial resolution satellite images with high spatial and low spectral resolution images to obtain fused images with increased spatial resolution, while preserving spectral information as much as possible. These techniques are intensity-hue-saturation (IHS) transform, principle component analysis (PCA), Brovey transform (BT), and Wavelet transform (WT) image fusion. Images used in the study belong to Çankırı reg...
Image resolution enhancement using wavelet domain Hidden Markov Tree and coefficient sign estimation Temizel, Alptekin (2007-01-01) Image resolution enhancement using wavelets is a relatively new subject and many new algorithms have been proposed recently. These algorithms assume that the low resolution image is the approximation subband of a higher resolution image and attempts to estimate the unknown detail coefficients to reconstruct a high resolution image. A subset of these recent approaches utilized probabilistic models to estimate these unknown coefficients. Particularly, hidden Markov tree (HMT) based methods using Gaussian mixt...
Alignment of uncalibrated images for multi-view classification Arık, Sercan Ömer; Vural, Elif; Frossard, Pascal (2011-12-29) Efficient solutions for the classification of multi-view images can be built on graph-based algorithms when little information is known about the scene or cameras. Such methods typically require a pairwise similarity measure between images, where a common choice is the Euclidean distance. However, the accuracy of the Euclidean distance as a similarity measure is restricted to cases where images are captured from nearby viewpoints. In settings with large transformations and viewpoint changes, alignment of im...
Superpixel based image sequence representation and motion estimation İnce, Kutalmış Gökalp; Alatan, Abdullah Aydın; Demirekler, Mübeccel; Department of Electrical and Electronics Engineering (2017) In this study a superpixel based representation of image sequences is proposed. For superpixel extraction, a novel gradient ascent approach, in which spatial and spectral statistics are utilized to obtain an optimal Bayesian classiﬁer for pixel to superpixel label assignment, is proposed. Utilization of the spectral and spatial statistics reduce the dependency on user selected global parameters, while increasing the robustness and adaptability. Proposed Local Adaptive Superpixels (LASP) approach exploits he...

Citation Formats

F. C. Ataman and G. Akar, “VISIBLE AND INFRARED IMAGE FUSION USING ENCODER-DECODER NETWORK,” Alaska, Amerika Birleşik Devletleri, 2021, vol. 2021-September, Accessed: 00, 2022. [Online]. Available: https://www.scopus.com/inward/record.uri?partnerID=HzOxMe3b&scp=85125570182&origin=inward.