Show/Hide Menu
Hide/Show Apps
Logout
Türkçe
Türkçe
Search
Search
Login
Login
OpenMETU
OpenMETU
About
About
Open Science Policy
Open Science Policy
Open Access Guideline
Open Access Guideline
Postgraduate Thesis Guideline
Postgraduate Thesis Guideline
Communities & Collections
Communities & Collections
Help
Help
Frequently Asked Questions
Frequently Asked Questions
Guides
Guides
Thesis submission
Thesis submission
MS without thesis term project submission
MS without thesis term project submission
Publication submission with DOI
Publication submission with DOI
Publication submission
Publication submission
Supporting Information
Supporting Information
General Information
General Information
Copyright, Embargo and License
Copyright, Embargo and License
Contact us
Contact us
Deep Joint Deinterlacing and Denoising for Single Shot Dual-ISO HDR Reconstruction
Date
2020-01-01
Author
Cogalan, Ugur
Akyüz, Ahmet Oğuz
Metadata
Show full item record
This work is licensed under a
Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License
.
Item Usage Stats
198
views
0
downloads
Cite This
HDR images have traditionally been obtained by merging multiple exposures each captured with a different exposure time. However, this approach entails longer capture times and necessitates deghosting if the captured scene contains moving objects. With the advent of modern camera sensors that can perform per-pixel exposure modulation, it is now possible to capture all of the required exposures within a single shot. The new challenge then becomes how to best combine different pixels with different exposure values into a single full-resolution and low-noise HDR image. We propose a joint multi-exposure frame deinterlacing and denoising algorithm powered by deep convolutional neural networks (DCNN). In our algorithm, we first train two DCNNs, with one tuned for reconstructing low exposures and the other for high exposures. Each DCNN takes the same mosaicked dual-ISO input image and outputs either the low exposure or high exposure depending on the type of the network. The resulting exposures can be demosaicked and converted to the desired target color space prior to HDR assembly. Our evaluations indicate that the quality of our results significantly surpasses the state-of-the-art in single-image HDR reconstruction algorithms.
Subject Keywords
Software
,
Computer Graphics and Computer-Aided Design
URI
https://hdl.handle.net/11511/48281
Journal
IEEE TRANSACTIONS ON IMAGE PROCESSING
DOI
https://doi.org/10.1109/tip.2020.3004014
Collections
Department of Computer Engineering, Article
Suggestions
OpenMETU
Core
Deep joint deinterlacing and denoising for single shot dual-ISO HDR reconstruction
Çoğalan, Uğur; Akyüz, Ahmet Oğuz; Department of Computer Engineering (2019)
HDR (High Dynamic Range) images have traditionally been obtained by merging multiple exposures each captured with a different exposure time. However, this approach entails longer capture times and necessitates deghosting if the captured scene contains moving objects. With the advent of modern camera sensors that can perform per-pixel exposure modulation, it is now possible to capture all of the required exposures within a single shot. The new challenge then becomes how to best combine different pixels with ...
Noise reduction in high dynamic range imaging
Akyüz, Ahmet Oğuz (Elsevier BV, 2007-10-01)
A common method to create high dynamic range (HDR) images is to combine several different exposures of the same scene. In this approach, the use of higher ISO settings will reduce exposure times, and thereby the total capture time. This is advantageous in certain environments where it may help minimize ghosting artifacts. However, exposures taken at high sensitivity settings tend to be noisy, which is further amplified by the HDR creation algorithm. We present a robust and efficient technique to significant...
Watermarking of Free-view Video
Koz, Alper; Cigla, Cevahir; Alatan, Abdullah Aydın (Institute of Electrical and Electronics Engineers (IEEE), 2010-07-01)
With the advances in image based rendering (IBR) in recent years, generation of a realistic arbitrary view of a scene from a number of original views has become cheaper and faster. One of the main applications of this progress has emerged as free-view TV(FTV), where TV-viewers select freely the viewing position and angle via IBR on the transmitted multiview video. Noting that the TV-viewer might record a personal video for this arbitrarily selected view and misuse this content, it is apparent that copyright...
Good Features to Correlate for Visual Tracking
Gundogdu, Erhan; Alatan, Abdullah Aydın (Institute of Electrical and Electronics Engineers (IEEE), 2018-05-01)
During the recent years, correlation filters have shown dominant and spectacular results for visual object tracking. The types of the features that are employed in this family of trackers significantly affect the performance of visual tracking. The ultimate goal is to utilize the robust features invariant to any kind of appearance change of the object, while predicting the object location as properly as in the case of no appearance change. As the deep learning based methods have emerged, the study of learni...
Accelerating Translational Image Registration for HDR Images on GPU
Alpay, Kadir Cenk; Temizel, Alptekin (null; 2020-10-09)
High Dynamic Range (HDR) images are generated using multiple exposures of a scene. When a hand-held camera is used to capture a static scene, these images need to be aligned by globally shifting each image in both dimensions. For a fast and robust alignment, the shift amount is commonly calculated using Median Threshold Bitmaps (MTB) and creating an image pyramid. In this study, we optimize these computations using a parallel processing approach utilizing GPU. Experimental evaluation shows that the proposed...
Citation Formats
IEEE
ACM
APA
CHICAGO
MLA
BibTeX
U. Cogalan and A. O. Akyüz, “Deep Joint Deinterlacing and Denoising for Single Shot Dual-ISO HDR Reconstruction,”
IEEE TRANSACTIONS ON IMAGE PROCESSING
, pp. 7511–7524, 2020, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/48281.