The State of the Art in HDR Deghosting: A Survey and Evaluation

Date

2015-05-01

Author

Tursun, Okan Tarhan
Akyüz, Ahmet Oğuz
Erdem, Aykut
Erdem, Erkut

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

150
views

0
downloads

Obtaining a high quality high dynamic range (HDR) image in the presence of camera and object movement has been a long-standing challenge. Many methods, known as HDR deghosting algorithms, have been developed over the past ten years to undertake this challenge. Each of these algorithms approaches the deghosting problem from a different perspective, providing solutions with different degrees of complexity, solutions that range from rudimentary heuristics to advanced computer vision techniques. The proposed solutions generally differ in two ways: (1) how to detect ghost regions and (2) what to do to eliminate ghosts. Some algorithms choose to completely discard moving objects giving rise to HDR images which only contain the static regions. Some other algorithms try to find the best image to use for each dynamic region. Yet others try to register moving objects from different images in the spirit of maximizing dynamic range in dynamic regions. Furthermore, each algorithm may introduce different types of artifacts as they aim to eliminate ghosts. These artifacts may come in the form of noise, broken objects, under-and over-exposed regions, and residual ghosting. Given the high volume of studies conducted in this field over the recent years, a comprehensive survey of the state of the art is required. Thus, the first goal of this paper is to provide this survey. Secondly, the large number of algorithms brings about the need to classify them. Thus the second goal of this paper is to propose a taxonomy of deghosting algorithms which can be used to group existing and future algorithms into meaningful classes. Thirdly, the existence of a large number of algorithms brings about the need to evaluate their effectiveness, as each new algorithm claims to outperform its precedents. Therefore, the last goal of this paper is to share the results of a subjective experiment which aims to evaluate various state-of-the-art deghosting algorithms.

Subject Keywords

Elastic registration, Ghost artifacts, Camera response, Image fusion, Stabilization, Algorithm, Removal

URI

https://hdl.handle.net/11511/35721

Journal

COMPUTER GRAPHICS FORUM

DOI

https://doi.org/10.1111/cgf.12593

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

The State of the art in HDR deghosting and an objective HDR image deghosting quality metric Tursun, Okan Tarhan; Akyüz, Ahmet Oğuz; Department of Computer Engineering (2016) Despite the emergence of new HDR acquisition methods, the multiple exposure technique (MET) is still the most popular one. The application of MET on dynamic scenes is a challenging task due to the diversity of motion patterns and uncontrollable factors such as sensor noise, scene occlusion and performance concerns on some platforms with limited computational capability. Currently, there are already more than 50 deghosting algorithms proposed for artifact-free HDR imaging of dynamic scenes and it is expected...
An Evaluation of ghost removal algorithms for exposure fusion Kutlu, Tuğser; Akar, Gözde; Department of Electrical and Electronics Engineering (2015) In high dynamic range imaging (HDR), the goal is to capture a scene with a higher dynamic range than the camera capable of capturing with a single exposure. Similar to HDR, exposure fusion is a process that takes multiple images and combines them to create a single dynamically enhanced image by only keeping the properly exposed elements. When using multiple images, local motion of objects can influence the quality of the final image in such a way that local motion of objects causes a ghost artifact. In this...
Evaluation of tone mapping and exposure fusion algorithms on HDR videos for face detection and recognition Çavdarlı, Fehime Betül; Akyüz, Ahmet Oğuz; Department of Computer Engineering (2022-2-08) High dynamic range (HDR) images have become popular recently especially for video surveillance systems. One of the most important reasons for this is that in areas where there is under or over-exposure, classical low dynamic range (LDR) images are insufficient to capture details, while HDR images have better visual details and contain wide range illumination values. However, since HDR images cannot be viewed on conventional LDR displays, additional processing such as tonemapping and/or fusion are required t...
Deep joint deinterlacing and denoising for single shot dual-ISO HDR reconstruction Çoğalan, Uğur; Akyüz, Ahmet Oğuz; Department of Computer Engineering (2019) HDR (High Dynamic Range) images have traditionally been obtained by merging multiple exposures each captured with a different exposure time. However, this approach entails longer capture times and necessitates deghosting if the captured scene contains moving objects. With the advent of modern camera sensors that can perform per-pixel exposure modulation, it is now possible to capture all of the required exposures within a single shot. The new challenge then becomes how to best combine different pixels with ...
Directional coding of backward compatible high dynamic range (HDR) image coding residues Feyiz, Kutan; Kamışlı, Fatih; Department of Electrical and Electronics Engineering (2018) High dynamic range (HDR) image and video formats are proposed to overcome limitations of widely accepted standard 8-bit low dynamic range (LDR) image and video representations. The main aim of these formats is to encode the whole luminance range of real world scenes which changes from extreme darkness ( 10 − 6 cd/ m 2 ) to bright sunshine ( 10 8 cd/ m 2 ), and to generate and store such scenes independent from the display technology. To achieve a successful transition from LDR to HDR technology, backward ...

Citation Formats

O. T. Tursun, A. O. Akyüz, A. Erdem, and E. Erdem, “The State of the Art in HDR Deghosting: A Survey and Evaluation,” COMPUTER GRAPHICS FORUM, pp. 683–707, 2015, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/35721.