FPGA-based infrared image deblurring using angular position of IR detector

Date

2020-08-01

Author

Doner, Tugay
GÖKCEN, DİNÇER

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

208
views

0
downloads

The motion of the object or the infrared (IR) imaging system during the integration time causes blurring of the IR image. This study covers real-time field programmable gate array (FPGA)-based deblurring for IR detectors, and an inertial measurement unit (IMU) was used to quantify the blur caused by the IR detector movement. Point spread function for each pixel was calculated using the angular position data of the IR detector obtained from IMU. Both spatially invariant and spatially variant blur cases can be modeled for the IR detector motion. After the quantification, the spatially invariant-type blur was eliminated using a Wiener filter-based deblurring algorithm. Deblurring algorithm was implemented in the Xilinx system generator environment directly using FPGA IP cores. The simulation results in the Xilinx system generator environment indicate that the proposed image deblurring method is real-time applicable, and it reduces the processing time of a single frame to 4 ms. For the implementation of 2D-fast Fourier transform design in FPGA using the corner turn matrix method, memory management is the most critical factor influencing the speed. The real-time deblurring solution given herein has the potential to be used in IR cameras on the moving platforms to increase the performance and robustness in systems such as object tracking and visual navigation.

Subject Keywords

Software, Computer Vision and Pattern Recognition, Computer Graphics and Computer-Aided Design

URI

https://hdl.handle.net/11511/64905

Journal

VISUAL COMPUTER

DOI

https://doi.org/10.1007/s00371-020-01961-y

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

New method for the fusion of complementary information from infrared and visual images for object detection Ulusoy, İlkay (Institution of Engineering and Technology (IET), 2011-02-01) Visual and infrared cameras have complementary properties and using them together may increase the performance of object detection applications. Although the fusion of visual and infrared information results in a better recall rate than using only one of those domains, there is always a decrease in the precision rate whereas the infrared domain on its own always has higher precision. Thus, the fusion of these domains is meaningful only for a better recall rate, which means that more foreground pixels are de...
A reality check for radiometric camera response recovery algorithms Akyüz, Ahmet Oğuz (Elsevier BV, 2013-11-01) The radiometric response of a camera governs the relationship between the incident light on the camera sensor and the output pixel values that are produced. This relationship, which is typically unknown and nonlinear, needs to be estimated for applications that require accurate measurement of scene radiance. Until now, various camera response recovery algorithms have been proposed each with different merits and drawbacks. However, an evaluation study that compares these algorithms has not been presented. In...
Extending Correlation Filter-Based Visual Tracking by Tree-Structured Ensemble and Spatial Windowing Gundogdu, Erhan; Özkan, Huseyin; Alatan, Abdullah Aydın (Institute of Electrical and Electronics Engineers (IEEE), 2017-11-01) Correlation filters have been successfully used in visual tracking due to their modeling power and computational efficiency. However, the state-of-the-art correlation filter-based (CFB) tracking algorithms tend to quickly discard the previous poses of the target, since they consider only a single filter in their models. On the contrary, our approach is to register multiple CFB trackers for previous poses and exploit the registered knowledge when an appearance change occurs. To this end, we propose a novel t...
Good Features to Correlate for Visual Tracking Gundogdu, Erhan; Alatan, Abdullah Aydın (Institute of Electrical and Electronics Engineers (IEEE), 2018-05-01) During the recent years, correlation filters have shown dominant and spectacular results for visual object tracking. The types of the features that are employed in this family of trackers significantly affect the performance of visual tracking. The ultimate goal is to utilize the robust features invariant to any kind of appearance change of the object, while predicting the object location as properly as in the case of no appearance change. As the deep learning based methods have emerged, the study of learni...
3D indirect shape retrieval based on hand interaction Irmak, Erdem Can; Sahillioğlu, Yusuf (Springer Science and Business Media LLC, 2020-01-01) In this work, we present a novel 3D indirect shape analysis method which successfully retrieves 3D shapes based on hand-object interaction. To this end, the human hand information is first transferred to the virtual environment by the Leap Motion controller. Position-, angle- and intersection-based novel features of the hand and fingers are used for this part. In the guidance of these features that define the way humans grab objects, a support vector machine (SVM) classifier is trained. Experiments validate...

Citation Formats

T. Doner and D. GÖKCEN, “FPGA-based infrared image deblurring using angular position of IR detector,” VISUAL COMPUTER, pp. 0–0, 2020, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/64905.