Multi-Frame motion deblurring of video using the natural oscillatory motion of dexterous legged robots

Date

2019-07-18

Author

Gultekin, Gokhan Koray
Saranlı, Afşar

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

153
views

0
downloads

Motion blur is a common problem for machine vision applications in legged mobile robotic platforms. Due to the oscillatory walking nature of these platforms, the cameras on them experience disturbances so that most of the captured frames are motion blurred. Motion blur results in loss of information in individual image frames and therefore makes single-frame deblurring an ill-posed problem. The variation in the magnitude of motion blur in consecutive video frames can be exploited to better restore these frames by combining the information available in them. The authors focus on the multi-frame image deblurring problem and propose a promising method to achieve this information fusion especially when the video is corrupted by non-linear blur, such as the case in legged mobile robots. The authors present the theory and results obtained on a realistic motion-blur dataset collected on a representative robotic platform. These results are also compared with a leading single-frame deblurring method and show improvement in particular for video corrupted by linear and non-linear motion blur.

URI

https://hdl.handle.net/11511/48509

Journal

IET IMAGE PROCESSING

DOI

https://doi.org/10.1049/iet-ipr.2018.6678

Collections

Department of Electrical and Electronics Engineering, Article

Suggestions

OpenMETU
Core

Camera motion blur and its effect on feature detectors Üzer, Ferit; Saranlı, Afşar; Department of Electrical and Electronics Engineering (2010) Perception, hence the usage of visual sensors is indispensable in mobile and autonomous robotics. Visual sensors such as cameras, rigidly mounted on a robot frame are the most common usage scenario. In this case, the motion of the camera due to the motion of the moving platform as well as the resulting shocks or vibrations causes a number of distortions on video frame sequences. Two most important ones are the frame-to-frame changes of the line-of-sight (LOS) and the presence of motion blur in individual fr...
MULTI-RESOLUTION MOTION ESTIMATION FOR MOTION COMPENSATED FRAME INTERPOLATION Guenyel, Bertan; Alatan, Abdullah Aydın (2010-09-29) A multi-resolution motion estimation scheme is proposed for tracking of the true 2D motion in video sequences for motion compensated image interpolation. The proposed algorithm utilizes frames with different resolutions and adaptive block dimensions for efficient representation of motion. Firstly, motion vectors for each block are assigned as a result of predictive search in each pass. Then, the outlier motion vectors are detected and corrected at the end of each pass. Simulation results with respect to dif...
Single and multi-frame motion deblurring for legged robots: characterization using a novel fd-aroc performance metric and a comprehensive motion-blur dataset Gültekin, Gökhan Koray; Saranlı, Afşar; Department of Electrical and Electronics Engineering (2016) Dexterous legged robots are agile platforms that can move on variable terrain at high speeds. The locomotion of these legged platforms causes oscillations of the robot body which become more severe depending on the surface and locomotion speed. Camera sensors mounted on such platforms experience the same disturbances, hence resulting in motion blur. This is a corruption of the image and results in loss of information which in turn causes degradation or loss of important image features. Most of the studies i...
ADAPTIVE MESH-GRID BASED SPATIALLY NON-UNIFORM VIDEO MOTION DEBLURRING USING IMU-CAMERA SENSOR FUSION Arslan, Ahmet; Saranlı, Afşar; Gültekin, Gökhan Koray; Department of Electrical and Electronics Engineering (2021-9-6) Motion blur is a common problem that produces blurry images with inevitable information loss and unpleasant visual quality. Relative motion between scene and image recording device during exposure time causes the motion blur. This artifact degrades the human perceptual quality and also challenges subsequent computer vision applications. Most of the studies in the literature assume uniform blur present in the image and focuses on removing motion blur with non-blind deconvolution algorithms because of their l...
LQG/LTR, H-infinity and Mu robust controllers design for line of sight stabilization Baskın, Mehmet; Leblebicioğlu, Mehmet Kemal; Department of Electrical and Electronics Engineering (2015) Line of sight stabilization against various disturbances is an essential property of gimbaled vision systems mounted on mobile platforms. As the vision systems are designed to function at longer operating ranges with relatively narrow field of views, the expectations from stabilization loops have increased in recent years. In order to design a good stabilization loop, high gain compensation is required. While satisfying high loop gains for disturbance attenuation, it is also required to satisfy sufficient l...

Citation Formats

G. K. Gultekin and A. Saranlı, “Multi-Frame motion deblurring of video using the natural oscillatory motion of dexterous legged robots,” IET IMAGE PROCESSING, pp. 1502–1508, 2019, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/48509.