An FPGA based high performance optical flow hardware design for autonomous mobile robotic platforms

Download
2010
Gültekin, Gökhan Koray
Optical flow is used in a number of computer vision applications. However, its use in mobile robotic applications is limited because of the high computational complexity involved and the limited availability of computational resources on such platforms. The lack of a hardware that is capable of computing optical flow vector field in real time is a factor that prevents the mobile robotics community to efficiently utilize some successful techniques presented in computer vision literature. In this thesis work, we design and implement a high performance FPGA hardware with a small footprint and low power consumption that is capable of providing over-realtime optical flow data and is hence suitable for this application domain. A well known differential optical flow algorithm presented by Horn & Schunck is selected for this implementation. The complete hardware design of the proposed system is described in details. We also discuss the design alternatives and the selected approaches together with a discussion of the selection procedure. We present the performance analysis of the proposed hardware in terms of computation speed, power consumption and accuracy. The designed hardware is tested with some of the available test sequences that are frequently used for performance evaluations of the optical flow techniques in literature. The proposed hardware is capable of computing optical flow vector field on 256x256 pixels images in 3.89ms which corresponds to a processing speed of 257 fps. The results obtained from FPGA implementation are compared with a floating-point implementation of the same algorithm realized on a PC hardware. The obtained results show that the hardware implementation achieved a superior performance in terms of speed, power consumption and compactness while there is minimal loss of accuracy due to the fixed point implementation.

Suggestions

An FPGA based high performance optical flow hardware design for computer vision applications
Gultekin, Gokhan Koray; Saranlı, Afşar (2013-05-01)
Optical Flow (OF) information is used in higher level vision tasks in a variety of computer vision applications. However, its use in resource constrained applications such as small-scale mobile robotic platforms is limited because of the high computational complexity involved. The inability to compute the OF vector field in real-time is the main drawback which prevents these applications to efficiently utilize some successful techniques from the computer vision literature. In this work, we present the desig...
A New Hardware-in-the-Loop Simulator for CNC Machine Applications
USENMEZ, S.; MUTLU, B. R.; Yaman, Ulaş; KILIÇ, ERGİN; Dölen, Melik; Koku, Ahmet Buğra (2013-03-01)
This study focuses on an integrated software and hardware platform that is capable of performing (real-time/nonreal- time) hardware-in-the-loop simulation of dynamic systems, including electrical machinery, CNC machine tools. In this approach, once the dynamics of the plant to be controlled is defined via C++ language, the resulting code is cross-compiled automatically on a PC. Executable files along with the necessary drivers are downloaded onto the composite hardware platform that consists of a Field Prog...
A VERSATILE MICROCOMPUTER INTERFACE AND PERIPHERAL DEVICES - AN APPLICATION IN DEUTERIUM LAMP BACKGROUND CORRECTION GRAPHITE-FURNACE ATOMIC-ABSORPTION SPECTROMETRY
GOKMEN, A; YALCIN, S (1992-01-01)
A versatile interface card for Apple IIe computer and various peripheral devices are designed to control instruments which generates transient signals like in graphite furnace atomic spectrometer. The interface card consists of a multiplexed analog-to-digital converter, a digital-to-analog converter, and a timer/counter chip. The timer/counter chip with 16 built-in registers can be programmed in many modes which provides a time base for real-time measurements. A stepper motor runs under the control of ti...
A MEMS Based Lens Microscanner for Resolution Enhancement of Infrared Imaging Systems
Sozak, Ahmet; Simsek, Ertug; Azgın, Kıvanç (2019-01-01)
The aim of this study is to demonstrate a Micro Electro Mechanical Systems (MEMS) based in-plane (x and y axes) lens scanner to improve the resolution of Long Wave Infrared Optical Systems (8-12 mu m wavelength). The proposed actuator consists of a 2 axis decoupled stage and has 4 separate V-Shaped (Chevron) thermal actuators which provide sufficient force and displacement to position the lens within required time. Miniaturization of lens has been achieved by using an aspherical surface and optimization of ...
Acceleration of molecular dynamics simulation for TERSOFF2 potential through reconfigurable hardware
Vargün, Bilgin; Erkoç, Şakir; Eminoğlu, Selim; Department of Micro and Nanotechnology (2012)
In nanotechnology, Carbon Nanotubes systems are studied with Molecular Dynamics Simulation software programs investigating the properties of molecular structure. Computational loads are very complex in these kinds of software programs. Especially in three body simulations, it takes a couple of weeks for small number of atoms. Researchers use supercomputers to study more complex systems. In recent years, by the development of sophisticated Field Programmable Gate Array (FPGA) Technology, researchers design s...
Citation Formats
G. K. Gültekin, “An FPGA based high performance optical flow hardware design for autonomous mobile robotic platforms,” M.S. - Master of Science, Middle East Technical University, 2010.