Photometric stereo considering highlights and shadows

Büyükatalay, Soner
Three dimensional (3D) shape reconstruction that aims to reconstruct 3D surface of objects using acquired images, is one of the main problems in computer vision. There are many applications of 3D shape reconstruction, from satellite imaging to material sciences, considering a continent on earth or microscopic surface properties of a material. One of these applications is the automated firearm identification that is an old, yet an unsolved problem in forensic science. Firearm evidence matching algorithms rely on the fact that a firearm creates characteristic marks on surfaces of the bullets and the cartridge cases. These marks should be digitized unaffected from different surface material properties of evidences. Accuracy of 3D shape is one of the most important parameters affecting the overall identification performance. A very high resolution, accurate 3D data have to be reconstructed in the order of minutes. Photometric stereo (PS) method is capable of reconstructing high resolution surfaces in a fast manner. But, the metallic material and the surface topology of the firearm evidences generate highlights and shadows on their images that does not comply with the assumptions of conventional PS. In the scope of this work, it is intended to design an accurate, fast and robust 3D shape reconstruction scheme using PS considering highlights and shadows. These new PS procedures to be developed here should not be limited only to the ballistic evidences but they also could be used for a wider range of objects reflection properties and texture. For this purpose, masked PS methods which are quite fast when compared to other approaches, were classified and implemented. Simple additional masking methods are also proposed. A novel weighted PS method, using weighted least square estimation, is presented to eliminate false edges created by the masks. Concurrently, the calibration processes and the illumination configuration were improved. The disturbances due to close light sources were removed by image calibrations. From experimental tests to simulate the light positioning problem, it is concluded that the double zenith illumination configuration have better performance than the optimal single zenith illumination configuration, when the highlights and the shadows are considered. Double zenith illumination configuration results were further improved by the weighted normal PS with a small additional computation cost. All the implemented methods were tested firstly on the controlled environment using synthetic images. Later the same tests were conducted on real objects with varying characteristics as well as the firearm evidences.


3D object recognition using scale space of curvatures
Akagündüz, Erdem; Ulusoy, İlkay; Department of Electrical and Electronics Engineering (2011)
In this thesis, a generic, scale and resolution invariant method to extract 3D features from 3D surfaces, is proposed. Features are extracted with their scale (metric size and resolution) from range images using scale-space of 3D surface curvatures. Different from previous scale-space approaches; connected components within the classified curvature scale-space are extracted as features. Furthermore, scales of features are extracted invariant of the metric size or the sampling of the range images. Geometric ...
3D reconstruction of rigid objects from multiple calibrated views
Mülayim, Adem Yaşar; Atalay, Mehmet Volkan; Halıcı, Uğur; Department of Computer Engineering (2003)
In this thesis, an image based three dimensional (3D) model reconstruction system is investigated and the work done for such a complete reconstruction system is presented. Calibrated images of a rigid object, acquired under a simple but controlled environment, are used to recover the 3D object geometry and the surface appereance. Based on a multi-image camera calibration method, an algorithm to define the rotation axis of a turn-table with respect to the fixed camera coordinate frame has been developed. Fur...
3D indirect shape retrieval based on hand interaction
Irmak, Erdem Can; Sahillioğlu, Yusuf; Department of Game Technologies (2017)
In this thesis, a novel 3D indirect shape analysis method is presented which successfully retrieves 3D shapes based on the hand-object interaction. In the first part of the study, the human hand information is processed and trans- ferred to the virtual environment by Leap Motion Controller. Position and rotation of the hand, the angle of the finger joints are used for this part in our method. Also, in this approach, a new type of feature, which we call inter- action point, is introduced. These interaction p...
3D Face Reconstruction Using Stereo Images and Structured Light
OZTURK, Ahmet Oguz; Halıcı, Uğur; ULUSOY PARNAS, İLKAY; AKAGUNDUZ, Erdem (2008-04-22)
In this paper, the 3D face scanner that we developed using stereo cameras and structured light together is presented. Structured light having a pattern of vertical lines is used to create feature points and to match them easily. 3D point cloud obtained by stereo analysis is post processed to obtain the 3D model in obj format.
Planar 3d scene representations for depth compression
Özkalaycı, Burak Oğuz; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2014)
The recent invasion of stereoscopic 3D television technologies is expected to be followed by autostereoscopic and holographic technologies. Glasses-free multiple stereoscopic pair displaying capabilities of these technologies will advance the 3D experience. The prospective 3D format to create the multiple views for such displays is Multiview Video plus Depth (MVD) format based on the Depth Image Based Rendering (DIBR) techniques. The depth modality of the MVD format is an active research area whose main obj...
Citation Formats
S. Büyükatalay, “Photometric stereo considering highlights and shadows,” Ph.D. - Doctoral Program, Middle East Technical University, 2011.