Human activity classification using spatio-temporal feature relations

Download

index.pdf

Date

2012

Author

Akpınar, Kutalmış

Metadata

Show full item record

Item Usage Stats

102
views

41
downloads

This thesis compares the state of the art methods and proposes solutions for human activity classification from video data. Human activity classification is finding the meaning of human activities, which are captured by the video. Classification of human activity is needed in order to improve surveillance video analysis and summarization, video data mining and robot intelligence. This thesis focuses on the classification of low level human activities which are used as an important information source to determine high level activities. In this study, the feature relation histogram based activity description proposed by Ryoo et al. (2009) is implemented and extended. The feature histogram is widely used in feature based approaches; however, the feature relation histogram has the ability to represent the locational information of the features. Our extension defines a new set of relations between the features, which makes the method more effective for action description. Classifications are performed and results are compared using feature histogram, Ryoo’s feature relation histogram and our feature relation histogram using the same datasets and the feature type. Our experiments show that feature relation histogram performs slightly better than the feature histogram, our feature relation histogram is even better than both of the two. Although the difference is not clearly observable in the datasets containing periodic actions, a 12% improvement is observed for the non-periodic action datasets. Our work shows that the spatio-temporal relation represented by our new set of relations is a better way to represent the activity for classification.

Subject Keywords

Human activity recognition., Pattern recognition systems., Video surveillance, Data mining., Sequential pattern mining., Human engineering.

URI

http://etd.lib.metu.edu.tr/upload/12614587/index.pdf
https://hdl.handle.net/11511/21779

Collections

Graduate School of Natural and Applied Sciences, Thesis

Suggestions

OpenMETU
Core

Human behavior understanding using video analysis Gökçe, Celal Onur; Halıcı, Uğur; Department of Electrical and Electronics Engineering (2016) In this study we proposed a new hierarchical architecture for solution of human behavior understanding problem. A new dataset, namely football video game (FVG) dataset, is generated which involves activities more complex than any other dataset present in the literature. Football ball is detected using multilayer neural networks trained with gradient descent algorithm and enhanced using learning with queries method and it is tracked using growing window algorithm. After region of interest is extracted around...
Human activity recognition by Gait Analysis Kepenekci, Burcu; Akar, Gözde; Department of Electrical and Electronics Engineering (2011) This thesis analyzes the human action recognition problem. Human actions are modeled as a time evolving temporal texture. Gabor filters, which are proved to be a robust 2D texture representation tool by detecting spatial points with high variation, is extended to 3D domain to capture motion texture features. A well known filtering algorithm and a recent unsupervised clustering algorithm, the Genetic Chromodynamics, are combined to select salient spatio-temporal features of the temporal texture and to segmen...
Human action recognition with line and flow histograms İKİZLER CİNBİŞ, NAZLI; Cinbiş, Ramazan Gökberk; DUYGULU ŞAHİN, PINAR (2008-12-11) We present a compact representation for human action recognition in videos using line and optical flow histograms. We introduce a new shape descriptor based on the distribution of lines which are fitted to boundaries of human figures. By using an entropy-based approach, we apply feature selection to densify our feature representation, thus, minimizing classification time without degrading accuracy. We also use a compact representation of optical flow for motion information. Using line and flow histograms to...
Rapid training data generation from image sequences for pattern recognition DİLAN, Rasim Askin; Koku, Ahmet Buğra; Konukseven, Erhan İlhan (2011-04-15) This study focuses on the development of a novel technique for the rapid generation of artificial neural network training data from video streams. Videos captured on an off-road terrain are used to train artificial neural networks that learn to differentiate road and non-road sections in the captured videos. Contrary to the times-taking frame-by-frame processing, in the proposed method, classification data of road pixels is created concurrently as the video plays. The proposed method is explained in detail ...
ARAS Human Activity Datasets In Multiple Homes with Multiple Residents Alemdar, Hande; Incel, Ozlem Durmaz; Ersoy, Cem (2013-05-08) The real world human activity datasets are of great importance in development of novel machine learning methods for automatic recognition of human activities in smart environments. In this study, we present the details of ARAS (Activity Recognition with Ambient Sensing) human activity recognition datasets that are collected from two real houses with multiple residents during two months. The datasets contain the ground truth labels for 27 different activities. Each house was equipped with 20 binary sensors o...

Citation Formats

K. Akpınar, “Human activity classification using spatio-temporal feature relations,” M.S. - Master of Science, Middle East Technical University, 2012.