Video adaptation based on content characteristics and hardware capabilities

2007-12-18
Onur, Ozgur Deniz
Alatan, Abdullah Aydın
The subjective user satisfaction related to viewing a video on a resource constrained mobile device is modeled by using a utility function. The resulting models account for different video content characteristics and varying hardware capabilities of the viewing device. The user satisfaction is divided into two independent components, namely the temporal and the spatial satisfaction. Subjective video evaluation experiments are performed to obtain the models for each component. These components are combined by using a weighted sum. The firame-rate and the bit-rate that maximizes the total utility is then obtained by the optimization algorithms. It is further demonstrated that the utility curves obtained through subjective tests for a limited number of devices can be interpolated to generate utility curves for other devices with different hardware capabilities.

Suggestions

Video adaptation for transmission channels by utility modeling
Onur, OD; Alatan, Abdullah Aydın (2005-01-01)
The satisfaction a user gets from watching a video in a resource limited device, can be formulated by Utility Theory. The resulting video adaptation is optimal in the sense that the adapted video maximizes the user satisfaction, which is modeled through subjective tests comprising of 3 independent utility components : crispness, motion smoothness and confetti visibility These components are maximized in terms of coding parameters by obtaining a Pareto optimal set. In this manuscript, inclusion of transmissi...
Optimal video adaptation for resource constrained mobile devices based on utility theory
Önür, Özgür Deniz; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2003)
This thesis proposes a novel system to determine the best representation of a video in the sense that, a user watching the video reaches the highest level of satisfaction possible, given the resource capabilities of the viewing device. Utility theory is used to obtain a utility function representing the user satisfaction as a function of video coding parameters, and the viewing device capabilities. The utility function is formulated as the weighted sum of three individual components. These components are ch...
Video segmentation using partially decoded MPEG bitstream
Kayaalp, Işıl Burcun; Akar, Gözde; Department of Electrical and Electronics Engineering (2003)
In this thesis, a mixed type video segmentation algorithm is implemented to find the scene cuts in MPEG compressed video data. The main aim is to have a computationally efficient algorithm for real time applications. Due to this reason partial decoding of the bitstream is used in segmentation. As a result of partial decoding, features such as bitrate, motion vector type, and DC images are implemented to find both continuous and discontinuous scene cuts on a MPEG-2 coded general TV broadcast data. The result...
Representation Learning for Contextual Object and Region Detection in Remote Sensing
Firat, Orhan; Can, Gulcan; Yarman Vural, Fatoş Tunay (2014-08-28)
The performance of object recognition and classification on remote sensing imagery is highly dependent on the quality of extracted features, amount of labelled data and the priors defined for contextual models. In this study, we examine the representation learning opportunities for remote sensing. First we attacked localization of contextual cues for complex object detection using disentangling factors learnt from a small amount of labelled data. The complex object, which consists of several sub-parts is fu...
Optical flow based video frame segmentation and segment classification
Akpınar, Samet; Alpaslan, Ferda Nur; Department of Computer Engineering (2018)
Video information retrieval is a field of multimedia research enabling us to extract desired semantic information from video data. In content-based video information retrieval, visual content obtained from video scenes is utilized. For developing methods to cope with content-based video information retrieval in terms of temporal concepts such as action, event, etc., representation of temporal information becomes critical. In this thesis, action detection is tackled based on a temporal video representation m...
Citation Formats
O. D. Onur and A. A. Alatan, “Video adaptation based on content characteristics and hardware capabilities,” 2007, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/41848.