A Multimodal sensor analysis framework for vehicular mobile applications

Orhan, Fatih
The sensing, computing and communicating capabilities of smart phones bring new possibilities for creating remarkable applications increasing the quality, safety, comfort, economy and other capabilities of cars. However, many challenges exist regarding the development of multimodal sensor analysis applications, such as proper collection of sensor values, integration of diverse libraries and tools for sharing the results. This study focuses on these challenges and aims to construct a framework that enables easy, fast and flexible implementations of smart vehicular applications. The goal is to provide capabilities for real-time sensing, signal and multimedia processing, and sharing of information. Hence, the proposed framework provides an abstraction for easy access to sensor readings, and also diverse signal and image processing libraries are integrated and mechanisms are developed and provided with the framework for information sharing. A sample mobile application is also developed in the scope of this study, in order to demonstrate the capabilities and the feasibility of the developed framework. This application is a multimodal sensor analyzer which intends to detect obstacles on the road or critical road surface anomalies (i.e. pothole, speed bump) by measuring and analyzing different sensors of smart phones (GPS, accelerometer, magnetometer and camera) in real-time. First, the detection is performed on one modality by analyzing the motion of the vehicle using the accelerometer sensor and then a second analysis is performed using the camera images to automatically extract the video section and the image of the corresponding road segment containing the defect. Upon such critical hazard detection, the application instantly informs nearby users about the incident with detailed information and image of the scene. The developed mobile application is deployed on multiple devices as part of a test scenario in a chosen location and the outcomes of the test scenario are measured and evaluated as part of the validation.


A novel user activity prediction model for context aware computing systems
Peker, Serhat; Koçyiğit, Altan; Department of Information Systems (2011)
In the last decade, with the extensive use of mobile electronic and wireless communication devices, there is a growing need for context aware applications and many pervasive computing applications have become integral parts of our daily lives. Context aware recommender systems are one of the popular ones in this area. Such systems surround the users and integrate with the environment; hence, they are aware of the users' context and use that information to deliver personalized recommendations about everyday ...
A Mobile sensing framework for audience emotion analysis
Kepucka, Eldjon; Temizel, Alptekin; Department of Information Systems (2014)
The main objective of this thesis is to develop a multi-modal framework which facilitates simple data collection using mobile sensing on smartphones from an audience, for the duration of an experimental study. Current solutions primarily rely on custom mobile sensing platforms which are expensive to develop and complicated to apply. While there are a number of mobile sensing platforms developed for smartphones targeting different domains, such as transportation and air pollution they are not designed to be ...
A Study on quality assessment on mobile B2C applications
Yıldız, Ekrem; Bilgen, Semih; Department of Information Systems (2014)
This study aims to provide mechanisms to analyze the quality of the Business to Customer (B2C) mobile software products based on mobile-specific characteristics and quality factors, and sub-factors based on ISO 25010 product quality model which would help mobile software developers, designers and testers to develop more effective mobile applications. We aim to help development of more qualified and effective mobile applications from not only developers’ perspective but also endusers’ perspective. For this p...
A Mobile Participatory Framework for the Consumer Decision Process
ÖZARSLAN, SÜLEYMAN; Eren, Pekin Erhan (2013-09-27)
With the recent advances in mobile technologies, the role of mobile information systems has been increasing within the consumer behavior domain. Accordingly, we propose a holistic framework which supports consumers on all stages of the consumer decision process by using the participatory sensing approach. The consumer decision process is the major part of the consumer behavior, and represents the set of stages a consumer follows when purchasing a product. On the other hand, participatory sensing is a recent...
A Self-Cloning Agents Based Model for High-Performance Mobile-Cloud Computing
Angın, Pelin; Jin, Zhongjun (2015-07-02)
The rise of the mobile-cloud computing paradigm in recent years has enabled mobile devices with processing power and battery life limitations to achieve complex tasks in real-time. While mobile-cloud computing is promising to overcome the limitations of mobile devices for real-time computing, the lack of frameworks compatible with standard technologies and techniques for dynamic performance estimation and program component relocation makes it harder to adopt mobile-cloud computing at large. Most of the avai...
Citation Formats
F. Orhan, “A Multimodal sensor analysis framework for vehicular mobile applications,” M.S. - Master of Science, Middle East Technical University, 2013.