A Multimodal sensor analysis framework for vehicular mobile applications

Download

index.pdf

Date

2013

Author

Orhan, Fatih

Metadata

Show full item record

Item Usage Stats

196
views

105
downloads

The sensing, computing and communicating capabilities of smart phones bring new possibilities for creating remarkable applications increasing the quality, safety, comfort, economy and other capabilities of cars. However, many challenges exist regarding the development of multimodal sensor analysis applications, such as proper collection of sensor values, integration of diverse libraries and tools for sharing the results. This study focuses on these challenges and aims to construct a framework that enables easy, fast and flexible implementations of smart vehicular applications. The goal is to provide capabilities for real-time sensing, signal and multimedia processing, and sharing of information. Hence, the proposed framework provides an abstraction for easy access to sensor readings, and also diverse signal and image processing libraries are integrated and mechanisms are developed and provided with the framework for information sharing. A sample mobile application is also developed in the scope of this study, in order to demonstrate the capabilities and the feasibility of the developed framework. This application is a multimodal sensor analyzer which intends to detect obstacles on the road or critical road surface anomalies (i.e. pothole, speed bump) by measuring and analyzing different sensors of smart phones (GPS, accelerometer, magnetometer and camera) in real-time. First, the detection is performed on one modality by analyzing the motion of the vehicle using the accelerometer sensor and then a second analysis is performed using the camera images to automatically extract the video section and the image of the corresponding road segment containing the defect. Upon such critical hazard detection, the application instantly informs nearby users about the incident with detailed information and image of the scene. The developed mobile application is deployed on multiple devices as part of a test scenario in a chosen location and the outcomes of the test scenario are measured and evaluated as part of the validation.

Subject Keywords

Mobile communication systems., Mobile geographic information systems., Global system for mobile communications., Multimodal user interfaces (Computer systems).

URI

http://etd.lib.metu.edu.tr/upload/12616403/index.pdf
https://hdl.handle.net/11511/23083

Collections

Graduate School of Informatics, Thesis

Suggestions

OpenMETU
Core

A novel user activity prediction model for context aware computing systems Peker, Serhat; Koçyiğit, Altan; Department of Information Systems (2011) In the last decade, with the extensive use of mobile electronic and wireless communication devices, there is a growing need for context aware applications and many pervasive computing applications have become integral parts of our daily lives. Context aware recommender systems are one of the popular ones in this area. Such systems surround the users and integrate with the environment; hence, they are aware of the users' context and use that information to deliver personalized recommendations about everyday ...
A Mobile sensing framework for audience emotion analysis Kepucka, Eldjon; Temizel, Alptekin; Department of Information Systems (2014) The main objective of this thesis is to develop a multi-modal framework which facilitates simple data collection using mobile sensing on smartphones from an audience, for the duration of an experimental study. Current solutions primarily rely on custom mobile sensing platforms which are expensive to develop and complicated to apply. While there are a number of mobile sensing platforms developed for smartphones targeting different domains, such as transportation and air pollution they are not designed to be ...
A Study on quality assessment on mobile B2C applications Yıldız, Ekrem; Bilgen, Semih; Department of Information Systems (2014) This study aims to provide mechanisms to analyze the quality of the Business to Customer (B2C) mobile software products based on mobile-specific characteristics and quality factors, and sub-factors based on ISO 25010 product quality model which would help mobile software developers, designers and testers to develop more effective mobile applications. We aim to help development of more qualified and effective mobile applications from not only developers’ perspective but also endusers’ perspective. For this p...
A Mobile Participatory Framework for the Consumer Decision Process ÖZARSLAN, SÜLEYMAN; Eren, Pekin Erhan (2013-09-27) With the recent advances in mobile technologies, the role of mobile information systems has been increasing within the consumer behavior domain. Accordingly, we propose a holistic framework which supports consumers on all stages of the consumer decision process by using the participatory sensing approach. The consumer decision process is the major part of the consumer behavior, and represents the set of stages a consumer follows when purchasing a product. On the other hand, participatory sensing is a recent...
A Context-aware application recommendation system for mobile device users Bayram, Gamze; Koçyiğit, Altan; Department of Information Systems (2015) Development of smartphones and applications has opened a whole new world for mobile device users. Although this new world has many benefits due to a large diversity, regarding specific application domains, it is getting more complex day by day. In this study, a context-aware application recommendation system that recognizes the situation of users, predicts, and recommends the interactions that are likely to happen by the users in their specific context is developed. The proposed system is based on a hybridi...

Citation Formats

F. Orhan, “A Multimodal sensor analysis framework for vehicular mobile applications,” M.S. - Master of Science, Middle East Technical University, 2013.