Emergence of communication in RObots through Sensorimotor and Social Interaction (ROSSI)

Starting from the assumption that cognition is embodied, the ROSSI project addresses the question how the possibility of communication between agents (e.g. humans and robots) is effected by differences in sensorimotor capacities.This is an important issue, given that robots are expected to become more common in non-structured environments, such as homes or hospitals. While there is a trend towards humanoid robots, it is clear that for the foreseeable future there will still be substantial differences in physical embodiment between robots and humans.To explore to what extent concepts must be shared to facilitate communication, we will build robots with sensorimotor systems structurally roughly similar to human beings. Furthermore, the control mechanisms for these robots will be based on insights into the neural mechanisms underlying human concepts and language.In particular, two types of neurons in premotor cortex will be modelled: (1) canonical neurons, which are active during both the execution of specific object-directed actions and the mere visual observation of the same objects, and (2) mirror neurons, which are involved in both an agent's own actions and the visual observation of such actions performed by others.In this framework, the project's aims are twofold. First, behavioural and neurophysiological experiments will provide new evidence and insights into the grounding of human conceptualization and language. Second, computational modelling of the underlying neural mechanisms will provide novel approaches to grounding of robotic conceptualization and language.More specifically, the project aims at building robots endowed with the sensorimotor and neural/computational mechanisms that allow them to: (a) flexibly manipulate and use objects in the environment, (b) use a simple form of language, i.e. nouns and verbs referring to objects and object-oriented actions, (c) use such concepts and verbal labels in social interaction with humans.


Fault detection and diagnosis in nonlinear dynamical systems
Kılıç, Erdal; Leblebicioğlu, Mehmet Kemal; Department of Electrical and Electronics Engineering (2005)
The aim of this study is to solve Fault Detection and Diagnosis (FDD) problems occurring in nonlinear dynamical systems by using model and knowledge-based FDD methods and to give a priority and a degree about faults. For this purpose, three model-based FDD approaches, called FDD by utilizing principal component analysis (PCA), system identification based FDD and inverse model based FDD are introduced. Performances of these approaches are tested on different nonlinear dynamical systems starting from simple t...
Reshaping human intention in Human-Robot Interactions by robot moves A comparative analysis of HMM and OOM methods
Durdu, Akif; Erkmen, Aydan Müşerref; Yilmaz, Alper (John Benjamins Publishing Company, 2019-01-01)
This paper outlines the methodology and experiments associated with the reshaping of human intentions based on robot movements within Human-Robot Interactions (HRIs). Although studies on estimating human intentions are well studied in the literature, reshaping intentions through robot-initiated interactions is a new significant branching in the field of HRI. In this paper, we analyze how estimated human intentions can intentionally change through cooperation with mobile robots in real Human-Robot environmen...
Implementation and Evaluation of Age-Aware Downlink Scheduling Policies in Push-Based and Pull-Based Communication
Oğuz, Tahir Kerem; Ceran Arslan, Elif Tuğçe; Uysal, Elif; Girici, Tolga (2022-5-01)
As communication systems evolve to better cater to the needs of machine-type applications such as remote monitoring and networked control, advanced perspectives are required for the design of link layer protocols. The age of information (AoI) metric has firmly taken its place in the literature as a metric and tool to measure and control the data freshness demands of various applications. AoI measures the timeliness of transferred information from the point of view of the destination. In this study, we exper...
Computational modeling of coupled cardiac electromechanics incorporating cardiac dysfunctions
Berberoglu, Ezgi; Solmaz, H. Onur; Göktepe, Serdar (Elsevier BV, 2014-11-01)
Computational models have huge potential to improve our understanding of the coupled biological, electrical, and mechanical underpinning mechanisms of cardiac function and diseases. This contribution is concerned with the computational modeling of different cardiac dysfunctions related to the excitation-contraction coupling in the heart. To this end, the coupled problem of cardiac electromechanics is formulated through the conservation of linear momentum equation and the excitation equation formulated in th...
Emergence of verb and object concepts through learning affordances
Dağ, Nilgün; Kalkan, Sinan; Şahin, Erol; Department of Computer Engineering (2010)
Researchers are still far from thoroughly understanding and building accurate computational models of the mechanisms in human mind that give rise to cognitive processes such as emergence of concepts and language acquisition. As a new attempt to give an insight into this issue, in this thesis, we are concerned about developing a computational model that leads to the emergence of concepts. Speci cally, we investigate how a robot can acquire verb and object concepts through learning affordances, a notion first...
Citation Formats
E. Şahin, “Emergence of communication in RObots through Sensorimotor and Social Interaction (ROSSI),” 2011. Accessed: 00, 2020. [Online]. Available: https://cordis.europa.eu/project/id/216125.