Finite-state sign language morphophonology

Sevinç, Ayça Müge
The aim of this thesis is to investigate the computational power required for processing sign language morphophonology. This dissertation focuses on the objective of reducing autosegmental representations and rules defined by three sign language phonology models, namely, Movement-Hold Model (Liddell & Johnson, 1989), Hand-Tier Model (Sandler, 1989, 1990), and Prosodic Model (Brentari, 1998), to finite state machinery. By adopting Autosegmental Phonology framework (Goldsmith, 1976), these models are capable of dealing with both simultaneity and sequentiality observed in sign language phonology and morphology. We suggest algorithms for transforming the autosegmental representations and rules constructed within these three models into state labeled automata of One-Level Phonology (Bird & Ellison, 1994). State labeled automata are known to have regular language power. By this reduction, non-linear representations of sign languages are shown to be serializable.


Verb concepts from affordances
Kalkan, Sinan; Yuerueten, Onur; Borghi, Anna M.; Şahin, Erol (John Benjamins Publishing Company, 2014-01-01)
In this paper, we investigate how the interactions of a robot with its environment can be used to create concepts that are typically represented by verbs in language. Towards this end, we utilize the notion of affordances to argue that verbs typically refer to the generation of a specific type of effect rather than a specific type of action. Then, we show how a robot can form these concepts through interactions with the environment and how humans can use these concepts to ease their communication with the r...
A Low cost learning based sign language recognition system
Akış, Abdullah Hakan; Akar, Gözde; Department of Electrical and Electronics Engineering (2018)
Sign Language Recognition (SLR) is an active area of research due to its important role in Human Computer Interaction (HCI). The aim of this work is to automatically recognize hand gestures consisting of the movement of hand, arm and fingers. To achieve this, we studied two different approaches, namely feature based recognition and Convolutional Neural Networks (CNN) based recognition. The first approach is based on segmentation, feature extraction and classification whereas the second one is based on segme...
Robot hand preshaping and regrasping using genetic algorithms
Erkmen, İsmet; Erkmen, Aydan Müşerref; Gunver, H (2000-09-01)
This paper contributes (1) to the development of the necessary formalism for the generation of task optimal fingertip trajectories for a multifingered robot hand of a predetermined preshape closing upon an object to be handled; (2) to the generation, in the case of a failing grasp, of an optimal sequence of hand preshapes, differing gradually from each other in terms of manipulability and stability. A "look ahead" preshape control for a robot hand, either in the phase of impacting an object with a certain h...
Coupling speech recognition and rule-based machine translation
Köprü, Selçuk; Yazıcı, Adnan; Department of Computer Engineering (2008)
The objective of this thesis was to study the coupling of automatic speech recognition (ASR) systems with rule-based machine translation (MT) systems. In this thesis, a unique approach to integrating ASR with MT for speech translation (ST) tasks was proposed. The proposed approach is unique, essentially because it includes the rst rule-based MT system that can process speech data in a word graph format. Compared to other rule-based MT systems, our system processes both a word graph and a stream of words. Th...
Language learning from the perspective of nonlinear dynamic systems
Hohenberger, Annette Edeltraud; Peltzer-Karpf, Annemarie (Walter de Gruyter GmbH, 2009-01-01)
This article outlines a nonlinear dynamic systems approach to language learning on the basis of developmental cognitive neuroscience. Language learning, on this view, is a process of experience-dependent shaping and selection of broadly defined domain-general and domain-specific genetic predispositions. The central concept of development is (neuro) cognitive,e growth in terms of self-organization. Linguistic structure-building is synergetic and emergent insofar as the acquisition of a critical mass of eleme...
Citation Formats
A. M. Sevinç, “Finite-state sign language morphophonology,” Ph.D. - Doctoral Program, Middle East Technical University, 2015.