Finite-state sign language morphophonology

Sevinç, Ayça Müge
The aim of this thesis is to investigate the computational power required for processing sign language morphophonology. This dissertation focuses on the objective of reducing autosegmental representations and rules defined by three sign language phonology models, namely, Movement-Hold Model (Liddell & Johnson, 1989), Hand-Tier Model (Sandler, 1989, 1990), and Prosodic Model (Brentari, 1998), to finite state machinery. By adopting Autosegmental Phonology framework (Goldsmith, 1976), these models are capable of dealing with both simultaneity and sequentiality observed in sign language phonology and morphology. We suggest algorithms for transforming the autosegmental representations and rules constructed within these three models into state labeled automata of One-Level Phonology (Bird & Ellison, 1994). State labeled automata are known to have regular language power. By this reduction, non-linear representations of sign languages are shown to be serializable.


Verb concepts from affordances
Kalkan, Sinan; Yuerueten, Onur; Borghi, Anna M.; Şahin, Erol (John Benjamins Publishing Company, 2014-01-01)
In this paper, we investigate how the interactions of a robot with its environment can be used to create concepts that are typically represented by verbs in language. Towards this end, we utilize the notion of affordances to argue that verbs typically refer to the generation of a specific type of effect rather than a specific type of action. Then, we show how a robot can form these concepts through interactions with the environment and how humans can use these concepts to ease their communication with the r...
Language learning from the perspective of nonlinear dynamic systems
Hohenberger, Annette Edeltraud; Peltzer-Karpf, Annemarie (Walter de Gruyter GmbH, 2009-01-01)
This article outlines a nonlinear dynamic systems approach to language learning on the basis of developmental cognitive neuroscience. Language learning, on this view, is a process of experience-dependent shaping and selection of broadly defined domain-general and domain-specific genetic predispositions. The central concept of development is (neuro) cognitive,e growth in terms of self-organization. Linguistic structure-building is synergetic and emergent insofar as the acquisition of a critical mass of eleme...
Robot hand preshaping and regrasping using genetic algorithms
Erkmen, İsmet; Erkmen, Aydan Müşerref; Gunver, H (2000-09-01)
This paper contributes (1) to the development of the necessary formalism for the generation of task optimal fingertip trajectories for a multifingered robot hand of a predetermined preshape closing upon an object to be handled; (2) to the generation, in the case of a failing grasp, of an optimal sequence of hand preshapes, differing gradually from each other in terms of manipulability and stability. A "look ahead" preshape control for a robot hand, either in the phase of impacting an object with a certain h...
Coupling speech recognition and rule-based machine translation
Köprü, Selçuk; Yazıcı, Adnan; Department of Computer Engineering (2008)
The objective of this thesis was to study the coupling of automatic speech recognition (ASR) systems with rule-based machine translation (MT) systems. In this thesis, a unique approach to integrating ASR with MT for speech translation (ST) tasks was proposed. The proposed approach is unique, essentially because it includes the rst rule-based MT system that can process speech data in a word graph format. Compared to other rule-based MT systems, our system processes both a word graph and a stream of words. Th...
Sign language recognition by image analysis /
Büyüksaraç, Buket; Bulut, Mehmet Mete; Akar, Gözde; Department of Electrical and Electronics Engineering (2015)
The Sign Language Recognition (SLR) Problem is a highly important research topic, because of its ability to increase the interaction between the people who are hearing-impaired or impediment in speech. However there are several limitations of the existing methods. Most applications need different necessities like making the user wear multi-colored or sensor based gloves or usage of a specific camera. We propose a simple but robust system that can be used without the need of any specific accessories. The pro...
Citation Formats
A. M. Sevinç, “Finite-state sign language morphophonology,” Ph.D. - Doctoral Program, Middle East Technical University, 2015.