Experimenting with software testbeds for evaluating new technologies

RUS, Ioana
Betin Can, Aysu
BULTAN, Tevfik
ANDERS, Bettina
BASILI, Victor
SHULL, Forrest
TVEDT, Roseanne
PECH, Daniel
The evolution of a new technology depends upon a good theoretical basis for developing the technology, as well as upon its experimental validation. In order to provide for this experimentation, we have investigated the creation of a software testbed and the feasibility of using the same testbed for experimenting with a broad set of technologies. The testbed is a set of programs, data, and supporting documentation that allows researchers to test their new technology on a standard software platform. An important component of this testbed is the Unified Model of Dependability (UMD), which was used to elicit dependability requirements for the testbed software. With a collection of seeded faults and known issues of the target system, we are able to determine if a new technology is adept at uncovering defects or providing other aids proposed by its developers. In this paper, we present the Tactical Separation Assisted Flight Environment (TSAFE) testbed environment for which we modeled and evaluated dependability requirements and defined faults to be seeded for experimentation. We describe two completed experiments that we conducted on the testbed. The first experiment studies a technology that identifies architectural violations and evaluates its ability to detect the violations. The second experiment studies model checking as part of design for verification. We conclude by describing ongoing experimental work studying testing, using the same testbed. Our conclusion is that even though these three experiments are very different in terms of the studied technology, using and re-using the same testbed is beneficial and cost effective.


A new fuzzy-chaotic modelling proposal for medical diagnostic processes
Beyan, Timur; Baykal, Nazife; Department of Information Systems (2005)
Main reason of this study is to set forth the internal paradox of the basic approach of the artificial intelligence in the medical field to by discussing on the theoretical and application levels and to suggest solutions in theory and practice against that. In order to rule out the internal paradox in the medical decision support systematic, a new medical model is suggested and based on this, concepts such as disease, health, etiology, diagnosis and treatment are questioned. Meanwhile, with the current scie...
Implementation and evaluation of age-aware downlink scheduling policies in communication networks
Oğuz, Tahir Kerem; Uysal, Elif; Department of Electrical and Electronics Engineering (2021-9-09)
As communication systems evolve, advanced perspectives are needed to meet the requirements of emerging applications. The Age of Information metric has taken its place in the literature to examine the information freshness demands of various applications. With the Age of Information perspective, the freshness of information subject to communication is monitored from the destination’s point of view. Within the scope of the thesis, a wireless network with a single transmitter (base station) and multiple receiv...
Assessing Information Technology Use in Organizations: Developing a Framework
Sezgin, Emre; Özkan Yıldırım, Sevgi (2011-10-07)
Increasing use of current and developing information technologies (IT) within business and production processes is a required transformation to survive in the market. However. IT should be well-managed to be adapted by an organization as a whole. This study proposes a new model for the assessment of IT use in organizations. The aim is to assist decision making processes in information technology management through exploring strength and weaknesses of organization on IT tools and applications. The model has ...
Sayısal Ortamda, Tasarımın Deneyimlenmesi İçin Arayüzlerin Geliştirilmesi: Bir Ön-Tasarım Parametresi Olarak Ses
Özgenel, Çağlar Fırat; Sorguç, Arzu (2011-01-01)
In architecture of our day, with the enhancement in technology, experiencing design decisions and / or changes by means of various computational technologies in computational medium has become an essential design tool. With the presence of the tools used in computational medium, changes in the architectural design process occurred and the usage of the tools drifted from simply virtual experience to optimization of the design by examining the design throughout the process. In the performance based design app...
Coordination of nanometrology in Europe (CO-NANOMET)
Turan, Raşit(2010-12-31)
Nanotechnology has the ability to become the most promising technology advance for the 21st Century. It offers a huge potential of applications and economic benefits, which may contribute to the European economy. Scientifically and economically, nano-metrology is an indispensible part for nanotechnology which must develop hand in hand with the developments of nano-science and –technology. The programme of work set out in this project will address the need within Europe to develop the required measurement fr...
Citation Formats
M. LINDVALL et al., “Experimenting with software testbeds for evaluating new technologies,” EMPIRICAL SOFTWARE ENGINEERING, pp. 417–444, 2007, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/31176.