Experimenting with software testbeds for evaluating new technologies

Download
index.pdf
2007-08-01
LINDVALL, Mikael
RUS, Ioana
DONZELLI, Paolo
MEMON, Atif
ZELKOWITZ, Marvin
Betin Can, Aysu
BULTAN, Tevfik
ACKERMANN, Chris
ANDERS, Bettina
ASGARI, Sima
BASILI, Victor
HOCHSTEIN, Lorin
FELLMANN, Joerg
SHULL, Forrest
TVEDT, Roseanne
PECH, Daniel
HIRSCHBACH, Daniel
Show full item record
Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
189
views
0
downloads
The evolution of a new technology depends upon a good theoretical basis for developing the technology, as well as upon its experimental validation. In order to provide for this experimentation, we have investigated the creation of a software testbed and the feasibility of using the same testbed for experimenting with a broad set of technologies. The testbed is a set of programs, data, and supporting documentation that allows researchers to test their new technology on a standard software platform. An important component of this testbed is the Unified Model of Dependability (UMD), which was used to elicit dependability requirements for the testbed software. With a collection of seeded faults and known issues of the target system, we are able to determine if a new technology is adept at uncovering defects or providing other aids proposed by its developers. In this paper, we present the Tactical Separation Assisted Flight Environment (TSAFE) testbed environment for which we modeled and evaluated dependability requirements and defined faults to be seeded for experimentation. We describe two completed experiments that we conducted on the testbed. The first experiment studies a technology that identifies architectural violations and evaluates its ability to detect the violations. The second experiment studies model checking as part of design for verification. We conclude by describing ongoing experimental work studying testing, using the same testbed. Our conclusion is that even though these three experiments are very different in terms of the studied technology, using and re-using the same testbed is beneficial and cost effective.
Empirical study, Technology evaluation, Software testbed
https://hdl.handle.net/11511/31176
EMPIRICAL SOFTWARE ENGINEERING
Graduate School of Informatics, Article

Suggestions

A new fuzzy-chaotic modelling proposal for medical diagnostic processes
Beyan, Timur; Baykal, Nazife; Department of Information Systems (2005)
Main reason of this study is to set forth the internal paradox of the basic approach of the artificial intelligence in the medical field to by discussing on the theoretical and application levels and to suggest solutions in theory and practice against that. In order to rule out the internal paradox in the medical decision support systematic, a new medical model is suggested and based on this, concepts such as disease, health, etiology, diagnosis and treatment are questioned. Meanwhile, with the current scie...
Evaluating the convergence of high-performance computing with big data, artificial intelligence and cloud computing technologies
Dildar Korkmaz, Yeşim; Eren, Pekin Erhan; Kayabay, Kerem; Department of Information Systems (2023-1-24)
The advancements in High-Performance Computing (HPC), Big Data, Artificial Intelligence (AI), and Cloud Computing technologies have led to a convergence of these fields, resulting in the emergence of significant improvements for a wide range of fields. Identifying the state of development of technology convergence and forecasting promising technology convergence is critical for both academia and industry. That's why technology assessment and forecasting for HPC-Big Data-AI-Cloud Computing convergence is nee...
Implementation and evaluation of age-aware downlink scheduling policies in communication networks
Oğuz, Tahir Kerem; Uysal, Elif; Department of Electrical and Electronics Engineering (2021-9-09)
As communication systems evolve, advanced perspectives are needed to meet the requirements of emerging applications. The Age of Information metric has taken its place in the literature to examine the information freshness demands of various applications. With the Age of Information perspective, the freshness of information subject to communication is monitored from the destination’s point of view. Within the scope of the thesis, a wireless network with a single transmitter (base station) and multiple receiv...
Assessing Information Technology Use in Organizations: Developing a Framework
Sezgin, Emre; Özkan Yıldırım, Sevgi (2011-10-07)
Increasing use of current and developing information technologies (IT) within business and production processes is a required transformation to survive in the market. However. IT should be well-managed to be adapted by an organization as a whole. This study proposes a new model for the assessment of IT use in organizations. The aim is to assist decision making processes in information technology management through exploring strength and weaknesses of organization on IT tools and applications. The model has ...
Sayısal Ortamda, Tasarımın Deneyimlenmesi İçin Arayüzlerin Geliştirilmesi: Bir Ön-Tasarım Parametresi Olarak Ses
Özgenel, Çağlar Fırat; Sorguç, Arzu (2011-01-01)
In architecture of our day, with the enhancement in technology, experiencing design decisions and / or changes by means of various computational technologies in computational medium has become an essential design tool. With the presence of the tools used in computational medium, changes in the architectural design process occurred and the usage of the tools drifted from simply virtual experience to optimization of the design by examining the design throughout the process. In the performance based design app...
Citation Formats
M. LINDVALL et al., “Experimenting with software testbeds for evaluating new technologies,” EMPIRICAL SOFTWARE ENGINEERING, pp. 417–444, 2007, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/31176.
METU IIS - Integrated Information Service open@metu.edu.tr