Automated Video Game Testing Using Synthetic and Human-Like Agents

Download

index.pdf

Date

2019-06-01

Author

Arıyürek, Sinan
Betin Can, Aysu
Sürer, Elif

Metadata

Show full item record

Item Usage Stats

172
views

218
downloads

In this paper, we present a new methodology that employs tester agents to automate video game testing. We introduce two types of agents -synthetic and human-like- and two distinct approaches to create them. Our agents are derived from Reinforcement Learning (RL) and Monte Carlo Tree Search (MCTS) agents, but focus on finding defects. The synthetic agent uses test goals generated from game scenarios, and these goals are further modified to examine the effects of unintended game transitions. The human-like agent uses test goals extracted by our proposed multiple greedy-policy inverse reinforcement learning (MGP-IRL) algorithm from tester trajectories. MGPIRL captures multiple policies executed by human testers. These testers' aims are finding defects while interacting with the game to break it, which is considerably different from game playing. We present interaction states to model such interactions. We use our agents to produce test sequences, run the game with these sequences, and check the game for each run with an automated test oracle. We analyze the proposed method in two parts: we compare the success of human-like and synthetic agents in bug finding, and we evaluate the similarity between humanlike agents and human testers. We collected 427 trajectories from human testers using the General Video Game Artificial Intelligence (GVG-AI) framework and created three games with 12 levels that contain 45 bugs. Our experiments reveal that human-like and synthetic agents compete with human testers' bug finding performances. Moreover, we show that MGP-IRL increases the human-likeness of agents while improving the bug finding performance.

URI

https://hdl.handle.net/11511/77046

Collections

Unclassified, Article

Suggestions

OpenMETU
Core

Automated Video Game Testing Using Synthetic and Human-Like Agents Arıyürek, Sinan; Betin Can, Aysu; Sürer, Elif (2019-10-01) We present a new methodology that employs tester agents to automate video game testing. We introduce two types of agents —synthetic and human-like. Our agents are derived from Sarsa and MCTS but focus on finding defects while traditional game-playing agents focus on maximizing game scores. The synthetic agent uses test goals generated from game scenarios, and these goals are further modified to examine the effects of unintended game transitions. The human-like agent uses test goals extracted by our proposed...
AUTOMATED VIDEO GAME TESTING USING REINFORCEMENT LEARNING AGENTS Arıyürek, Sinan; Sürer, Elif; Betin Can, Aysu; Department of Bioinformatics (2022-9-21) In this thesis, several methodologies are introduced to automate and improve video game playtesting. These methods are based on Reinforcement Learning (RL) agents. First, synthetic and human-like tester agents are proposed to automate video game testing. The synthetic agent uses test goals generated from game scenarios, and the human-like agent uses test goals extracted from tester trajectories. Tester agents are derived from Sarsa and Monte Carlo Tree Search (MCTS) but focus on finding defects, while tradi...
Vocational Interests toward complex occupations make a difference in STEM work life. Toker, Yonca (2018-04-19) The STEM Interest Complexity Measure, measuring interests toward complex tasks under the realistic and investigative work environments, was investigated with employed engineering-scientist and technol-ogist-technician samples. Interest levels were higher for the higher complexity engineering-scientist sample. Interest and work criteria associations were again higher for the high-complexity sample.
Optimum design and operation of 'a pump-piping-storage system' Kaplan, H; Seireg, A; Dölen, Melik (Inderscience Publishers, 2001-01-01) The study reported in this paper is undertaken to develop a computer simulation and an optimum design and operation strategy for a general storage system. The influence of various design parameters on the total operation cost of the system for a general delivery regime is also studied.
Evaluation and selection of case tools: a methodology and a case study Okşar, Koray; Okşar, Koray; Department of Information Systems (2010) Today’s Computer Aided Software Engineering (CASE) technology covers nearly all activities in software development ranging from requirement analysis to deployment.Organizations are evaluating CASE tool solutions to automate or ease their processes. While reducing human errors, these tools also increase control, visibility and auditability of the processes. However, to achieve these benefits, the right tool or tools should be selected for usage in the intended processes. This is not an easy task when the vas...

Citation Formats

S. Arıyürek, A. Betin Can, and E. Sürer, “Automated Video Game Testing Using Synthetic and Human-Like Agents,” 2019, Accessed: 00, 2021. [Online]. Available: https://hdl.handle.net/11511/77046.