Playtesting: What is Beyond Personas

Download
2022-01-01
Ariyurek, Sinan
Sürer, Elif
Betin Can, Aysu
We present two approaches to improve automated playtesting. First, we propose developing persona, which allows a persona to progress to different goals. In contrast, the procedural persona is fixed to a single goal. Second, a human playtester knows which paths she has tested before, and during the consequent tests, she may test different paths. However, Reinforcement Learning (RL) agents disregard these previous paths. We propose a novel methodology that we refer to as Alternative Path Finder (APF). We train APF with previous paths and employ APF during the training of a RL agent. APF modulates the reward structure of the environment while preserving the agent's goal. When evaluated, the agent generates a different trajectory that achieves the same goal. We use the General Video Game Artificial Intelligence and VizDoom frameworks to test our proposed methodologies. We use Proximal Policy Optimization RL agent during experiments. First, we compare the playtest data generated by developing and procedural persona. Our experiments show that developing persona provides better insight into the game and how different players would play. Second, we present the alternative paths found using APF and argue why traditional RL agents cannot learn those paths.
IEEE Transactions on Games

Suggestions

Playtesting: What is Beyond Personas
Ariyurek, Sinan; Sürer, Elif; Betin Can, Aysu (2021-07-01)
Playtesting is an essential step in the game design process. Game designers use the feedback from playtests to refine their design. Game designers may employ procedural personas to automate the playtesting process. In this paper, we present two approaches to improve automated playtesting. First, we propose a goal-based persona model, which we call developing persona -- developing persona proposes a dynamic persona model, whereas the current persona models are static. Game designers can use the developing pe...
AUTOMATED VIDEO GAME TESTING USING REINFORCEMENT LEARNING AGENTS
Arıyürek, Sinan; Sürer, Elif; Betin Can, Aysu; Department of Bioinformatics (2022-9-21)
In this thesis, several methodologies are introduced to automate and improve video game playtesting. These methods are based on Reinforcement Learning (RL) agents. First, synthetic and human-like tester agents are proposed to automate video game testing. The synthetic agent uses test goals generated from game scenarios, and the human-like agent uses test goals extracted from tester trajectories. Tester agents are derived from Sarsa and Monte Carlo Tree Search (MCTS) but focus on finding defects, while tradi...
Jumps in an stochastic optimization: self-financing portfolio for risk averse investors: does bequest matter?
Gazioglu, Saziye; Bastiyali-Hafavi, Azize; Sezgin, Ozge (2013-05-01)
We optimized consumer/investor behaviour, subject to self-financing constraint by using stochastic dynamics system with jumps. Our aim in this article was to compare a stochastic optimization model with and without jumps in a self-financing portfolio model, for the risk averse investors. In this article, our contribution to the literature was to introduce an analytical solution of the utility maximizing model and to investigate the consequences of jumps and bequest to the economic system. A previous model b...
Deep Learning-Based Hybrid Approach for Phase Retrieval
IŞIL, ÇAĞATAY; Öktem, Sevinç Figen; KOÇ, AYKUT (2019-06-24)
We develop a phase retrieval algorithm that utilizes the hybrid-input-output (HIO) algorithm with a deep neural network (DNN). The DNN architecture, which is trained to remove the artifacts of HIO, is used iteratively with HIO to improve the reconstructions. The results demonstrate the effectiveness of the approach with little additional cost.
Mobile Robot Heading Adjustment Using Radial Basis Function Neural Networks Controller and Reinforcement Learning
BAYAR, GÖKHAN; Konukseven, Erhan İlhan; Koku, Ahmet Buğra (2008-10-28)
This paper proposes radial basis function neural networks approach to the Solution of a mobile robot heading adjustment using reinforcement learning. In order to control the heading of the mobile robot, the neural networks control system have been constructed and implemented. Neural controller has been charged to enhance the control system by adding some degrees of strength. It has been achieved that neural networks system can learn the relationship between the desired directional heading and the error posi...
Citation Formats
S. Ariyurek, E. Sürer, and A. Betin Can, “Playtesting: What is Beyond Personas,” IEEE Transactions on Games, pp. 0–0, 2022, Accessed: 00, 2022. [Online]. Available: https://hdl.handle.net/11511/97721.