Using Multi-Agent Reinforcement Learning in Auction Simulations

Date

2020-04-01

Author

Kanmaz, Medet
Sürer, Elif

Metadata

Show full item record

Item Usage Stats

492
views

0
downloads

Game theory has been developed by scientists as a theory of strategic interaction among players who are supposed to be perfectly rational. These strategic interactions might have been presented in an auction, a business negotiation, a chess game, or even in a political conflict aroused between different agents. In this study, the strategic (rational) agents created by reinforcement learning algorithms are supposed to be bidder agents in various types of auction mechanisms such as British Auction, Sealed Bid Auction, and Vickrey Auction designs. Next, the equilibrium points determined by the agents are compared with the outcomes of the Nash equilibrium points for these environments. The bidding strategy of the agents is analyzed in terms of individual rationality, truthfulness (strategy-proof), and computational efficiency. The results show that using a multi-agent reinforcement learning strategy improves the outcomes of the auction simulations.

Subject Keywords

Reinforcement learning, Multi-Agent rein forcement learning;, Auction simulation, Nash equilibrium

URI

https://arxiv.org/abs/2004.02764
https://hdl.handle.net/11511/74620

Collections

Turkish Armed Forces Modeling and Simulation R&D Center (TSK-MODSİMMER), Book / Book chapter

Suggestions

OpenMETU
Core

Using Generative Adversarial Nets on Atari Games for Feature Extraction in Deep Reinforcement Learning Aydın, Ayberk; Sürer, Elif (2020-04-01) Deep Reinforcement Learning (DRL) has been suc-cessfully applied in several research domains such as robotnavigation and automated video game playing. However, thesemethods require excessive computation and interaction with theenvironment, so enhancements on sample efficiency are required.The main reason for this requirement is that sparse and delayedrewards do not provide an effective supervision for representationlearning of deep neural networks. In this study, Proximal Policy...
EXTRACTING EXPLICIT RELATIONAL INFORMATION FROM A NEW RELATIONAL REASONING TESTBED WITH A LEARNING AGENT Küçüksubaşı, Faruk; Sürer, Elif; Department of Modeling and Simulation (2021-7-29) In recent studies, reinforcement learning (RL) agents work in ways that are specialized according to the tasks, and most of the time, their decision-making logic is not interpretable. By using symbolic artificial intelligence techniques like logic programming, statistical methods-based agent algorithms can be enhanced in terms of generalizability and interpretability. In this study, the PrediNet architecture is used for the first time in an RL problem, and in order to perform benchmarking, the multi-head do...
Multi-objective linguistic-neutrosophic matrix game and its applications to tourism management Bhaumik, Ankan; Roy, Sankar Kumar; Weber, Gerhard Wilhelm (2021-04-01) Game theory plays an important role in numerous decision-oriented real-life problems. Nowadays, many such problems are basically characterized by various uncertainties. Uncertainties come to happen due to decision makers' collection of data, intuition, assumption, judgement, behaviour, evaluation and lastly, due to the problem itself. Fuzzy concept with membership degree made an initialization towards the treatment of uncertainty, but it was not enough. Intuitionistic fuzzy concept was evolved concerning wi...
Using chains of bottleneck transitions to decompose and solve reinforcement learning tasks with hidden states Aydın, Hüseyin; Çilden, Erkin; Polat, Faruk (2022-08-01) Reinforcement learning is known to underperform in large and ambiguous problem domains under partial observability. In such cases, a proper decomposition of the task can improve and accelerate the learning process. Even ambiguous and complex problems that are not solvable by conventional methods turn out to be easier to handle by using a convenient problem decomposition, followed by the incorporation of machine learning methods for the sub-problems. Like in most real-life problems, the decomposition of a ta...
Inventory control under substitutable demand: A stochastic game application Avşar, Zeynep Müge (Wiley, 2002-06-01) Substitutable product inventory problem is analyzed using the concepts of stochastic game theory. It is assumed that there are two substitutable products that are sold by different retailers and the demand for each product is random. Game theoretic nature of this problem is the result of substitution between products. Since retailers compete for the substitutable demand, ordering decision of each retailer depends on the ordering decision of the other retailer. Under the discounted payoff criterion, this pro...

Citation Formats

M. Kanmaz and E. Sürer, Using Multi-Agent Reinforcement Learning in Auction Simulations. 2020.