Batch Mode TD(lambda) for Controlling Partially Observable Gene Regulatory Networks

Date

2017-11-01

Author

Sirin, Utku
Polat, Faruk
Alhajj, Reda

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

231
views

0
downloads

External control of gene regulatory networks (GRNs) has received much attention in recent years. The aim is to find a series of actions to apply to a gene regulation system making it avoid its diseased states. In this work, we propose a novel method for controlling partially observable GRNs combining batch mode reinforcement learning (Batch RL) and TD(lambda) algorithms. Unlike the existing studies inferring a computational model from gene expression data, and obtaining a control policy over the constructed model, our idea is to interpret the time series gene expression data as a sequence of observations that the system produced, and obtain an approximate stochastic policy directly from the gene expression data without estimation of the internal states of the partially observable environment. Thereby, we get rid of the most time consuming phases of the existing studies, inferring a model and running the model for the control. Results show that our method is able to provide control solutions for regulation systems of several thousands of genes only in seconds, whereas existing studies cannot solve control problems of even a few dozens of genes. Results also show that our approximate stochastic policies are almost as good as the policies generated by the existing studies.

Subject Keywords

Batch mode reinforcement learning, Temporal-difference learning, Gene regulatory networks, Gene expression, Gene regulation

URI

https://hdl.handle.net/11511/39510

Journal

IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS

DOI

https://doi.org/10.1109/tcbb.2016.2595577

Collections

Department of Computer Engineering, Article

Suggestions

OpenMETU
Core

Batch mode reinforcement learning for controlling gene regulatory networks and multi-model gene expression data enrichment framework Şirin, Utku; Polat, Faruk; Department of Computer Engineering (2013) Over the last decade, modeling and controlling gene regulation has received much attention. In this thesis, we have attempted to solve (i) controlling gene regulation systems and (ii) generating high quality artificial gene expression data problems. For controlling gene regulation systems, we have proposed three control solutions based on Batch Mode Reinforcement Learning (Batch RL) techniques. We have proposed one control solution for fully, and two control solutions for partially observable gene regulatio...
Feature reduction for gene regulatory network control Tan, Mehmet; Polat, Faruk; Alhajj, Reda (2007-10-17) Scalability is one of the most important issues in control problems, including the control of gene regulatory networks. In this paper we argue that it is possible to improve scalability of gene regulatory networks control by reducing the number of genes to be considered by the control policy; and consequently propose a novel method to estimate genes that are less important for control. The reported test results on real and synthetic data demonstrate the applicability and effectiveness of the proposed approach.
Induction and control of large-scale gene regulatory networks Tan, Mehmet; Tan, Mehmet; Department of Computer Engineering (2009) Gene regulatory networks model the interactions within the cell and thus it is essential to understand their structure and to develop some control mechanisms that could effectively deal with them. This dissertation tackles these two aspects. To handle the first problem, a new constraint-based modeling algorithm is proposed that can both increase the quality of the output and decrease the computational requirements for learning the structure of gene regulatory networks by integrating multiple biological data...
Integer linear programming based solutions for construction of biological networks Eren Özsoy, Öykü; Can, Tolga; Department of Health Informatics (2014) Inference of gene regulatory or signaling networks from perturbation experiments and gene expression assays is one of the challenging problems in bioinformatics. Recently, the inference problem has been formulated as a reference network editing problem and it has been show that finding the minimum number of edit operations on a reference network in order to comply with perturbation experiments is an NP-complete problem. In this dissertation, we propose linear programming based solutions for reconstruction o...
Automated Large-Scale Control of Gene Regulatory Networks Tan, Mehmet; Alhajj, Reda; Polat, Faruk (Institute of Electrical and Electronics Engineers (IEEE), 2010-04-01) Controlling gene regulatory networks (GRNs) is an important and hard problem. As it is the case in all control problems, the curse of dimensionality is the main issue in real applications. It is possible that hundreds of genes may regulate one biological activity in an organism; this implies a huge state space, even in the case of Boolean models. This is also evident in the literature that shows that only models of small portions of the genome could be used in control applications. In this paper, we empower...

Citation Formats

U. Sirin, F. Polat, and R. Alhajj, “Batch Mode TD(lambda) for Controlling Partially Observable Gene Regulatory Networks,” IEEE-ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS, pp. 1214–1227, 2017, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/39510.