A Sparse Temporal Mesh Model for Brain Decoding

Date

2016-08-23

Author

Afrasiyabi, Arman
Onal, Itir
Yarman Vural, Fatoş Tunay

Metadata

Show full item record

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

Item Usage Stats

207
views

0
downloads

One of the major drawbacks of brain decoding from the functional magnetic resonance images (fMRI) is the very high dimension of feature space which consists of thousands of voxels in sequence of brain volumes, recorded during a cognitive stimulus. In this study, we propose a new architecture, called Sparse Temporal Mesh Model (STMM), which reduces the dimension of the feature space by combining the voxel selection methods with the mesh learning method. We, first, select the "most discriminative" voxels using the state-of-the-art feature selection methods, namely, Recursive Feature Elimination (RFE), one way Analysis of Variance (ANOVA) and Mutual Information (MI). After we select the most informative voxels, we form a star mesh around each selected voxel with their functional neighbors. Then, we estimate the mesh arc weights, which represent the relationship among the voxels within a neighborhood. We further prune the estimated arc weights using ANOVA to get rid of redundant relationships among the voxels. By doing so, we obtain a sparse representation of information in the brain to discriminate cognitive states. Finally, we train k-Nearest Neighbor (kNN) and Support Vector Machine (SVM) classifiers by the feature vectors of sparse mesh arc weights. We test STMM architecture on a visual object recognition experiment. Our results show that forming meshes around the selected voxels leads to a substantial increase in the classification accuracy, compared to forming meshes around all the voxels in the brain. Furthermore, pruning the mesh arc weights by ANOVA solves the dimensionality curse problem and leads to a slight increase in the classification performance. We also discover that, the resulting network of sparse temporal meshes are quite similar in all three voxel selection methods, namely, RFE, ANOVA or MI.

Subject Keywords

fMRI, Voxel selection, Brain decoding, Object recognition, Classification

URI

https://hdl.handle.net/11511/52640

Conference Name

15th IEEE International Conference on Cognitive Informatics and Cognitive Computing (ICCI*CC)

Collections

Department of Computer Engineering, Conference / Seminar

Suggestions

OpenMETU
Core

A computational model of the brain for decoding mental states from FMRI images Alkan, Sarper; Yarman Vural, Fatoş Tunay; Department of Cognitive Sciences (2019) Brain decoding from brain images obtained using functional magnetic resonance imaging (fMRI) techniques is an important task for the identification of mental states and illnesses as well as for the development of brain machine interfaces. The brain decoding methods that use multi-voxel pattern analysis that rely on the selection of voxels (volumetric pixels) that have relevant activity with respect to the experimental tasks or stimuli of the fMRI experiments are the most commonly used methods. While MVPA ba...
Effect of Voxel Selection on Temporal Mesh Model for Brain Decoding Afrasiyabi, Arman; Onal, Itir; Yarman Vural, Fatoş Tunay (2016-05-19) In this study, we combine a voxel selection method with temporal mesh model to decode the discriminative information distributed in functional Magnetic Resonance Imaging (fMRI) data. We first employ one way Analysis of Variance (ANOVA) feature selection to select the most informative voxels. Then, we form meshes around selected voxels with their spatial and functional neighbors by employing the Mesh Model with Temporal Measurements (MM-TM). We estimate the arc weights of meshes, which represent the relation...
Modeling Voxel Connectivity for Brain Decoding Onal, Itir; Ozay, Mete; Yarman Vural, Fatoş Tunay (2015-06-12) The massively dynamic nature of human brain cannot be represented by considering only a collection of voxel intensity values obtained from fMRI measurements. It has been observed that the degree of connectivity among voxels provide important information for modeling cognitive activities. Moreover, spatially close voxels act together to generate similar BOLD responses to the same stimuli. In this study, we propose a local mesh model, called Local Mesh Model with Temporal Measurements (LMM-TM), to first estim...
An Information Theoretic Approach to Classify Cognitive States Using fMRI Onal, Itir; Ozay, Mete; Firat, Orhan; GİLLAM, İLKE; Yarman Vural, Fatoş Tunay (2013-11-13) In this study, an information theoretic approach is proposed to model brain connectivity during a cognitive processing task, measured by functional Magnetic Resonance Imaging (fMRI). For this purpose, a local mesh of varying size is formed around each voxel. The arc weights of each mesh are estimated using a linear regression model by minimizing the squared error. Then, the optimal mesh size for each sample, that represents the information distribution in the brain, is estimated by minimizing various inform...
Representation of Cognitive Processes Using the Minimum Spanning Tree of Local Meshes Firat, Orhan; Ozay, Mete; Onal, Itir; GİLLAM, İLKE; Yarman Vural, Fatoş Tunay (2013-07-07) A new graphical model called Cognitive Process Graph (CPG) is proposed, for classifying cognitive processes based on neural activation patterns which are acquired via functional Magnetic Resonance Imaging (fMRI) in brain. In the CPG, first local meshes are formed around each voxel. Second, the relationships between a voxel and its neighbors in a local mesh, which are estimated by using a linear regression model, are used to form the edges among the voxels (graph nodes) in the CPG. Then, a minimum spanning t...

Citation Formats

A. Afrasiyabi, I. Onal, and F. T. Yarman Vural, “A Sparse Temporal Mesh Model for Brain Decoding,” presented at the 15th IEEE International Conference on Cognitive Informatics and Cognitive Computing (ICCI*CC), Stanford Univ, Stanford, CA, 2016, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/52640.