Decoding cognitive states using the bag of words model on fMRI time series

Download

index.pdf

Date

2017

Author

Sucu, Güneş

Metadata

Show full item record

Item Usage Stats

87
views

98
downloads

Bag-of-words (BoW) modeling has yielded successful results in document and image classification tasks. In this study, we explore the use of BoW for cognitive state classification. We estimate a set of common patterns embedded in the Functional Magnetic Resonance Imaging (fMRI) time series recorded in three dimensional voxel coordinates by clustering the Blood Oxygen Level Dependent (BOLD) responses. We use these common patterns, called the code-words, to encode activities of both individual voxels and group of voxels, and obtain BoW representations on which we train linear classifiers. We experimented with a number of different BoW representations such as encoding spatial and functional neighbors, spatial pooling, and soft and hard encoding. Our experimental results show that, on a multiclass fMRI dataset, the hard BoW encoding, when applied to individual voxels, significantly improves the classification accuracy (an average 7.22% increase when applied on average intensity per voxel and an average 15.52% increase when applied to raw intensity time series per voxel) compared to a classical multi voxel pattern analysis (MVPA) method. This preliminary result gives us a clue to generate a code-book for fMRI data which may be used to represent a variety of cognitive states to study the human brain.

Subject Keywords

Brain, Magnetic resonance imaging., Time-series analysis., Cognitive styles.

URI

http://etd.lib.metu.edu.tr/upload/12621400/index.pdf
https://hdl.handle.net/11511/26701

Collections

Graduate School of Natural and Applied Sciences, Thesis

Suggestions

OpenMETU
Core

Decoding Cognitive States Using the Bag of Words Model on fMRI Time Series Sucu, Güneş; Akbaş, Emre; Yarman Vural, Fatoş Tunay (2016-05-19) Bag-of-words (BoW) modeling has yielded successful results in document and image classification tasks. In this paper, we explore the use of BoW for cognitive state classification. We estimate a set of common patterns embedded in the fMRI time series recorded in three dimensional voxel coordinates by clustering the BOLD responses. We use these common patterns, called the code-words, to encode activities of both individual voxels and group of voxels, and obtain a BoW representation on which we train linear cl...
An Improved BOW Approach Using Fuzzy Feature Encoding and Visual-word Weighting Altintakan, Umit L.; Yazıcı, Adnan (2015-08-05) The bag-of-words (BOW) has become a popular image representation model with successful implementations in visual analysis. Although the original model has been improved in several ways, the utilization of the Fuzzy Set Theory in BOW has not been investigated thoroughly. This paper presents a fuzzy feature encoding approach to address the problems associated with the hard and soft assignments of image features to the visualwords. Our encoding method assigns each image feature to only the first and second clo...
Interpretation of searches for supersymmetry with simplified models Chatrchyan, S.; et. al. (American Physical Society (APS), 2013-09-01) The results of searches for supersymmetry by the CMS experiment are interpreted in the framework of simplified models. The results are based on data corresponding to an integrated luminosity of 4.73 to 4.98 fb(-1). The data were collected at the LHC in proton-proton collisions at a center-of-mass energy of 7 TeV. This paper describes the method of interpretation and provides upper limits on the product of the production cross section and branching fraction as a function of new particle masses for a number o...
Image categorization using Fisher kernels of non-iid image models Cinbiş, Ramazan Gökberk; Schmid, Cordelia (2012-01-01) The bag-of-words (BoW) model treats images as an unordered set of local regions and represents them by visual word histograms. Implicitly, regions are assumed to be identically and independently distributed (iid), which is a poor assumption from a modeling perspective. We introduce non-iid models by treating the parameters of BoW models as latent variables which are integrated out, rendering all local regions dependent. Using the Fisher kernel we encode an image by the gradient of the data log-likelihood w....
Oblique parameters and extra generations via OPUCEM Asilar, Ece; Cavlan, Esin; Doganguen, Oktay; Kefeli, Sinan; ÖZCAN, VEYSİ ERKCAN; ŞAHİN, MEHMET; Uenel, Goekhan (2012-04-01) Recent improvements to OPUCEM, the tool for calculation of the contributions of various models to oblique parameters, are presented. OPUCEM is used to calculate the available parameter space for the four family Standard Model given the current electroweak precision data. It is shown that even with the restrictions on Higgs boson and new quark masses presented in the 2011 Autumn conferences, there is still enough space to allow a fourth generation with Dirac type neutrinos. For Majorana type neutrinos, the a...

Citation Formats

G. Sucu, “Decoding cognitive states using the bag of words model on fMRI time series,” M.S. - Master of Science, Middle East Technical University, 2017.