Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis

Mol, Mayke
van Schaik, Anneke
Dozeman, Els
Ruwaard, Jeroen
Vis, Christiaan
Ebert, David D.
Etzelmueller, Anne
Mathiasen, Kim
Moles, Bárbara
Mora, Teresa
Pedersen, Claus D.
Skjøth, Mette Maria
Pensado, Luisa Peleteiro
Piera-Jimenez, Jordi
Gokcay, Didem
Ince, Burçin Ünlü
Russi, Alessio
Sacco, Ylenia
Zanalda, Enrico
Zabala, Ane Fullaondo
Riper, Heleen
Smit, Jan H.
Background: The System Usability Scale (SUS) is used to measure usability of internet-based Cognitive Behavioural Therapy (iCBT). However, whether the SUS is a valid instrument to measure usability in this context is unclear. The aim of this study is to assess the factor structure of the SUS, measuring usability of iCBT for depression in a sample of professionals. In addition, the psychometric properties (reliability, convergent validity) of the SUS were tested. Methods: A sample of 242 professionals using iCBT for depression from 6 European countries completed the SUS. Confirmatory Factor Analysis (CFA) was conducted to test whether a one-factor, two-factor, tone-model or bi-direct model would fit the data best. Reliability was assessed using complementary statistical indices (e.g. omega). To assess convergent validity, the SUS total score was correlated with an adapted Client Satisfaction Questionnaire (CSQ-3). Results: CFA supported the one-factor, two-factor and tone-model, but the bi-factor model fitted the data best (Comparative Fit Index=0.992, Tucker Lewis Index=0.985, Root Mean Square Error of Approximation=0.055, Standardized Root Mean Square Residual=0.042 (respectively chi(2)(diff) (9)=69.82, p < 0.001; chi(2)(diff) (8) (=) 33.04, p < 0.001). Reliability of the SUS was good (omega=0.91). The total SUS score correlated moderately with the CSQ-3 (CSQ1 r(s) =.49, p < 0.001; CSQ2 r(s) =.46, p < 0.001; CSQ3 r(s) =.38, p < 0.001), indicating convergent validity. Conclusions: Although the SUS seems to have a multidimensional structure, the best model showed that the total sumscore of the SUS appears to be a valid and interpretable measure to assess the usability of internet-based interventions when used by professionals in mental healthcare.
BMC Psychiatry


SAHIN, NH; SAHIN, N (Wiley, 1992-03-01)
The Dysfunctional Attitude Scale (DAS-A) has been used in many studies to measure depressogenic attitudes, vulnerability to depression and to assess the effectiveness of cognitive therapy. Despite its frequent use in research, no data have yet been reported on its item validity. The purpose of the present study was to investigate the item validity and psychometric properties of the DAS-A in the Turkish cultural context. The subjects were 345 university students. The locally adapted versions of the Beck ...
Autism screening questionnaire: diagnostic validity
Kazak Berument, Sibel; Lord, C; Pickles, A; Bailey, A (Royal College of Psychiatrists, 1999-11-01)
Background: Good interview and diagnostic measures for autism and other pervasive developmental disorders (PDDs) are available but there is a lack of a good screening questionnaire. Aims: To develop and test a screening questionnaire based on items in the best available diagnostic interview--the Autism Diagnostic Interview--Revised (ADI-R). Method: A 40-item scale, the Autism Screening Questionnaire (ASQ), was developed and tested on a sample of 160 individuals with PDD and 40 with non-PDD diagnoses. Res...
Perceived parental rearing behaviors, responsibility attitudes and life events as predictors of obsessive compulsive symptomatology: test of a cognitive model
Hacıömeroğlu, A. Bikem; Karancı, Ayşe Nuray; Department of Psychology (2008)
The main objective of this study was to examine the vulnerability factors of Obsessive Compulsive Symptomatology (OCS) in a non-clinical sample. On the basis of Salkovskis’ cognitive model of OCD, the present study aimed to investigate the role of perceived parental rearing behaviors, responsibility attitudes, and life events in predicting OCS. Furthermore, the mediator role of responsibility attitudes in the relationship between perceived parental rearing behaviors and OCS was examined. Finally, the specif...
Eye Tracking Scanpath Analysis Techniques on Web Pages: A Survey, Evaluation and Comparison
Eraslan, Sukru; Yesilada, Yeliz; Harper, Simon (2016-01-01)
Eye tracking has commonly been used to investigate how users interact with web pages, with the goal of improving their usability. This article comprehensively revisits the techniques that could be applicable to eye tracking data for analysing user scanpaths on web pages. It also uses a third-party eye tracking study to compare these techniques. This allows researchers to recognise existing techniques for their goals, understand how they work and know their strengths and limitations so that they can make an ...
Comparison of Cognitive Modeling and User Performance Analysis for Touch Screen Mobile Interface Design
Ocak, Nihan; Çağıltay, Kürşat (Informa UK Limited, 2016-12-23)
The aim of this study is to analyze and comparatively evaluate the usability of touch screen mobile applications through cognitive modeling and end-user usability testing methodologies. The study investigates the accuracy of the estimated results of a cognitive model produced for touch screen mobile phone interfaces. A mobile wallet application was chosen as the mobile software. The CogTool modeling tool was used as the cognitive modeling method. Eight tasks were determined and user tests were conducted in ...
Citation Formats
M. Mol et al., “Dimensionality of the system usability scale among professionals using internet-based interventions for depression: a confirmatory factor analysis,” BMC Psychiatry, 2020, Accessed: 00, 2020. [Online]. Available: https://hdl.handle.net/11511/51466.