Identifying psychosis spectrum disorder from experience sampling data using machine learning approaches

The ubiquity of smartphones opened up the possibility of widespread use of the Experience Sampling Method (ESM). The method is used to collect longitudinal data of participants' daily life experiences and is ideal to capture fluctuations in emotions (momentary mental states) as an indicator for later mental ill-health. In this study, ESM data of patients with psychosis spectrum disorder and controls were used to examine daily life emotions and higher order patterns thereof. We attempted to determine whether aggregated ESM data, in which statistical measures represent the distribution and dynamics of the original data, were able to distinguish patients from controls in a predictive modeling framework. Variable importance, recursive feature elimination, and ReliefF methods were used for feature selection. Model training, tuning, and testing were performed in nested cross-validation, based on algorithms such as Random Forests, Support Vector Machines, Gaussian Processes, Logistic Regression, and Neural Networks. ROC analysis was used to post-process these models. Stability of model performance was studied using Monte Carlo simulations. The results provide evidence that patterns in emotion changes can be captured by applying a combination of these techniques. Acceleration in the variables anxious and insecure was particularly successful in adding further predictive power to the models. The best results were achieved by Support Vector Machines with radial kernel (accuracy = 82% and sensitivity = 82%). This proof-of-concept work demonstrates that synergistic machine learning and statistical modeling may be used to harness the power of ESM data in the future.