Hostname: page-component-69cd664f8f-lpdgq Total loading time: 0 Render date: 2025-03-12T21:22:53.486Z Has data issue: false hasContentIssue false

Characterising symptomatic substates in individuals on the psychosis continuum: a hidden Markov modelling approach

Published online by Cambridge University Press:  12 March 2025

Isabelle Scott*
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
Emmeke Aarts
Affiliation:
Department of Methodology and Statistics, Faculty of Social and Behavioural Sciences, Utrecht University, Utrecht, Netherlands
Cassandra Wannan
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
Caroline X. Gao
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia School of Public Health and Preventive Medicine, Monash University, Melbourne, VIC, Australia
Scott Clark
Affiliation:
Discipline of Psychiatry, Adelaide Medical School, The University of Adelaide, Adelaide, SA, Australia
Simon Hartmann
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia Discipline of Psychiatry, Adelaide Medical School, The University of Adelaide, Adelaide, SA, Australia
Josh Nguyen
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
Blake Cavve
Affiliation:
Telethon Kids Institute, The University of Western Australia, Perth, WA, Australia
Jessica A. Hartmann
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia Department of Public Mental Health, Central Institute of Mental Health, Medical Faculty Mannheim, University of Heidelberg, Mannheim, Germany
Dominic Dwyer
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
Sara van der Tuin
Affiliation:
Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion Regulation, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
Esdras Raposo de Almeida
Affiliation:
Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion Regulation, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands Institute & Department of Psychiatry (LIM-23), Hospital das Clinicas, School of Medicine, University of Sao Paulo, Sao Paulo, Brazil
Ashleigh Lin
Affiliation:
School of Population and Global Health, The University of Western Australia, Perth, WA, Australia
G. Paul Amminger
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
Andrew Thompson
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
Stephen J Wood
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia School of Psychology, The University of Birmingham, Birmingham, UK
Alison R. Yung
Affiliation:
Institute for Mental and Physical Health and Clinical Translation, Deakin University, Melbourne, VIC, Australia
David van den Berg
Affiliation:
Department of Clinical Psychology, Amsterdam Public Health Research Institute, Vrije Universiteit Amsterdam, Amsterdam, The Netherlands Mark van der Gaag Research Centre, Parnassia Psychiatric Institute, The Hague, The Netherlands
Patrick D. McGorry
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
Johanna T.W. Wigman
Affiliation:
Department of Psychiatry, Interdisciplinary Center Psychopathology and Emotion Regulation, University of Groningen, University Medical Center Groningen, Groningen, The Netherlands
Barnaby Nelson
Affiliation:
Orygen, Parkville, VC, Australia Centre for Youth Mental Health, The University of Melbourne, Melbourne, VIC, Australia
*
Corresponding author: Isabelle Scott; Email: [email protected]
Rights & Permissions [Opens in a new window]

Abstract

Background

To improve early intervention and personalise treatment for individuals early on the psychosis continuum, a greater understanding of symptom dynamics is required. We address this by identifying and evaluating the movement between empirically derived attenuated psychotic symptomatic substates—clusters of symptoms that occur within individuals over time.

Methods

Data came from a 90-day daily diary study evaluating attenuated psychotic and affective symptoms. The sample included 96 individuals aged 18–35 on the psychosis continuum, divided into four subgroups of increasing severity based on their psychometric risk of psychosis, with the fourth meeting ultra-high risk (UHR) criteria. A multilevel hidden Markov modelling (HMM) approach was used to characterise and determine the probability of switching between symptomatic substates. Individual substate trajectories and time spent in each substate were subsequently assessed.

Results

Four substates of increasing psychopathological severity were identified: (1) low-grade affective symptoms with negligible psychotic symptoms; (2) low levels of nonbizarre ideas with moderate affective symptoms; (3) low levels of nonbizarre ideas and unusual thought content, with moderate affective symptoms; and (4) moderate levels of nonbizarre ideas, unusual thought content, and affective symptoms. Perceptual disturbances predominantly occurred within the third and fourth substates. UHR individuals had a reduced probability of switching out of the two most severe substates.

Conclusions

Findings suggest that individuals reporting unusual thought content, rather than nonbizarre ideas in isolation, may exhibit symptom dynamics with greater psychopathological severity. Individuals at a higher risk of psychosis exhibited persistently severe symptom dynamics, indicating a potential reduction in psychological flexibility.

Type
Original Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0), which permits unrestricted re-use, distribution and reproduction, provided the original article is properly cited.
Copyright
© The Author(s), 2025. Published by Cambridge University Press

Introduction

Individuals with attenuated psychotic symptoms are at a heightened risk of developing a full-threshold psychotic disorder. To operationalise the increased risk of transition to psychosis observed in these individuals, the construct of an ultra-high risk (UHR) state for psychosis was introduced (Fusar-Poli et al., Reference Fusar-Poli, Borgwardt, Bechdolf, Addington, Riecher-Rössler, Schultze-Lutter and Yung2013; A. R. Yung et al., Reference Yung, McGorry, McFarlane, Jackson, Patton and Rakkar1996; Alison R. Yung, Phillips, Yuen, and McGorry, Reference Yung, Phillips, Yuen and McGorry2004). Despite the heightened risk of transitioning to first-episode psychosis compared to the general population and other clinical populations (de Pablo et al., Reference de Pablo, Raduà, Pereira, Bonoldi, Arienti, Besana and Fusar-Poli2021; Fusar-Poli et al., Reference Fusar-Poli, Borgwardt, Bechdolf, Addington, Riecher-Rössler, Schultze-Lutter and Yung2013; Yung et al., Reference Yung, McGorry, McFarlane, Jackson, Patton and Rakkar1996; Yung et al., Reference Yung, Phillips, Yuen, Francey, McFarlane, Hallgren and McGorry2003), only approximately 25% of UHR individuals transition over a 3-year period (de Pablo et al., Reference de Pablo, Raduà, Pereira, Bonoldi, Arienti, Besana and Fusar-Poli2021), and over 30% of individuals who present with first-episode psychosis have not experienced a prodromal phase meeting UHR criteria (Shah et al., Reference Shah, Crawford, Mustafa, Iyer, Joober and Malla2017). In addition, UHR individuals generally exhibit reduced functioning and require treatment irrespective of transition (Mei et al., Reference Mei, van der Gaag, Nelson, Smit, Yuen, Berger and McGorry2021).

Despite significant heterogeneity in the type, frequency, and trajectories of symptoms that occur in the UHR population (Addington et al., Reference Addington, Cornblatt, Cadenhead, Cannon, McGlashan, Perkins and Heinssen2011; Lencz, Smith, Auther, Correll, and Cornblatt, Reference Lencz, Smith, Auther, Correll and Cornblatt2004; McGlashan, Walsh, and Woods, Reference McGlashan, Walsh and Woods2010; Mittal and Addington, Reference Mittal and Addington2021; Woods et al., Reference Woods, Parker, Kerr, Walsh, Wijtenburg and Prunier2023; Yung et al., Reference Yung, Yuen, McGorry, Phillips, Kelly, Dell’Olio and Buckby2005), they are usually treated with a “one-size-fits-all” approach (Fusar-Poli et al., Reference Fusar-Poli, Salazar de Pablo, Correll, Meyer-Lindenberg, Millan, Borgwardt and Arango2020). Furthermore, individuals lower on the psychosis continuum who exhibit milder symptoms that do not meet UHR criteria may experience distress and impaired functioning (Kelleher et al., Reference Kelleher, Devlin, Wigman, Kehoe, Murtagh, Fitzpatrick and Cannon2014; Kelleher et al., Reference Kelleher, Wigman, Harley, O’Hanlon, Coughlan, Rawdon and Cannon2015; van Os, Linscott, Myin-Germeys, Delespaul, and Krabbendam, Reference van Os, Linscott, Myin-Germeys, Delespaul and Krabbendam2009). Tools such as the Comprehensive Assessment of At-Risk Mental States (CAARMS; Alison R. Yung et al., Reference Yung, Yuen, McGorry, Phillips, Kelly, Dell’Olio and Buckby2005) and the Prodromal Questionnaire-16 (PQ-16; Ising et al., Reference Ising, Veling, Loewy, Rietveld, Rietdijk, Dragt and van der Gaag2012) are widely used to assess psychosis risk and provide valuable information about symptom severity and frequency. However, these retrospective tools characterise psychosis symptoms by their average presence or absence, or by the most severe episode, rather than as dynamic and time-varying phenomena and provide little insight into how such experiences may fluctuate in the flow of daily life (Salvi, Rauch, and Baker, Reference Salvi, Rauch and Baker2021). Additional studies are needed to characterise the heterogeneous attenuated psychotic symptomsFootnote 1 and symptom dynamics that occur within individuals on the psychosis continuum to improve treatment and early intervention for these individuals (Mittal and Addington, Reference Mittal and Addington2021; Salvi et al., Reference Salvi, Rauch and Baker2021).

To parse the heterogeneity of individuals with attenuated psychotic symptoms, several studies have identified subgroups of individuals based on a cross-sectional assessment of symptoms (Allswede et al., Reference Allswede, Addington, Bearden, Cadenhead, Cornblatt, Mathalon and Cannon2020; Hartmann et al., Reference Hartmann, Schmidt, McGorry, Berger, Berger, Chen and Nelson2020; Laloyaux, Larøi, Nuyens, and Billieux, Reference Laloyaux, Larøi, Nuyens and Billieux2018; Valmaggia et al., Reference Valmaggia, Stahl, Yung, Nelson, Fusar-Poli, McGorry and McGuire2013). However, limited work has explicitly identified clinical states or substates (considering the presence of attenuated positive symptoms as a state itself) within these individuals. Symptomatic states can be considered as clusters of symptoms that occur within individuals at a similar time (Hamaker, Grasman, and Kamphuis, Reference Hamaker, Grasman, Kamphuis, Molenaar and Newell2010), for example, the clustering of disinhibition, increased energy, and impulsivity characterising a manic state in bipolar disorder (American Psychiatric Association, 2013).

To investigate the intra-individual temporal association between attenuated psychotic symptoms, autoregressive, linear mixed-effect, and network modelling have been applied to “intensive” longitudinal data from diary studies (van der Steen et al., Reference van der Steen, Gimpel-Drees, Lataster, Viechtbauer, Simons, Lardinois and Myin-Germeys2017; van der Tuin et al., Reference van der Tuin, Balafas, Oldehinkel, Wit, Booij and Wigman2022). However, these modelling approaches capture pairwise associations, rather than symptomatic states within an individual. Additionally, parameter estimation for these approaches often involves some level of aggregation across time points, losing information regarding intra-individual dynamics over time (Bringmann, Ferrer, Hamaker, Borsboom, and Tuerlinckx, Reference Bringmann, Ferrer, Hamaker, Borsboom and Tuerlinckx2018; Hamaker et al., Reference Hamaker, Grasman, Kamphuis, Molenaar and Newell2010; Scheffer et al., Reference Scheffer, Bockting, Borsboom, Cools, Delecroix, Hartmann and Nelson2024).

Hidden Markov models (HMMs) address these limitations but have not yet been applied to attenuated psychotic symptoms. The HMM is a latent longitudinal mixture modelling approach, which uncovers empirically derived symptom substates from longitudinal data and determines the probabilities of switching between substates over time (Hamaker et al., Reference Hamaker, Grasman, Kamphuis, Molenaar and Newell2010). A previous study applied an HMM to diary data and uncovered empirically derived neutral, elevated, mixed, and lowered states in patients with bipolar disorder (Mildiner Moraga et al., Reference Mildiner Moraga, Bos, Doornbos, Bruggeman, van der Krieke, Snippe and Aarts2024). By pairing the HMM with a multilevel framework, we can infer symptom patterns shared among individuals, and evaluate individual-specific symptom dynamics (Hale and Aarts, Reference Hale and Aarts2023). This may offer new insights into the heterogeneity of symptom dynamics that occur within individuals on the psychosis continuum.

As is the case with many elements of psychopathology, true discrete symptomatic states may not exist (Haslam, Holland, and Kuppens, Reference Haslam, Holland and Kuppens2012). Nonetheless, assuming some general patterns exist, discretising the problem can facilitate interpretation and aid clinical decision-making (Eaton et al., Reference Eaton, Bringmann, Elmer, Fried, Forbes, Greene and Waszczuk2023; McGorry and Hickie, Reference McGorry and Hickie2019). The current study applied a multilevel HMM to daily diary data to identify and characterise symptomatic substates in individuals on the psychosis continuum. Furthermore, the time spent within and the pattern of how individuals transition between substates was examined, including an exploration of whether this varies by point of severity along the psychosis continuum. We hypothesised that individuals further along the psychosis continuum would have a tendency to spend time in substates with multiple and more severe co-occurring symptoms.

Materials and methods

Sample

The present study utilises data collected at baseline from the Mirorr study, a Dutch daily diary study conducted with 96 participants aged 18–35 years, who exhibited varying levels of attenuated psychotic symptoms. Participants completed a 90-day daily diary study at baseline and at a 1-year follow-up. Participants are also scheduled to receive yearly follow-up questionnaires regarding functioning and clinical stage for 3 years. A detailed description of the study is provided in the protocol paper (Booij et al., Reference Booij, Wichers, de Jonge, Sytema, van Os, Wunderink and Wigman2018). Individuals were split into four subgroups, increasing in clinical severity:

  1. 1) Non-Clinical (n = 25): Individuals recruited from the general population and not receiving mental health care at baseline. From the 100 individuals recruited, the 25% with the highest scores on the positive symptoms subscale of the Community Assessment of Psychic Experiences (CAPE) were selected (Konings, Bak, Hanssen, van Os, and Krabbendam, Reference Konings, Bak, Hanssen, van Os and Krabbendam2006; Versmissen et al., Reference Versmissen, Janssen, Myin-Germeys, Mengelers, Campo, van Os and Krabbendam2008).

Subgroups 2–4 were all receiving mental health care at baseline.

  1. 2) Mild-PLE (psychotic-like experience) (n = 27): Individuals who had a total score of less than six on the Prodromal Questionnaire-16 (PQ-16), a screening tool for identifying individuals at clinical high risk for psychosis (Ising et al., Reference Ising, Veling, Loewy, Rietveld, Rietdijk, Dragt and van der Gaag2012).

  2. 3) Mod-PLE (n = 24): Individuals who scored six or above on the PQ-16 but did not meet UHR criteria as defined by the Comprehensive Assessment of At Risk Mental States (CAARMS; Alison R. Yung et al., Reference Yung, Yuen, McGorry, Phillips, Kelly, Dell’Olio and Buckby2005). A cut-off of six on the PQ-16 has previously been found to achieve the best balance between sensitivity and specificity in classifying UHR cases (Ising et al., Reference Ising, Veling, Loewy, Rietveld, Rietdijk, Dragt and van der Gaag2012).

  3. 4) UHR (n = 20): Individuals who met UHR criteria as defined by the CAARMS, excluding trait-only criteria.

In addition, the following measures were used to measure psychopathology and functioning across the entire sample:

Subclinical psychotic experiences were measured with the Community Assessment of Psychic Experiences (CAPE; Konings et al., Reference Konings, Bak, Hanssen, van Os and Krabbendam2006), a self-report questionnaire consisting of 42 items. A 4-point Likert scale is used to score both the frequency and distress of psychotic experiences. The CAPE has good reliability and validity (Konings et al., Reference Konings, Bak, Hanssen, van Os and Krabbendam2006) and was found to have good internal consistency in the present sample (Cronbach’s α = .89) (van der Tuin et al., Reference van der Tuin, Balafas, Oldehinkel, Wit, Booij and Wigman2022).

General psychopathology was measured using the Dutch Symptom Checklist Revised (SCL-90-R), a 90-item self-report questionnaire measuring psychological symptoms in the past week. The Dutch SCL-90 has high reliability (ω = .98) (Smits, Timmerman, Barelds, and Meijer, Reference Smits, Timmerman, Barelds and Meijer2015) and was found to have excellent internal consistency in the present sample (Cronbach’s α = .98) (van der Tuin et al., Reference van der Tuin, Balafas, Oldehinkel, Wit, Booij and Wigman2022).

Social functioning was measured with the Groningse Vragenlijst voor Sociaal Gedrag (GVSG) (De Jong and Lubbe, Reference De Jong and Lubbe2001), a Dutch self-report questionnaire. The GVSG includes nine social domains: five domains assessing interpersonal relationships and four domains assessing social and role functioning. Each domain includes five questions, scored on a 4-point scale, and only domains relevant to the individual are included in the total score calculation.

The study was approved by the medical ethical committee of the University Medical Centre Groningen, Groningen, The Netherlands (registration number MEC no. 2015/159, ABR no. NL52974.042.15). All participants provided written informed consent.

Daily diary data

Participants completed an 81-item questionnaire (Supplementary Table S1) on their smartphone each evening for 90 days. Six items were included in the HMM, selected after study completion to capture attenuated psychotic (four items) and affective symptoms (two items). Translated from Dutch to English, these included “I felt suspicious today” (suspiciousness), “I felt that others could read my thoughts today” (broadcasting), “Today I had the feeling that others did not like me” (disliked), “I felt that others could control me today” (external control), “How stressed were you today?” (anxiety) and “I felt down today” (mood). All six items were rated on a scale of 0–100, depending on the degree to which the participant agreed with the item statement (not at all - very much).

A further two diary items, rated on a scale of 0–7, recorded perceptual disturbances: “Today I heard voices that others couldn’t hear” (auditory hallucinations) and “Today I saw things that others couldn’t see” (visual hallucinations). The low endorsement of these two hallucination-related items in this population—reflecting earlier stages on the psychosis continuum—resulted in insufficient variability in the data to reliably estimate corresponding HMM parameters. As such, these two items were not included in fitting the HMM but were included in post-hoc analyses.

While a further six Mirorr items (30, 37–40, and 46; Supplementary Table S1) were potentially related to psychotic experiences (delusions or disorganised thoughts), these items were excluded due to possible alternative interpretations (e.g. “Today I felt special”). Exploratory data analysis further supported this decision, as these items were often endorsed in the absence of any other psychotic experiences. The final six items related to psychotic experiences included in the present analyses (four within the HMM and two within post-hoc analyses) are comparable to those commonly used to measure psychotic experiences in previous studies (Myin-Germeys, Marcelis, Krabbendam, Delespaul, and van Os, Reference Myin-Germeys, Marcelis, Krabbendam, Delespaul and van Os2005; Oorschot, Kwapil, Delespaul, and Myin-Germeys, Reference Oorschot, Kwapil, Delespaul and Myin-Germeys2009; Raposo De Almeida et al., Reference Raposo De Almeida, Van Der Tuin, Muller, Van Den Berg, Wang, Veling and Wigman2024). Only two items related to affect were included in addition to these six items related to psychotic experiences, aligned with the primary study objective to determine empirically derived symptomatic substates in individuals along the psychosis continuum. These included one item related to mood and one related to anxiety/stress, symptoms that commonly co-occur with psychotic experiences (Hartley, Barrowclough, and Haddock, Reference Hartley, Barrowclough and Haddock2013). By carefully selecting a small pool of theoretically motivated and pragmatically guided items, the current study prioritised substate interpretability and minimised the risk of overfitting. The remaining 67 items excluded from the present analyses measured experiences nonspecific to psychosis (e.g. affect, sleep or social events).

Statistical analysis

A Bayesian multilevel HMM (Altman, Reference Altman2007; Kirchherr et al., Reference Kirchherr, Mildiner Moraga, Coudé, Bimbi, Ferrari, Aarts and Bonaiuto2023; Zhang and Berhane, Reference Zhang and Berhane2014) was fitted to the diary data using the statistical software R (Core Team, 2021) version 4.2.3 and the mHMMbayes (Aarts, Reference Aartsn.d.) package version 1.0.0.

Multilevel HMM

A description of HMMs and related modelling assumptions are provided in the Supplementary Material (Supplementary Methods; Supplementary Figure S1). Two sets of parameters describe the HMM: (1) The emission distribution parameters define a multivariate Gaussian density function indicating the probability of observing certain diary item scores given the current substate, (2) The transition probabilities for switching from one substate to another at the subsequent time point.

The multilevel HMM is a hierarchical model which includes random effects for the emission distribution parameters and transition probabilities to capture differences in participants’ symptom dynamics. Subsequently, the meaning of each substate can be preserved (the ordinality of values across the substates is consistent across individuals) while accommodating individual differences. For example, while the item “I felt down” may be rated most highly by individuals when they are in a depressed substate, the mean item score for this substate is likely to vary across individuals. Furthermore, participant-level parameters are regularised, pooling them toward the group-level means and making the model more robust to outliers (Gelman et al., Reference Gelman, Carlin, Stern, Dunson, Vehtari and Rubin2013).

Missing data

There was an average of 6.9 (maximum four consecutive) missing days across participants. Missing data was assumed missing at random (Little and Rubin, Reference Little and Rubin2019).

Parameter estimation

The substate transition probabilities and emission parameters were estimated using a Bayesian procedure, employing a hybrid Metropolis within Gibbs MCMC algorithm (Aarts, Reference Aarts2019; Scott, Reference Scott2002). The depmixS4 (Visser and Speekenbrink, Reference Visser and Speekenbrink2010) package was first used to train a single-level HMM, providing initial parameter values for the Bayesian estimation procedure. Weakly informative hyperpriors were specified for the emission distributions to allow the data to primarily inform the parameter estimates (see Supplementary Methods hyperprior values). The model was fitted using 4000 iterations of the MCMC sampler with the first 1000 iterations treated as a burn-in period. Bayesian multiple imputation is able to handle occasional missing data (missing at random) without introducing bias (de Haan-Rietdijk et al., Reference de Haan-Rietdijk, Kuppens, Bergeman, Sheeber, Allen and Hamaker2017). For missing observations, at each iteration, the forward probability of the corresponding hidden states is computed and a new set of hidden states is sampled from the posterior distribution. Convergence of all sample-level parameters was checked with the multivariate potential scale reduction factor, utilising a threshold of 1.05 (Rhat ≤1.05), and calculated using two additional chains with randomised starting values (Brooks and Gelman, Reference Brooks and Gelman1998).

Model fit

Separate multilevel HMMs were trained for 2–6 states, including and omitting the affective symptom items. The latter was done to ascertain whether the substates remained stable when excluding affective symptoms. This ensures that the substate determination is driven by psychotic symptoms, while allowing for the assessment of how affective symptoms vary across these psychotic substates.

Model selection was based on Akaike information criterion (AIC) (Akaike, Reference Akaike1974), the ability to reproduce the original empirical data through post-hoc model-based simulations (posterior-predictive checks) (Gelman et al., Reference Gelman, Carlin, Stern, Dunson, Vehtari and Rubin2013), and the evaluation of pseudo-residuals. Posterior predictive checks for the group-level emission distributions were performed by generating 500 simulated 90-day time series datasets for 96 hypothetical individuals. Posterior predictive checks for the individual-level emission distribution and transition parameters were performed by generating 500 simulated 90-day time series datasets for 96 hypothetical individuals. The individual-level emission distribution parameters and transition probabilities were provided as input. Residuals for each individual were calculated separately for each diary item by subtracting the individual-level item mean score from the 90-day daily item scores. Residuals were assessed for homoscedasticity and a zero mean to ensure the model fit was unbiased across time. Residuals were also aggregated across diary items and time for each individual, and further assessed for zero mean centring.

Determining individual substate sequences

Using fitted participant-level parameters (posterior means of the individual level parameters; see Parameter Estimation above) and the Viterbi algorithm, the most likely state sequence for each participant over the 90-day assessment period was estimated based on their observed data (Forney, Reference Forney1973; Viterbi, Reference Viterbi1967).

Post-Hoc analysis of perceptual disturbances

Scores for the two perceptual disturbance items were transformed to indicator variables, taking a daily value of zero (score < 4) or one (score ≥ 4).

Difference in substate switching patterns between subgroups

The multilevel HMM employs a multinomial logit framework to model the transition probabilities between substates, allowing for the inclusion of random effects and optional covariates. To examine how transitions between substates vary with psychosis risk, we adapted the model to include subgroup as a participant-level logit regression covariate influencing transition probabilities. This allowed us to investigate how subgroup membership impacted the likelihood of switching between substates while maintaining consistent substate characterisations (emission distributions) as in the model without covariates.

Since the mHMMbayes package does not natively handle categorical variables, we represented subgroup membership using multiple binary (0/1) variables. For interpretability, logits for the subgroup-level transition probabilities were transformed back into probability space for each MCMC iteration. From these iterations, excluding the burn-in period, we calculated the posterior mean and associated 95% credible interval for all subgroup transition probabilities.

Results

The mean (SD) age of individuals in the study was 24.7 (4.2) years and 76% of individuals were female. Psychological distress, psychotic experiences, and impairments in social functioning increased across the subgroups. There was no significant difference in the number of days of missing diary data between subgroups (Table 1).

Table 1. Demographic and clinical characteristics of the sample

*Significant difference: P < .05. Group differences for continuous variables were determined using analysis of variance with Tukey test for pairwise comparisons. Group differences for proportions were determined using chi-square tests with Holm adjustment. SCL-90-R, Dutch Symptom Checklist Revised; CVSG, Groningse Vragenlijst voor Sociaal Gedrag; CAPE, Community Assessment of Psychic Experiences.

Number of substates

Balancing model fit, parsimony, and interpretability, the multilevel HMM consisting of four substates was selected as the most appropriate representation of the data (Pohle, Langrock, van Beest, and Schmidt, Reference Pohle, Langrock, van Beest and Schmidt2017). The AIC favoured the four-substate model over the two- and three-substate models (Supplementary Figure S2) and the four-substate model was able to adequately describe the empirical data at both the group and individual level (Supplementary Figures S3-S7). While increasing the number of groups beyond four resulted in a slightly lower AIC, the reduction was marginal and did not justify the added complexity. The structural differences between the five-state and four-state models were minimal and did not provide meaningful additional insights: four states in the five-state model were nearly identical to those of the four-state model, with the additional fifth state largely overlapping with the most clinically severe state in the four-state model, differing only by a slight leftward shift in the emission distribution. For a detailed description of the emission distribution in the four-substate model, see the Substate Compositions section below; a comparison with the five-state model is provided in Supplementary Figure S8.

Substate compositions

The symptomatic profiles of the four substates are captured by the four group-level emission distributions visualised in Figure 1. These probability distributions describe how likely (vertical axis) individuals are to report specific item scores (horizontal axis) within each substate, with higher scores along the horizontal axis corresponding to more severe symptoms. As such, the group-level emission distributions provide insight into the severity and co-occurrence of symptoms across states. The first substate (Minimal Symptoms) is characterised by negligible (mean < 10) scores across the four psychotic items, and low scores (10 < mean < 25) for the affective items, suggesting mild mood disturbances. The second substate (Affective Low-Suspiciousness) is characterised by low scores for suspiciousness and feelings of being disliked, coupled with moderate scores for affective symptoms (25 ≤ mean < 60). This substate suggests a decoupling of psychotic symptoms, with suspiciousness co-occurring alongside feelings of being disliked but in the absence of similarly severe thoughts of broadcasting or external control. The third substate (Affective Low-Psychosis) is characterised by low scores across all psychotic items, with the highest scores for broadcasting, and moderate affective symptoms. As such, the third substate is similar to the second, differentiated predominantly by the additional presence of thoughts of external control and broadcasting. The fourth substate (Affective Moderate-Psychosis) represents the most clinically severe substate, exhibiting moderate (25 < mean < 75) scores across all items (affective and psychotic). There was heterogeneity in the individual emission distribution means, however, the substate characterisations were consistent with the group-level emission findings (variable-dependent ordinal relation over states was preserved across individuals; Supplementary Figure S9).

Figure 1. Group level emission distributions characterizing the four clinical substates uncovered with the multilevel HMM. A continuous multivariate normal distribution captures the most likely scores for each of the six diary items that are observed in each substate.

Analysis of the emission distributions across all four substates highlights consistent patterns of symptom co-occurrence, with suspiciousness and feelings of being disliked, as well as broadcasting and external control, emerging as commonly co-occurring symptom pairs. Additionally, suspiciousness and feelings of being disliked occurred in isolation within the second substate, without accompanying unusual thought content or passivity phenomena. Conversely, thoughts of broadcasting and external control only tended to occur in the context of suspiciousness and feelings of being disliked, suggesting an asymmetric relationship between these symptom clusters.

Substate trajectories

The diary data and substate sequence for four exemplar individuals, chosen due to their unique substate patterns, are displayed in Figure 2. The substate sequences for the full set of individuals are provided in the Supplementary Material (Supplementary Figures S10 and S11). Individuals displayed a large degree of intra-individual heterogeneity; on average, individuals switched substates 37 times (SD = 14) over the assessment period. There was no significant difference in the state-switching frequency between subgroups (ANOVA, P = .19).

Figure 2. Substate sequences generated for four individuals across subgroups 1–4. Missing diary data is imputed while missing substate sequence data is displayed in white. The exemplar individual spent: (a) most time in the first substate, consistent with negligible psychotic symptoms; (b) most time in the first and third substates, displaying high affective symptoms throughout the assessment period, with occasional symptoms of broadcasting; (c) multiple days in the fourth substate at the start of the assessment period, displaying high psychotic symptoms during this time. In the middle of the assessment period, this same individual spent periods in the second substate, displaying periods of high affective symptoms and suspiciousness, and, towards the end of the assessment period, spent most time in the first substate, exhibiting minimal psychotic symptoms; (d) most time in the fourth substate, displaying moderate scores for all items across the assessment period.

Relationship between individual states and perceptual disturbances

Of the 148 occurrences of perceptual disturbances across individuals, 140 occurred when an individual was in the third or fourth substate (s1: Minimal Symptoms = 7, s2: Affective Low-Suspiciousness = 1, s3: Affective Low-Psychosis = 47, s4: Affective Moderate-Psychosis = 93), indicating broadcasting and concerns regarding external control tend to accompany perceptual disturbances. The state sequences for the individuals who recorded a perceptual disturbance on two or more are displayed in Figure 3. The state sequence is coupled with a time series indicating perceptual disturbance occurrences.

Figure 3. Perceptual disturbances and temporally associated state sequences for eight individuals belonging to subgroups 2–4. Grey and black lines (top panel) depict whether a perceptual disturbance was present or absent for each day across the 90-day assessment period. Missing state sequence data is displayed in white.

Substate switching patterns

The group- and subgroup-level state switching patterns are displayed in Figure 4. Bayesian credible intervals for the transition probabilities for each subgroup are provided in the Supplementary Material (Supplementary Table S2), as well as pairwise differences in stability and switching probabilities, based on nonoverlapping credible intervals (Supplementary Table S3). At the group level, the first Minimal Symptoms substate is the most stable, as indicated by a larger node compared to other substates. This suggests that when an individual is currently within this substate, they are likely to remain there at the next point in time. However, at the subgroup level, the first Minimal Symptoms substate exhibits lower stability (indicated by a smaller first node) for the UHR subgroup than the other three subgroups, particularly when contrasted with the first nonclinical subgroup. This suggests that individuals within the UHR subgroup are more likely to transition out of the first Minimal Symptoms substate at the next time point, resulting in less sustained periods of minimal symptoms.

Figure 4. Network diagram of group-level and subgroup substate switching patterns. Switching probabilities are calculated as the posterior mean of estimates generated by the MCMC sampler, excluding the burn-in period. Nodes represent substates, and edges represent relative switching probabilities. The node area is proportional to the probability of an individual remaining in that substate. Edge thickness is proportional to the size of the relative switching probability (dashed: probabilities <.3, grey: probabilities 2–.4, black: probabilities >.4).

The probability of switching from the third back to the first substate also varies across subgroups. Individuals in the first nonclinical and second mild-PLE subgroups display a higher probability of returning to the first Minimal Symptoms substate when in the third Affective Low-Psychosis substate, as indicated by thick black arrow linking the third with the first substate. This suggests that individuals within the first nonclinical and second mild-PLE subgroups are less likely to exhibit sustained periods of multiple low-to-moderate psychotic symptoms. In contrast, individuals in the third and fourth subgroups (moderate-PLE and UHR) are more likely to progress from the Affective Low-Psychosis substate to the more severe Affective Moderate-Psychosis substate, than to return to the Minimal Symptoms or Affective Low-Suspiciousness substates. UHR individuals exhibit a strong bidirectional relationship between the third (Affective Low-Psychosis) and fourth (Affective Moderate-Psychosis) substates, as indicated by the thick black arrows linking these substates. UHR individuals also exhibit a high probability of switching into these substates from the first (Minimal Symptoms) and second (Affective Low-Suspiciousness) less severe substates. Consequently, UHR individuals may get “trapped” moving back and forth between the two most severe substates, as evidenced by their individual substate sequences (Supplementary Figures S10 and S11) and the time UHR individuals spent in these two substates across the assessment period (Supplementary Figure S12).

Discussion

To our knowledge, this is the first study to identify symptomatic substates in individuals early on the psychosis continuum, providing novel insights into how symptoms interact and evolve over time. It is also, to our knowledge, the first study to characterise and investigate the temporal symptom dynamics of psychotic symptoms (attenuated or frank) by utilising a multilevel HMM approach. Symptomatic substates were inferred from the response patterns of 96 individuals over four daily diary items related to attenuated psychotic symptoms and two related to affective symptoms. This modelling approach provided evidence for four symptomatic substates: increasing in severity: (1: Minimal Symptoms), characterised by low-grade affective and negligible psychotic symptoms; (2: Affective Low-Suspiciousness), marked by low levels of suspiciousness and feelings of being disliked, with moderate affective symptoms; (3: Affective Low-Psychosis), involving low levels of suspiciousness, feelings of being disliked, and thoughts of broadcasting and external control, with moderate affective symptoms; and (4: Affective Moderate-Psychosis), characterised by moderate levels of suspiciousness, feelings of being disliked, thoughts of broadcasting and external control, and affective symptoms. Individuals switched frequently between substates, highlighting the dynamic nature of psychopathology.

Temporal dynamics discerned from the multilevel HMM results were compared across the four attenuated psychotic symptom subgroups to link these dynamic findings to more traditional cross-sectional severity measures and provide a complementary dynamic perspective. Clear trends emerged across the subgroups in terms of their substate dynamics. Consistent with our original hypothesis, with increasing psychosis risk, individuals were more likely to transition into and stay in substates characterised by more severe and multiple psychotic symptoms, with difficulty switching back into or remaining in substates with fewer or negligible psychotic symptoms. While this dynamic finding was hypothesised, it could not be assumed, as the CAARMS definition of UHR does not require the presence of multiple co-occurring symptoms. Instead, the CAARMS treats symptoms as disjunctive entities, meaning that individuals can be classified as at UHR for psychosis if they meet severity and frequency criteria for any single symptom. In contrast, the present findings indicate that individuals at UHR of psychosis frequently occupy substates characterised by multiple co-occurring symptoms (e.g. suspiciousness, paranoia/feelings of being disliked, thoughts of broadcasting and external control), highlighting the potential importance of considering symptom co-occurrence in understanding psychosis risk dynamics.

The persistence of psychotic symptoms in populations at greater risk, especially passivity experiences, may reflect an increase in psychological inflexibility (Morris and Mansell, Reference Morris and Mansell2018). It is also consistent with lived experience accounts that detail a reduction in the individual’s ability to shift away from these experiences as psychosis progresses (Fusar-Poli et al., Reference Fusar-Poli, Estradé, Stanghellini, Venables, Onwumere, Messas and Maj2022). Clinically, this suggests that there may be a greater tendency to return (“relapse”) into these more severe symptomatic substates in response to situational/contextual stressors, so strategies to develop resilience, stress management, and ease to re-entry into clinical services may be warranted. Diary studies could serve as a valuable monitoring or psychoeducation tool, helping individuals track changes in and understand their dynamic response to stressors.

Despite differences in the clinical population, analytical approach, and the symptom severity recorded (attenuated rather than frank psychotic symptoms), the findings of this study echo and extend previous cross-sectional work investigating the co-occurrence of symptoms in first-episode psychosis (Lemonde et al., Reference Lemonde, Joober, Malla, Iyer, Lepage, Boksa and Shah2021). Along with suspiciousness feelings of being disliked – which, at the group level, potentially represent a level of paranoia as indicated by this item’s close tracking with suspiciousness – was the most common psychotic symptom observed in the present study, occurring at low and moderate levels in three of the four substates. Broadcasting and delusions of external control, but not suspiciousness or feelings of being disliked/paranoia, were positively correlated with perceptual disturbances. Further, similar levels of stress characterised the second and third substates, despite the presence of broadcasting only in the latter substate, supporting the finding of Lemonde (Reference Lemonde, Joober, Malla, Iyer, Lepage, Boksa and Shah2021) that broadcasting and anxiety are not specifically correlated.

The current study identified suspiciousness and feelings of being disliked/paranoia, and broadcasting and external control, as commonly co-occurring symptom pairs. This co-occurrence aligns with the clinical grouping of these phenomena into paranoid delusions and passivity phenomena, and the categorisation of these into nonbizarre ideas/suspiciousness and unusual thought content within the CAARMS and PSYCHS. However, in contrast to these measures, which apply equal weighting to nonbizarre ideas and unusual thought content when defining UHR and transition criteria, the present study identified an asymmetric association between these symptom classes. Broadcasting and delusions of external control only tended to occur in the context of symptoms of suspiciousness and paranoia/feelings of being disliked (within the third, Affective Low-Psychosis, and fourth, Affective Moderate-Psychosis, substates). In contrast, suspiciousness and paranoia/feelings of being disliked also commonly occurred in isolation (within the second Affective Low-Suspiciousness substate). This asymmetric association is consistent with previous work (Paquin et al., Reference Paquin, Malla, Iyer, Lepage, Joober and Shah2023) and suggests that individuals who report unusual thought content may exhibit more severe psychopathological dynamics (in terms of the number and severity of co-occurring symptoms). The present finding that unusual thought is correlated with more severe psychopathological dynamics also supports previous work which identified baseline levels of unusual thought content to be a stronger predictor of psychosis onset in UHR individuals than suspiciousness or paranoia (Mason et al., Reference Mason, Startup, Halpin, Schall, Conrad and Carr2004; Thompson, Nelson, and Yung, Reference Thompson, Nelson and Yung2011). While further work is required to confirm the present findings, taken together with previous work, these findings have important implications for staging. Specifically, in line with the contention put forward by Mason et al. (Reference Mason, Startup, Halpin, Schall, Conrad and Carr2004) that at-risk criteria are too disjunctive, these findings suggest that assessment tools could be further refined to consider the number and type of co-occurring symptoms and to consider symptom-specific severity thresholds.

The asymmetric association between psychotic symptoms observed in this study has important implications for the refinement and development of future risk calculators. The asymmetric association indicates a possibly complex and nonlinear correlation structure between attenuated psychotic symptoms, suggesting care should be taken regarding feature selection for risk calculators. Such nonlinear correlations can be missed with traditional methods for detecting and addressing multicollinearity (Armstrong, Reference Armstrong2019; Bollinger, Belsley, Kuh, and Welsch, Reference Bollinger, Belsley, Kuh and Welsch1981). Furthermore, this finding supports the use of nonlinear features or models, such as decision trees, even in the setting of few predictor variables (Pudjihartono, Fadason, Kempa-Liehr, and O’Sullivan, Reference Pudjihartono, Fadason, Kempa-Liehr and O’Sullivan2022).

The present study should be viewed in the context of several limitations. The study utilised daily diary entries, which offer several advantages, including the ability to capture real-time data and reduce recall bias, but may introduce biases related to the self-report nature, including mood-state dependence and social desirability effects (Schneider and Stone, Reference Schneider and Stone2016; Van De Mortel, Reference Van De Mortel2008). The psychotic symptoms used to characterise substates were limited to the diary items recorded as part of the Mirorr study. The inclusion of a wider range of psychotic symptoms would provide a more complete characterisation of the symptomatic substates. Perceptual disturbances were only included in post-hoc analyses due to the low endorsement of these items; however, future work should explore their inclusion when applying this methodology to groups further along the psychosis spectrum, where these disturbances may be more prominent. Additionally, future research should explore the inclusion of environmental, social, and treatment factors – either within the HMM or post-hoc analyses – to provide further insight into the factors influencing symptom dynamics. Transition probabilities were assumed constant across the assessment period, however, in practice, they may have varied over time. During the assessment period, the UHR subgroup was allocated to more intensive and specific treatment and the nonclinical subgroup did not undergo treatment. These differing trajectories could have influenced transition patterns. However, this limitation is also not unique to the HMM approach, as many ambulatory assessment methods, such as nontime-varying autoregressive models, similarly assume stable parameters across the assessment period. Finally, we assumed that the transition probabilities were dependent only on the current state and, consistent with the frequency of data collection, that individuals stay in the same state for the entire day. Future extensions to the multilevel HMMs framework may allow for these assumptions to be relaxed.

The present study utilised 90-day baseline daily diary data from the Mirorr study. While the present study provided novel insights into symptom dynamics within individuals early on the psychosis continuum, further work is needed to validate these findings and offer greater insight into their clinical implications and relationship with long-term outcomes. Future analyses will incorporate the 1-year follow-up daily diary data to examine the intraindividual stability of the present findings and determine how changes in symptom dynamics correspond to changes in psychosis risk. Additionally, the relationship between baseline symptom dynamics and transition to full-threshold psychosis over the subsequent four years will be examined.

Conclusion

The present study identified four symptomatic substates of increasing psychopathological severity in individuals with attenuated psychotic symptoms. Passivity symptoms associated with disorders of self tended to occur only in the context of symptoms of suspiciousness or paranoia and were associated with more severe psychopathological dynamics. Perceptual disturbances were more likely to occur in conjunction with symptoms of unusual thought content. Individuals further along the psychosis continuum exhibited a reduced ability to transition back into less severe symptomatic substates, suggesting a level of psychological inflexibility. These results offer new insights into the dynamics of symptoms in individuals lower on the psychosis continuum that could inform treatment and allow us to refine staging models for greater clinical utility.

Supplementary material

The supplementary material for this article can be found at http://doi.org/10.1017/S003329172500056X.

Funding statement

This work was supported by an Australian NHMRC Centres of Research Excellence grant (GA126980). In addition, the data used in this study was collected with funding from the Netherlands Organization for Scientific Research (NWO) (Veni JTWW: no. 016.156.019).

Competing interests

The authors declare none.

Footnotes

J.T.W.W. and B.N. shared last contributors for this manuscript.

1 In this article, we use the term “attenuated psychotic symptoms” broadly to encompass both the attenuated psychotic symptoms present in ultra-high risk individuals and the psychotic-like experiences that are reported in other clinical and nonclinical groups.

References

Aarts, E. (2019). Estimation of the multilevel hidden markov model. Retrieved from https://cran.ncc.metu.edu.tr/web/packages/mHMMbayes/vignettes/estimation-mhmm.pdfGoogle Scholar
Aarts, E. (n.d.). Multilevel hidden markov models using bayesian estimation [R package mHMMbayes version 1.0.0]. Retrieved February 1, 2024, from https://cran.r-project.org/web/packages/mHMMbayes/index.htmlGoogle Scholar
Addington, J., Cornblatt, B. A., Cadenhead, K. S., Cannon, T. D., McGlashan, T. H., Perkins, D. O., … Heinssen, R. (2011). At clinical high risk for psychosis: outcome for nonconverters. The American Journal of Psychiatry, 168(8), 800805. https://doi.org/10.1176/appi.ajp.2011.10081191CrossRefGoogle ScholarPubMed
Akaike, H. (1974). A new look at the statistical model identification. IEEE Transactions on Automatic Control, 19(6), 716723. https://doi.org/10.1109/TAC.1974.1100705CrossRefGoogle Scholar
Allswede, D. M., Addington, J., Bearden, C. E., Cadenhead, K. S., Cornblatt, B. A., Mathalon, D. H., … Cannon, T. D. (2020). Characterizing Covariant Trajectories of Individuals at Clinical High Risk for Psychosis Across Symptomatic and Functional Domains. The American Journal of Psychiatry, 177(2), 164171. https://doi.org/10.1176/appi.ajp.2019.18111290CrossRefGoogle ScholarPubMed
Altman, R. M. (2007). Mixed hidden Markov models. Journal of the American Statistical Association, 102(477), 201210. https://doi.org/10.1198/016214506000001086CrossRefGoogle Scholar
American Psychiatric Association. (2013). Diagnostic and statistical manual of mental disorders: DSM-5 (Vol. 5). Washington, DC: American psychiatric association. Retrieved from https://www.academia.edu/download/38718268/csl6820_21.pdfGoogle Scholar
Armstrong, R. A. (2019). Should Pearson’s correlation coefficient be avoided? Ophthalmic & Physiological Optics: The Journal of the British College of Ophthalmic Opticians, 39(5), 316327. https://doi.org/10.1111/opo.12636CrossRefGoogle ScholarPubMed
Bollinger, G., Belsley, D. A., Kuh, E., & Welsch, R. E. (1981). Regression diagnostics: Identifying influential data and sources of collinearity. JMR, Journal of Marketing Research, 18(3), 392. https://doi.org/10.2307/3150985Google Scholar
Booij, S. H., Wichers, M., de Jonge, P., Sytema, S., van Os, J., Wunderink, L., & Wigman, J. T. W. (2018). Study protocol for a prospective cohort study examining the predictive potential of dynamic symptom networks for the onset and progression of psychosis: the Mapping Individual Routes of Risk and Resilience (Mirorr) study. BMJ Open, 8(1), e019059. https://doi.org/10.1136/bmjopen-2017-019059CrossRefGoogle ScholarPubMed
Bringmann, L. F., Ferrer, E., Hamaker, E. L., Borsboom, D., & Tuerlinckx, F. (2018). Modeling Nonstationary Emotion Dynamics in Dyads using a Time-Varying Vector-Autoregressive Model. Multivariate Behavioral Research, 53(3), 293314. https://doi.org/10.1080/00273171.2018.1439722CrossRefGoogle ScholarPubMed
Brooks, S. P., & Gelman, A. (1998). General Methods for Monitoring Convergence of Iterative Simulations. Journal of Computational and Graphical Statistics: A Joint Publication of American Statistical Association, Institute of Mathematical Statistics, Interface Foundation of North America, 7(4), 434455. https://doi.org/10.1080/10618600.1998.10474787CrossRefGoogle Scholar
Core Team, R. (2021). R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria.Google Scholar
de Haan-Rietdijk, S., Kuppens, P., Bergeman, C. S., Sheeber, L. B., Allen, N. B., & Hamaker, E. L. (2017). On the Use of Mixed Markov Models for Intensive Longitudinal Data. Multivariate Behavioral Research, 52(6), 747767. https://doi.org/10.1080/00273171.2017.1370364CrossRefGoogle ScholarPubMed
De Jong, A., & Lubbe, P. M. (2001). Groningse vragenlijst over sociaal gedrag: Zelfbeoordelingsvragenlijsten voor het vaststellen van problemen in het interpersoonlijke functioneren: Handleiding. Rob Giel Onderzoekcentrum.Google Scholar
de Pablo, G. S., Raduà, J., Pereira, J., Bonoldi, I., Arienti, V., Besana, F., … Fusar-Poli, P. (2021). Probability of transition to psychosis in individuals at clinical high risk: An updated meta-analysis. JAMA Psychiatry. https://doi.org/10.1001/jamapsychiatry.2021.0830Google Scholar
Eaton, N. R., Bringmann, L. F., Elmer, T., Fried, E. I., Forbes, M. K., Greene, A. L., … Waszczuk, M. A. (2023). A review of approaches and models in psychopathology conceptualization research. Nature Reviews Psychology, 115. https://doi.org/10.1038/s44159-023-00218-4Google Scholar
Forney, G. D. (1973). The viterbi algorithm. Proceedings of the IEEE, 61(3), 268278. https://doi.org/10.1109/PROC.1973.9030CrossRefGoogle Scholar
Fusar-Poli, P., Borgwardt, S., Bechdolf, A., Addington, J., Riecher-Rössler, A., Schultze-Lutter, F., … Yung, A. (2013). The psychosis high-risk state: a comprehensive state-of-the-art review. JAMA Psychiatry, 70(1), 107120. https://doi.org/10.1001/jamapsychiatry.2013.269CrossRefGoogle Scholar
Fusar-Poli, P., Estradé, A., Stanghellini, G., Venables, J., Onwumere, J., Messas, G., … Maj, M. (2022). The lived experience of psychosis: a bottom-up review co-written by experts by experience and academics. World Psychiatry: Official Journal of the World Psychiatric Association, 21(2), 168188. https://doi.org/10.1002/wps.20959CrossRefGoogle ScholarPubMed
Fusar-Poli, P., Salazar de Pablo, G., Correll, C. U., Meyer-Lindenberg, A., Millan, M. J., Borgwardt, S., … Arango, C. (2020). Prevention of Psychosis: Advances in Detection, Prognosis, and Intervention. JAMA Psychiatry, 77(7), 755765. https://doi.org/10.1001/jamapsychiatry.2019.4779CrossRefGoogle ScholarPubMed
Gelman, A., Carlin, J. B., Stern, H. S., Dunson, D. B., Vehtari, A., & Rubin, D. B. (2013). Bayesian Data Analysis, Third Edition. CRC Press. Retrieved from https://play.google.com/store/books/details?id=ZXL6AQAAQBAJCrossRefGoogle Scholar
Hale, W. W., & Aarts, E. (2023). Hidden Markov model detection of interpersonal interaction dynamics in predicting patient depression improvement in psychotherapy: Proof-of-concept study. Journal of Affective Disorders Reports, 14, 100635. https://doi.org/10.1016/j.jadr.2023.100635CrossRefGoogle Scholar
Hamaker, E. L., Grasman, R. P., & Kamphuis, J. H. (2010). Regime-switching models to study psychological process. In Molenaar, P. C. M. and Newell, K. M. (Eds.), Individual Pathways of Change: Statistical Models for Analyzing Learning and Development (pp. 155168). American Psychological Association. Retrieved from https://www.researchgate.net/profile/Ellen-Hamaker/publication/44161972_Regime-switching_models_to_study_psychological_process/links/00b7d53579c764f363000000/Regime-switching-models-to-study-psychological-process.pdfCrossRefGoogle Scholar
Hartley, S., Barrowclough, C., & Haddock, G. (2013). Anxiety and depression in psychosis: a systematic review of associations with positive psychotic symptoms. Acta Psychiatrica Scandinavica, 128(5), 327346. https://doi.org/10.1111/acps.12080CrossRefGoogle ScholarPubMed
Hartmann, J. A., Schmidt, S. J., McGorry, P. D., Berger, M., Berger, G. E., Chen, E. Y. H., … Nelson, B. (2020). Trajectories of symptom severity and functioning over a three-year period in a psychosis high-risk sample: A secondary analysis of the Neurapro trial. Behaviour Research and Therapy, 124, 103527. https://doi.org/10.1016/j.brat.2019.103527CrossRefGoogle Scholar
Haslam, N., Holland, E., & Kuppens, P. (2012). Categories versus dimensions in personality and psychopathology: a quantitative review of taxometric research. Psychological Medicine, 42(5), 903920. https://doi.org/10.1017/S0033291711001966CrossRefGoogle ScholarPubMed
Ising, H. K., Veling, W., Loewy, R. L., Rietveld, M. W., Rietdijk, J., Dragt, S., … van der Gaag, M. (2012). The validity of the 16-item version of the Prodromal Questionnaire (PQ-16) to screen for ultra high risk of developing psychosis in the general help-seeking population. Schizophrenia Bulletin, 38(6), 12881296. https://doi.org/10.1093/schbul/sbs068CrossRefGoogle ScholarPubMed
Kelleher, I., Devlin, N., Wigman, J. T. W., Kehoe, A., Murtagh, A., Fitzpatrick, C., & Cannon, M. (2014). Psychotic experiences in a mental health clinic sample: implications for suicidality, multimorbidity and functioning. Psychological Medicine, 44(8), 16151624. https://doi.org/10.1017/S0033291713002122CrossRefGoogle Scholar
Kelleher, I., Wigman, J. T. W., Harley, M., O’Hanlon, E., Coughlan, H., Rawdon, C., … Cannon, M. (2015). Psychotic experiences in the population: Association with functioning and mental distress. Schizophrenia Research, 165(1), 914. https://doi.org/10.1016/j.schres.2015.03.020CrossRefGoogle ScholarPubMed
Kirchherr, S., Mildiner Moraga, S., Coudé, G., Bimbi, M., Ferrari, P. F., Aarts, E., & Bonaiuto, J. J. (2023). Bayesian multilevel hidden Markov models identify stable state dynamics in longitudinal recordings from macaque primary motor cortex. The European Journal of Neuroscience, 58(3), 27872806. https://doi.org/10.1111/ejn.16065CrossRefGoogle ScholarPubMed
Konings, M., Bak, M., Hanssen, M., van Os, J., & Krabbendam, L. (2006). Validity and reliability of the CAPE: a self-report instrument for the measurement of psychotic experiences in the general population. Acta Psychiatrica Scandinavica, 114(1), 5561. https://doi.org/10.1111/j.1600-0447.2005.00741.xCrossRefGoogle Scholar
Laloyaux, J., Larøi, F., Nuyens, F., & Billieux, J. (2018). Subtyping attenuated psychotic symptoms: A cluster analytic approach. Journal of Clinical Psychology, 74(12), 21172133. https://doi.org/10.1002/jclp.22658CrossRefGoogle ScholarPubMed
Lemonde, A.-C., Joober, R., Malla, A., Iyer, S. N., Lepage, M., Boksa, P., & Shah, J. L. (2021). Delusional content at initial presentation to a catchment-based early intervention service for psychosis. The British Journal of Psychiatry: The Journal of Mental Science, 218(4), 217223. https://doi.org/10.1192/bjp.2020.157CrossRefGoogle ScholarPubMed
Lencz, T., Smith, C. W., Auther, A., Correll, C. U., & Cornblatt, B. (2004). Nonspecific and attenuated negative symptoms in patients at clinical high-risk for schizophrenia. Schizophrenia Research, 68(1), 3748. https://doi.org/10.1016/S0920-9964(03)00214-7CrossRefGoogle ScholarPubMed
Little, R. J. A., & Rubin, D. B. (2019). Statistical Analysis with Missing Data. John Wiley & Sons. Retrieved from https://play.google.com/store/books/details?id=BemMDwAAQBAJGoogle Scholar
Mason, O., Startup, M., Halpin, S., Schall, U., Conrad, A., & Carr, V. (2004). Risk factors for transition to first episode psychosis among individuals with ‘at-risk mental states’. Schizophrenia Research, 71(2), 227237. https://doi.org/10.1016/j.schres.2004.04.006CrossRefGoogle ScholarPubMed
McGlashan, T., Walsh, B., & Woods, S. (2010). The Psychosis-Risk Syndrome: Handbook for Diagnosis and Follow-Up. Oxford University Press, USA. Retrieved from https://play.google.com/store/books/details?id=fDlnDAAAQBAJGoogle Scholar
McGorry, P. D., & Hickie, I. B. (2019). Clinical Staging in Psychiatry: Making Diagnosis Work for Research and Treatment. Cambridge University Press. Retrieved from https://play.google.com/store/books/details?id=GqCkDwAAQBAJCrossRefGoogle Scholar
Mei, C., van der Gaag, M., Nelson, B., Smit, F., Yuen, H. P., Berger, M., … McGorry, P. D. (2021). Preventive interventions for individuals at ultra high risk for psychosis: An updated and extended meta-analysis. Clinical Psychology Review, 86, 102005. https://doi.org/10.1016/j.cpr.2021.102005CrossRefGoogle ScholarPubMed
Mildiner Moraga, S., Bos, F. M., Doornbos, B., Bruggeman, R., van der Krieke, L., Snippe, E., & Aarts, E. (2024). Evidence for mood instability in patients with bipolar disorder: Applying multilevel hidden Markov modeling to intensive longitudinal ecological momentary assessment data. Journal of Psychopathology and Clinical Science, Advance online publication. https://doi.org/10.1037/abn0000915CrossRefGoogle ScholarPubMed
Mittal, V. A., & Addington, J. M. (2021). Embracing heterogeneity creates new opportunities for understanding and treating those at clinical-high risk for psychosis. Schizophrenia Research, 227, 13. https://doi.org/10.1016/j.schres.2020.11.015CrossRefGoogle ScholarPubMed
Morris, L., & Mansell, W. (2018). A systematic review of the relationship between rigidity/flexibility and transdiagnostic cognitive and behavioral processes that maintain psychopathology. Journal of Experimental Psychopathology, 9(3), 2043808718779431. https://doi.org/10.1177/2043808718779431CrossRefGoogle Scholar
Myin-Germeys, I., Marcelis, M., Krabbendam, L., Delespaul, P., & van Os, J. (2005). Subtle fluctuations in psychotic phenomena as functional states of abnormal dopamine reactivity in individuals at risk. Biological Psychiatry, 58(2), 105110. https://doi.org/10.1016/j.biopsych.2005.02.012CrossRefGoogle ScholarPubMed
Oorschot, M., Kwapil, T., Delespaul, P., & Myin-Germeys, I. (2009). Momentary assessment research in psychosis. Psychological Assessment, 21(4), 498505. https://doi.org/10.1037/a0017077CrossRefGoogle ScholarPubMed
Paquin, V., Malla, A. K., Iyer, S. N., Lepage, M., Joober, R., & Shah, J. L. (2023). Combinations and temporal associations among precursor symptoms before a first episode of psychosis. Schizophrenia Bulletin. https://doi.org/10.1093/schbul/sbad152Google Scholar
Pohle, J., Langrock, R., van Beest, F. M., & Schmidt, N. M. (2017). Selecting the number of states in hidden Markov models: Pragmatic solutions illustrated using animal movement. Journal of Agricultural, Biological, and Environmental Statistics, 22(3), 270293. https://doi.org/10.1007/s13253-017-0283-8CrossRefGoogle Scholar
Pudjihartono, N., Fadason, T., Kempa-Liehr, A. W., & O’Sullivan, J. M. (2022). A Review of Feature Selection Methods for Machine Learning-Based Disease Risk Prediction. Frontiers in Bioinformatics, 2, 927312. https://doi.org/10.3389/fbinf.2022.927312CrossRefGoogle ScholarPubMed
Raposo De Almeida, E., Van Der Tuin, S., Muller, M. K., Van Den Berg, D., Wang, Y. P., Veling, W., & Wigman, . (2024). The associations between daily reports of loneliness and psychotic experiences in the early risk stages for psychosis. Early Intervention in Psychiatry.CrossRefGoogle ScholarPubMed
Salvi, J. D., Rauch, S. L., & Baker, J. T. (2021). Behavior as Physiology: How Dynamical-Systems Theory Could Advance Psychiatry. The American Journal of Psychiatry, 178(9), 791792. https://doi.org/10.1176/appi.ajp.2020.20081151CrossRefGoogle ScholarPubMed
Scheffer, M., Bockting, C. L., Borsboom, D., Cools, R., Delecroix, C., Hartmann, J. A., … Nelson, B. (2024). A Dynamical Systems View of Psychiatric Disorders—Practical Implications: A Review. JAMA Psychiatry. https://doi.org/10.1001/jamapsychiatry.2024.0228Google ScholarPubMed
Schneider, S., & Stone, A. A. (2016). Ambulatory and diary methods can facilitate the measurement of patient-reported outcomes. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 25(3), 497506. https://doi.org/10.1007/s11136-015-1054-zCrossRefGoogle ScholarPubMed
Scott, S. L. (2002). Bayesian Methods for Hidden Markov Models. Journal of the American Statistical Association, 97(457), 337351. https://doi.org/10.1198/016214502753479464CrossRefGoogle Scholar
Shah, J. L., Crawford, A., Mustafa, S. S., Iyer, S. N., Joober, R., & Malla, A. K. (2017). Is the Clinical High-Risk State a Valid Concept? Retrospective Examination in a First-Episode Psychosis Sample. Psychiatric Services, 68(10), 10461052. https://doi.org/10.1176/appi.ps.201600304CrossRefGoogle Scholar
Smits, I. A. M., Timmerman, M. E., Barelds, D. P. H., & Meijer, R. R. (2015). The Dutch Symptom Checklist-90-Revised. European Journal of Psychological Assessment: Official Organ of the European Association of Psychological Assessment, 31(4), 263271. https://doi.org/10.1027/1015-5759/a000233CrossRefGoogle Scholar
Thompson, A., Nelson, B., & Yung, A. (2011). Predictive validity of clinical variables in the “at risk” for psychosis population: International comparison with results from the North American Prodrome Longitudinal Study. Schizophrenia Research, 126(1), 5157. https://doi.org/10.1016/j.schres.2010.09.024CrossRefGoogle ScholarPubMed
Valmaggia, L. R., Stahl, D., Yung, A. R., Nelson, B., Fusar-Poli, P., McGorry, P. D., & McGuire, P. K. (2013). Negative psychotic symptoms and impaired role functioning predict transition outcomes in the at-risk mental state: a latent class cluster analysis study. Psychological Medicine, 43(11), 23112325. https://doi.org/10.1017/S0033291713000251CrossRefGoogle Scholar
Van De Mortel, T. F. (2008). Faking it: social desirability response bias in self-report research. Australian Journal of Advanced Nursing, 25(4), 4048.Google Scholar
van der Steen, Y., Gimpel-Drees, J., Lataster, T., Viechtbauer, W., Simons, C. J. P., Lardinois, M., … Myin-Germeys, I. (2017). Clinical high risk for psychosis: the association between momentary stress, affective and psychotic symptoms. Acta Psychiatrica Scandinavica, 136(1), 6373. https://doi.org/10.1111/acps.12714CrossRefGoogle ScholarPubMed
van der Tuin, S., Balafas, S. E., Oldehinkel, A. J., Wit, E. C., Booij, S. H., & Wigman, J. T. W. (2022). Dynamic symptom networks across different at-risk stages for psychosis: An individual and transdiagnostic perspective. Schizophrenia Research, 239, 95102. https://doi.org/10.1016/j.schres.2021.11.018CrossRefGoogle ScholarPubMed
van Os, J., Linscott, R. J., Myin-Germeys, I., Delespaul, P., & Krabbendam, L. (2009). A systematic review and meta-analysis of the psychosis continuum: evidence for a psychosis proneness–persistence–impairment model of psychotic disorder. Psychological Medicine, 39(2), 179195. https://doi.org/10.1017/S0033291708003814CrossRefGoogle ScholarPubMed
Versmissen, D., Janssen, I., Myin-Germeys, I., Mengelers, R., Campo, J. A., van Os, J., & Krabbendam, L. (2008). Evidence for a relationship between mentalising deficits and paranoia over the psychosis continuum. Schizophrenia Research, 99(1–3), 103110. https://doi.org/10.1016/j.schres.2007.09.024CrossRefGoogle ScholarPubMed
Visser, I., & Speekenbrink, M. (2010). depmixS4: An R Package for Hidden Markov Models. Journal of Statistical Software, 36, 121. https://doi.org/10.18637/jss.v036.i07CrossRefGoogle Scholar
Viterbi, A. (1967). Error bounds for convolutional codes and an asymptotically optimum decoding algorithm. IEEE Transactions on Information Theory/Professional Technical Group on Information Theory, 13(2), 260269. https://doi.org/10.1109/TIT.1967.1054010CrossRefGoogle Scholar
Woods, S. W., Parker, S., Kerr, M. J., Walsh, B. C., Wijtenburg, S. A., Prunier, N., … Accelerating Medicines Partnership Schizophrenia. (2023). Development of the PSYCHS: Positive SYmptoms and Diagnostic Criteria for the CAARMS Harmonized with the SIPS. Early Intervention in Psychiatry. https://doi.org/10.1111/eip.13457Google ScholarPubMed
Yung, A. R., McGorry, P. D., McFarlane, C. A., Jackson, H. J., Patton, G. C., & Rakkar, A. (1996). Monitoring and care of young people at incipient risk of psychosis. Schizophrenia Bulletin, 22(2), 283303. https://doi.org/10.1093/schbul/22.2.283CrossRefGoogle ScholarPubMed
Yung, Alison R., Phillips, L. J., Yuen, H. P., Francey, S. M., McFarlane, C. A., Hallgren, M., & McGorry, P. D. (2003). Psychosis prediction: 12-month follow up of a high-risk (“prodromal”) group. Schizophrenia Research, 60(1), 2132. https://doi.org/10.1016/S0920-9964(02)00167-6CrossRefGoogle ScholarPubMed
Yung, A. R., Phillips, L. J., Yuen, H. P., & McGorry, P. D. (2004). Risk factors for psychosis in an ultra high-risk group: psychopathology and clinical features. Schizophrenia Research, 67(2–3), 131142. https://doi.org/10.1016/S0920-9964(03)00192-0CrossRefGoogle Scholar
Yung, A. R., Yuen, H. P., McGorry, P. D., Phillips, L. J., Kelly, D., Dell’Olio, M., … Buckby, J. (2005). Mapping the onset of psychosis: the Comprehensive Assessment of At-Risk Mental States. The Australian and New Zealand Journal of Psychiatry, 39(11–12), 964971. https://doi.org/10.1080/j.1440-1614.2005.01714.xCrossRefGoogle ScholarPubMed
Zhang, Y., & Berhane, K. (2014). Bayesian mixed hidden Markov models: a multi-level approach to modeling categorical outcomes with differential misclassification. Statistics in Medicine, 33(8), 13951408. https://doi.org/10.1002/sim.6039CrossRefGoogle ScholarPubMed
Figure 0

Table 1. Demographic and clinical characteristics of the sample

Figure 1

Figure 1. Group level emission distributions characterizing the four clinical substates uncovered with the multilevel HMM. A continuous multivariate normal distribution captures the most likely scores for each of the six diary items that are observed in each substate.

Figure 2

Figure 2. Substate sequences generated for four individuals across subgroups 1–4. Missing diary data is imputed while missing substate sequence data is displayed in white. The exemplar individual spent: (a) most time in the first substate, consistent with negligible psychotic symptoms; (b) most time in the first and third substates, displaying high affective symptoms throughout the assessment period, with occasional symptoms of broadcasting; (c) multiple days in the fourth substate at the start of the assessment period, displaying high psychotic symptoms during this time. In the middle of the assessment period, this same individual spent periods in the second substate, displaying periods of high affective symptoms and suspiciousness, and, towards the end of the assessment period, spent most time in the first substate, exhibiting minimal psychotic symptoms; (d) most time in the fourth substate, displaying moderate scores for all items across the assessment period.

Figure 3

Figure 3. Perceptual disturbances and temporally associated state sequences for eight individuals belonging to subgroups 2–4. Grey and black lines (top panel) depict whether a perceptual disturbance was present or absent for each day across the 90-day assessment period. Missing state sequence data is displayed in white.

Figure 4

Figure 4. Network diagram of group-level and subgroup substate switching patterns. Switching probabilities are calculated as the posterior mean of estimates generated by the MCMC sampler, excluding the burn-in period. Nodes represent substates, and edges represent relative switching probabilities. The node area is proportional to the probability of an individual remaining in that substate. Edge thickness is proportional to the size of the relative switching probability (dashed: probabilities <.3, grey: probabilities 2–.4, black: probabilities >.4).

Supplementary material: File

Scott et al. supplementary material

Scott et al. supplementary material
Download Scott et al. supplementary material(File)
File 3.1 MB