Skip to main content

Understanding personalized dynamics to inform precision medicine: a dynamic time warp analysis of 255 depressed inpatients



Major depressive disorder (MDD) shows large heterogeneity of symptoms between patients, but within patients, particular symptom clusters may show similar trajectories. While symptom clusters and networks have mostly been studied using cross-sectional designs, temporal dynamics of symptoms within patients may yield information that facilitates personalized medicine. Here, we aim to cluster depressive symptom dynamics through dynamic time warping (DTW) analysis.


The 17-item Hamilton Rating Scale for Depression (HRSD-17) was administered every 2 weeks for a median of 11 weeks in 255 depressed inpatients. The DTW analysis modeled the temporal dynamics of each pair of individual HRSD-17 items within each patient (i.e., 69,360 calculated “DTW distances”). Subsequently, hierarchical clustering and network models were estimated based on similarities in symptom dynamics both within each patient and at the group level.


The sample had a mean age of 51 (SD 15.4), and 64.7% were female. Clusters and networks based on symptom dynamics markedly differed across patients. At the group level, five dynamic symptom clusters emerged, which differed from a previously published cross-sectional network. Patients who showed treatment response or remission had the shortest average DTW distance, indicating denser networks with more synchronous symptom trajectories.


Symptom dynamics over time can be clustered and visualized using DTW. DTW represents a promising new approach for studying symptom dynamics with the potential to facilitate personalized psychiatric care.

Peer Review reports


Depression is defined by its symptoms (such as a sad mood and insomnia) that are correlated with each other. The dominant explanation in the field has been that these relations stem from a shared causal origin, a perspective termed the common cause framework [1, 2]. The contemporary conceptualization for major depressive disorder (MDD) is similar to that of other medical conditions in that it assumes all observable depressive symptoms are caused by an underlying disease construct [1, 3]. In research, symptoms are usually added up to sum scores, and thresholds are used to indicate case status. This approach assumes that symptoms are equivalent, causally independent, and roughly interchangeable indicators of the underlying disease construct [4]. This conceptual framework has dominated depression research over the past decades: the inclusion criteria in research studies were based on the syndromal DSM diagnoses of MDD, and the unweighted sum scores of depression rating scales were used as a measure for severity and treatment response [5] (e.g., Hamilton Rating Scale for Depression [HRSD] [6] and Montgomery-Åsberg Depression Rating Scale [MADRS]) [7]. However, years of research have shown slow progress in the search for the underlying risk factors and biomarkers of the unitary construct MDD [4]. The need for a new, scientifically sound approach for conceptualizing depression is warranted.

Increasing evidence points towards the multidimensional character of MDD with a high degree of symptomatic variability between and within patients [4, 8]. Individual symptoms are mutually interacting and causing each other [9], and they have different risk factors [10, 11], underlying biology [11,12,13], psychosocial impact [14], and course trajectories [5]. Recent years have therefore seen a shift in the conceptualization of depression towards a network perspective where the depressive syndrome is hypothesized to stem from mutual causal relations among components of the system, such as depression symptoms [9, 15]. Furthermore, patients manifest specific depression symptom profiles with preferential responses to different treatments. Consequently, there is increasing recognition of the importance of investigating individual symptoms and their timely evolution, both within individual patients and in groups of patients [16, 17]. This is also in line with the aims of the Research Domain Criteria (RDoC) project to deconstruct psychiatric disorders by analyzing the dynamics (e.g., symptom trajectories over time) that lie at their basis [18, 19].

Several factor analytic studies of the HRSD-17 have tried to tackle the symptomatic diversity of MDD by means of identifying homogeneous symptom groups within MDD. Although there was evidence for a “general depression” and “insomnia” factor, the overall results were inconsistent, with reported factors ranging from two to eight [20,21,22,23]. Furthermore, factors seemed to change over time [24] and were poorly generalizable to other populations. Hierarchical cluster analysis is another statistical method to decompose MDD into homogeneous symptom groups, and comparable results (“general depression,” “insomnia”) have been found with this approach [25, 26]. Network analysis is a more recent approach that expands further on studying the symptom correlations by investigating the influence of symptoms on each other [9]. Both factor and network analyses were mostly conducted on cross-sectional data, and consequently, they did not take the temporal dynamics of symptoms into account. Furthermore, both techniques almost exclusively studied aggregated patient data without studying the intra-individual symptom heterogeneity.

Routine outcome monitoring (ROM) entails the collection of clinical data at baseline and at regular time intervals thereafter in order to monitor disease severity as well as the clinical course during treatment. ROM may provide feedback to both the clinician and the patient and enable “patient-centered research” [27, 28]. Time-series ROM data enable the capturing of dynamics of symptoms over time using dynamic time warping (DTW). DTW is a widely used statistical algorithm [29, 30], though not yet in psychological and psychiatric research. It is an effective clustering strategy for time-series data across a broad range of application domains [31]. Examples of biomedical applications are speech recognition [16], gait pathology [32,33,34], and electro-cardiogram analysis [35]. The DTW approach could be well-suited to cluster individual symptoms based on the temporal features that they share, using ROM or ecological momentary assessment EMA [36] time-series data.

In this study, we utilize depression symptom data from a clinical ROM regime, every 2 weeks, of 255 depressed inpatients and present the first implementation of DTW time-series analysis on depression symptom trajectories. This paper is built upon a dual structure in which the DTW analysis is introduced both for intra-individual (i.e., idiographic) and inter-individual (i.e., nomothetic) analysis [37]. In the idiographic analysis, we aim to assess the dynamics and covariation of changes in symptoms over time within each individual patient with two or more assessments and to estimate the symptom clusters and networks within each patient. In the nomothetic analysis, we aim to study the aggregated dynamics of individual symptoms to yield systematic patterns across patients.


Sample and setting

From the original study sample of 276 consecutive patients (i.e., included in the cohort study in the order that they were admitted), 21 patients had only one HRSD-17 measurement due to a short hospitalization period or refusal to participate, yielding 255 (91.6%) patients included in the current analysis. Thus, we included 255 adult patients consecutively admitted to a tertiary psychiatric hospital in Duffel, Belgium, and fulfilling the MINI-Plus diagnosis, based on the DSM-IV criteria, of a depressive episode as part of an MDD or bipolar disorder (BD). In order to obtain a representative sample of depressed participants, exclusion criteria were minimal. We did not include patients with (comorbid MINI-Plus) psychotic disorders (including schizoaffective disorder) or with a dependency on alcohol or drugs within 12 months prior to hospitalization. Moreover, patients with insufficient mastery of the Dutch language were not included.


Inpatients received treatment as usual which was based on evidence-based guidelines and consisted of pharmacotherapy, (group) psychotherapy, or a combination of both. These guidelines for diagnosis and treatment were formulated by the Dutch Association of Psychiatry, often in association with the associations of psychology and general practitioners (, Psychotropic medication at baseline was coded into five dichotomous variables: antidepressants, mood stabilizers, antipsychotics, benzodiazepines, and stimulants. Response was defined as a ≥ 50% reduction of the HRSD-17 compared to the baseline assessment. Remission was defined as scoring ≤ 7 on the HRSD-17.


The present study was part of a larger follow-up study investigating the feasibility of ROM in the University Psychiatric Centre in Duffel [38]. ROM were done at baseline and every 2 weeks thereafter during the clinical admission which lasted from 2 weeks to 16 months. ROM consisted of a test battery assessing overall mental well-being, quality of life, and mood (including the Hamilton Depression Rating Scale-17). The data presented in this article represent the collected data from the period April 2015 through February 2018.

The HRSD-17 consists of 17 items on a Likert scale, ranging from either 0 to 4 (for 9 items) or 0 to 2 (for 8 items). The internal reliability of the HRSD-17 is adequate with most studies reporting a Cronbach’s alpha of ≥ 0.70. It has a good retest and interrater reliability (above 0.80) when assessed over an interval ranging from 1 to 30 days [21]. The Omega and Cronbach’s alpha in our sample of 255 patients at baseline were only 0.49 and 0.52, respectively. The Cronbach’s alpha improved over time with a score of 0.74 after 2, 0.77 after 4, and 0.79 after 6 weeks. The total score ranges from 0 to 52, and higher scores indicate greater severity, but in the present study, we focus on the trajectories of the 17 individual items only. In order to improve interrater reliability, Hamilton Depression Rating Scale training sessions were organized every 3 months among the in total 6 assessors, during which video-recorded interviews with patients were rated and discussed to reach consensus. In total, they conducted 1480 HRSD-17 assessments in 255 patients, with an average of 5.8 assessments per patient.

Statistical analysis

DTW is an approximate pattern detection algorithm that can measure the similarity between two time-series. It uses a dynamic (i.e., stretching and compressing) programming approach to minimize a predefined distance measure (e.g., Euclidean distance), in order for the two time-series to become optimally aligned through a warping path. The “optimal” alignment minimizes the sum of distances between the aligned elements. The “dtw” (version 1.20.1), “pheatmap” (version 1.0.12), “parallelDist” (version 0.2.4), and “qgraph” (version 1.6.2) packages for the R statistical software were used (R version 3.6.0; R Foundation for Statistical Computing, Vienna, Austria, 2016. URL:

The idiographic approach per patient was followed by a nomothetic approach to study the depression symptom patterns both within individual patients and in the whole sample of 255 patients. The subsequent methodological steps and statistical methods are described below.

Intra-individual approach

We first aimed to cluster individual symptoms based on the temporal features that they share within each individual patient. The clustering of symptom trajectories based on DTW consisted of two steps. First, the DTW distance between each pair of symptom trajectories was calculated. This is illustrated in Fig. 1 with the example of two HRSD-17 item time-series (item 1 “depressed mood” and item 7 “work and interest”) of a single patient. The temporal scoring (per 2 weeks) on the given items is seen in Fig. 1a, with the two items for which the DTW distance is calculated shown in red. This patient had 14 assessments over a period of 26 weeks. The trajectories of items 1 “depressed mood” and 7 “work and interest” over time are plotted in Fig. 1b. The deformations of the time axes between both items are added, which brings the two time-series as close as possible to each other, in which all elements must be matched. Next, the calculation of the shortest path between the two time-series is shown in Fig. 1c. The two time-series were aligned in time with compressions and expansions. The “symmetricP0” step pattern was used as the dynamic time warping algorithm to match the two sequences, resulting in the red “warping path.” A Sakoe-Chiba Band of 2 was used in order for the severity scores to be matched to a maximum of plus or minus two time points (plus or minus a maximum of 4 weeks). Resulting from the DTW method, a distance measure (d) is produced: items with the best alignment, having a more similar slope and other dynamics (i.e., changes that co-vary over time), resulted in the smallest distance. The distance measures of each of the 17 time-series of individual HRSD-17 items are grouped in a distance matrix, comprising (172 − 17)/2 = 136 distances for each individual patient.

Fig. 1

For a single patient, the individual HRSD-17 item scores over time are shown (a). The DTW method uses a dynamic (i.e., stretching and compressing) programming approach to minimize a predefined distance measure (e.g., Euclidean distance), in order for the two time-series to become optimally aligned through a warping path (b). The optimal warping route between items 1 and 7 is shown (c). Using the “symmetricP0” step pattern and a Sakoe-Chiba Band of 2, this yields a final DTW distance of 13 (d)

Second, this matrix of 136 distances was presented in a heatmap and used in a hierarchical cluster analysis and a symptom network per patient. For the hierarchical cluster analysis, each item is initially assigned to its own cluster, and then the algorithm proceeds iteratively, at each stage joining the two most similar clusters, continuing until there is just a single cluster. We assumed 3 clusters for each patient, for illustrative purposes only, to enable easier recognition of the symptom with the more similar trajectories. We excluded all symptoms with a score of 0 throughout follow-up, as these tended to cluster together most strongly as these symptom pairs will have a distance of 0. At each stage, distances between clusters are recomputed by the Lance-Williams dissimilarity update formula according to the “Ward.D2” clustering methods. With “Ward.D2,” the total within-cluster variance is minimized, and the dissimilarities are squared before cluster updating.

Using the “qgraph” package, the structure of the network based on the distance matrix was visualized per patient, providing another way of graphical presentation of the clusters. We followed the recommendations on network analysis written by the developers of the R package [39]. A network with up to 17 nodes (representing the individual HRSD-17 depression symptoms) is obtained and, connecting them, the edges representing the distances between symptom trajectories. The thickness of the edges indicates the strength of the longitudinal elastic covariation (thicker edges represent a shorter distance between the two symptom trajectories).

Inter-individual approach

Next, we aimed to study the aggregated dynamics of individual symptoms to yield systematic patterns over time across patients. In this second part, we aimed to build a generalizable hierarchy of symptom clusters based on their shared temporal features. First, the 136 distances were averaged over the 255 patients, weighted for the number of assessments that were done for each of the patients (ranging from 2 through 17). Second, this matrix of 255 mean distances was used for the generalizable hierarchical cluster analysis. A scree plot was constructed displaying the heights in a downward curve and the elbow rule (i.e., the point where the graph leveled off) was used to determine the most appropriate number of clusters.

The “Distatis” algorithm from the “DistatisR” package was used to check whether using the actual 255 distance matrices instead of one mean distance matrix yielded similar clusters. Distatis is a generalization of classical multidimensional scaling (MDS), based on a three-way principal component analysis, to analyze a set of distance matrices. In order to compare these distance matrices, it combines them into a common structure called a compromise and then projects the original distance matrices onto this compromise. Compromise factors are calculated and plotted in the compromise space, with each component been given the length corresponding to its eigenvalues. We plotted each of the 17 HRSD symptoms on an X-Y plane according to their first and second compromise factor values.

In the following step, we investigated two centrality metrics, being closeness centrality and degree centrality [40] for the average distance matrix. Degree centrality is based on the number and strengths of connections each symptom has. Closeness centrality also takes the global network structure into account because it measures the average distance of a certain symptom to all other symptoms. Applied on the DTW data, closeness is inversely proportional to the mean DTW to all other symptoms and, in this way, indicates which symptom trajectory is the most similar to that of other symptoms.

Finally, we computed the average DTW distance among all symptom trajectories for each patient. Symptoms that scored consistently zero were deleted from these analyses for that particular patient, as all such symptoms would result in distances of zero. Shorter average DTW distances reflected denser interconnections between symptoms, and longer average DTW distances reflected looser longitudinal connectivity between symptoms. In order to investigate the relationship between network density and reaching response and remission, we calculated the residuals of the regression with the number of assessments and the HDRS sum score. These residuals were plotted using box plots according to whether response and remission were reached, and we performed Wilcoxon signed-rank tests to compare the two samples.

The analyses used the packages “dtw” (version 1.20.1), “pheatmap” (version 1.0.12), “parallelDist” (version 0.2.4), “qgraph” (version 1.6.2), and “DistatisR” (version) for the R statistical software (R version 3.6.0; R Foundation for Statistical Computing, Vienna, Austria, 2016). A sample code (with data from the of 2 exemplar patients of Fig. 2) can be found in Additional file 1.

Fig. 2

DTW analysis of HRSD-17 symptoms for patient no. 196 and patient no. 201 (a). Heatmap (symptoms that show high correlation are given a “hot” red color, and those that are not correlated are given a “cold” blue color) (b). Dendrogram based on the clustering of DTW distances of 15 of the non-zero HRSD-17 item scores over time (c). Network graph based on the distance matrix: connections between symptoms (edges) indicate distances between symptom trajectories (d). Centrality statistics of the network graph: centrality is based on the number and strengths of connections each symptom has. Closeness also takes the global network structure into account (e)


Patient characteristics

Table 1 shows the demographic and clinical characteristics and the use of psychotropic medication of the included patients. Patients had a mean age of 50.9 years (standard deviation [SD] = 15.4), and 165 were women (64.7%). A bipolar disorder was diagnosed in 48 patients (18.8%). The mean duration of illness was 11.2 ± 15 years. For 56 patients (22%), the current episode was the first depressive episode. The baseline HRSD-17 score was 20.7 (SD 4.6) on average, and 79.6% of the patients used antidepressants. Of the 255 patients, 169 showed treatment response and 128 remission at the end of admission. The median duration of hospitalization was 11 weeks, and the total number of assessments was 1480, with a mean of 5.8 and a median of 5 HRSD-17 assessments per patient.

Table 1 Characteristics and medication use of 255 consecutive depressed inpatients

Intra-individual approach

In Fig. 2, the DTW analyses of 2 exemplar patients are shown. We will discuss these two exemplar patients in order to demonstrate the opportunities of the DTW clustering method to inform clinical practice. By comparing the results from patients 196 and 201, we can already see a high degree of inter-individual variability in symptom trajectories.

Patient 196 was a 55-year-old female presenting with psychotic depression. At admission, anhedonia, insomnia, and psychic anxiety were overtly present. The anxious preoccupations disabled her in engaging any psychotherapy program at the start of hospitalization. A treatment with electroconvulsive therapy (ECT) led to a resolution of the most central symptoms (symptom with most dense connections with other symptoms, e.g., depressed mood, feelings of guilt, and somatic anxiety) during the hospitalization of 2 months. Although she remained to score relatively high on the HRSD-17 symptoms “work and interests,” “psychic anxiety,” and “insight,” she could be discharged after the resolution of the majority of her depressive symptoms. The central (red) symptoms tended to fluctuate most strongly together over time. Furthermore, due to the presence of residual symptoms that were resistant to ECT treatment, we formulated an advice for ambulatory psychological therapy to focus on these persistent (blue) symptoms of insight, engagement in activities, and psychic anxiety as a cornerstone of further treatment.

Patient 201 was a 38-year-old female who presented with a severely depressed mood and suicidal thoughts. She described her depressive complaints as an overpowering sense of feeling down and agitated. There was no loss of appetite or weight loss. A treatment with nortriptyline and trazodone (for her sleeping problems, mainly middle insomnia) was started. The sleeping problems improved quickly. Her depressed mood and suicidal thoughts did not change at the beginning of treatment. Treatment with lithium, because of a suspicion of underlying bipolar disorder, led to a quick resolution of the mood and anxiety symptoms. Loss of sexual interest was initially not present but commenced during hospitalization, possibly as a side effect of treatment.

Inter-individual approach

Figure 3 shows the nomothetic analysis of the 255 patients. A total of five clusters emerged, based on the elbow method in the scree plot (see Fig. 3a). The hierarchical cluster analysis was estimated based on the average weighted distance matrix (Fig. 3b). These clusters consisted of symptoms with a similar course trajectory: (1) core symptoms (2 items: “depressed mood,” “work and interests”), (2) sleep symptoms (3 items: late, middle, and early insomnia), (3) distress (2 items: “guilt,” “psychic anxiety”), (4) somatic symptoms (2 items: “genital symptoms,” “general somatic symptoms”), and (5) inner turmoil (8 items: insight, weight loss, hypochondriasis, gastro-intestinal symptoms, somatic anxiety, agitation, retardation, and suicide). As is shown in Additional file 2: Fig. S1, the network plots did not change significantly when excluding all symptoms with a score of 0 throughout follow-up.

Fig. 3

Nomothetic analyses based on all distance matrices from 255 depressed inpatients (see accompanying PDF). The scree plot displays the eigenvalues in a downward curve. The number of factors was determined using the elbow method (i.e., the point where the slope of the curve is leveling of; in our example, this is 5: after this point, the slope of the curve is nearly stable) (a). Ward’s (D2, i.e., general agglomerative hierarchical clustering procedure) clustering criterion on the weighted mean distance matrix from 255 patients (b). Distatis analysis: the PCA of the compromise matrix (i.e., weighted average of individual cross-product matrices) gives the position of the objects in the compromise space (c). Overview of the networks of HRSD-17 items for 255 patients (d)

In the following step, we analyzed the actual 255 distance matrices, instead of one mean distance matrix, using Distatis. Figure 3c shows the Distatis compromise plot in which each HRSD-17 item is plotted according to their first and second compromise factor values. The distribution pattern of the HRSD-17 items in the compromise plot shows a comparable pattern to the obtained hierarchical clusters, corroborating the obtained five clusters. The clusters corroborated those found with the hierarchical cluster analysis on the average distance matrix. Next, the average distance matrix was visually presented in a network graph in Fig. 3d.

Figure 4 shows the two centrality measures based on the network from the average distance matrix. These can inform us on which symptoms globally tend to covary together over time. The items from the “inner turmoil” show the highest degree centrality and closeness centrality scores, indicating that they covaried most strongly with other HRSD-17 items. Items constituting the “insomnia” or “somatic symptom” cluster showed lower centrality which suggests that these symptoms behaved in a more independent manner over time compared to the other HRSD-17 items.

Fig. 4

Centrality measures. The closeness centrality is the inverse of the average length of the shortest path between the focal node and every other node in the network (i.e., the more central a node is, the closer it is to all other nodes). Degree centrality represents the connectivity, based on the number and strengths of edges connected to it

The evolution of the mean HRSD-17 item levels over time are visualized in Fig. 5a using mixed models per item. The eight items with a range from 0 to 2 (three insomnia items: gastro-intestinal complaints, general somatic and genital symptoms, insight and weight loss) were scaled to a range from 0 to 4 in order to make a comparability between all items possible. The HRSD-17 items “depressed mood,” “work and interests,” “general somatic,” and “genital symptoms” had the highest baseline severity. The items “insight” and “weight loss” had the lowest mean scores and stayed relatively low during hospitalization. Figure 5b shows the intercepts and slopes of the 17 mixed models for the individual longitudinal trajectories. The intercepts indicated that genital, general somatic, and depressed mood symptoms generally scored the highest at baseline. The slopes of the linear model revealed that depressed mood showed the steepest decline over time.

Fig. 5

Forest plot of the 17 HRSD items of two mean levels of indicators of individual longitudinal trajectories. The mixed model intercept (a) indicates which symptoms scored the highest at baseline (i.e., genital, general somatic symptoms, and depressed mood scored the highest at baseline). The mixed model slope (b) of the linear model showed the average decline per 2-week time interval (i.e., depressed mood showed the steepest decline over time)

As shown in Fig. 6, patients that reached response or remission during hospitalization had significantly shorter average distances among symptoms than patients who failed to reach response or remission. That is, patients reaching response or remission mostly had on average a more densely connected symptom network (based on the mean DTW analysis). We excluded symptoms that scored zero throughout the admission, yet when these symptoms were included, this resulted in similar findings (see Additional file 2: Fig. S2A). In addition, not adjusting for HRSD-17 total scores at baseline did not alter the results (see Additional file 2: Fig. S2B). Exploring the difference in network connectivity between unipolar and bipolar depressed patients revealed a denser symptom network in bipolar than in unipolar patients (see Additional file 2: Fig. S3).

Fig. 6

Average DTW distance according to response and remission. Those patients with response or remission had the shortest average distance among symptom trajectories, indicating denser interconnections (p by Wilcoxon signed-rank test to compare the two samples). Distances were adjusted for the number of assessments and the baseline total HRSD-17 score


The present study is the first to analyze the time-series of depression symptoms using DTW analyses in psychiatric inpatients. We applied the DTW computational method to estimate and visualize similarities in symptom trajectories and to yield clusters of symptoms with similar course trajectories both at the patient level and at the group level. Both the intra- and inter-individual analyses may help to increase our insight into the dynamical complexity of symptom trajectories in severely depressed inpatients. Furthermore, combining ROM techniques with automated feedback for the clinician based on the methods—as introduced here—proved useful to inform and facilitate clinical decision making. Overall, three major findings are worth discussing in more detail.

We first focused on the individual symptom dynamics that proved to be highly variable across individuals and thus idiosyncratic [41]. This finding supports previous concerns on the use of sum scores for assessing treatment outcome, since sum scores do not represent this dynamical symptom complexity well [4, 16], with a loss of substantial information that may be of clinical relevance. The intra-individual dynamic symptom clusters and symptom networks, in which the edges between symptoms represented the dynamical relation between them, allowed us to gain insight into the relative importance of certain symptoms for individual patients, but also at the group level [40]. Such symptoms may cause other symptoms, which may be different for other patients [9]. It could be hypothesized that targeting treatment on such central symptoms early in therapy may lead to a more rapid resolution of closely connected depressive symptoms [42, 43].

Overall, the study of intra-individual temporal dynamics of depression symptoms is rare in the literature. A growing field of research has focused on the development of individual dynamic networks of symptoms in which time-series or experience sampling methods (ESM) data are used to study the within-patient dynamical structure of symptoms [43,44,45,46,47]. These networks are mostly estimated using vector autoregression (VAR) which estimates both lagged (i.e., time minus one temporal) and contemporaneous (i.e., simultaneous) relationships among multiple symptoms [45]. The DTW approach represents a less constraint analysis of individual symptom dynamics since the DTW distance measure accounts for a longer time period when measuring the similarity between each pair of depressive symptoms (2 time points). Furthermore, it provides an accessible and easily interpretable method that can be a useful tool for clinicians and researchers for the early detection of central symptoms and the directed tailoring of treatment towards these symptoms. Moreover, it does not necessitate the time-consuming ESM data collection, which can be challenging in daily clinical practice due to the considerable burden it puts on participants.

Secondly, we focused on the group-level analyses, which yielded five symptom clusters with more similar dynamics over time across the total sample. Compared to cross-sectional factor analytic studies, which investigate the co-occurrence of depressive symptoms at a certain time point, we similarly found that the three sleep items appeared consistently in one factor [20, 21]. Previously, there was some support for the presence of a “general depression,” with depressed mood, guilt, suicide, work and interests, and psychic anxiety appearing on one factor [20,21,22]. We, however, found that only “depressed mood” and “work and interest” showed the most consistent trajectories over time, which represented the core symptoms of depression. Somatic symptoms did not appear on the same factor as described for cross-sectional factor analyses (“somatic symptom” or “somatized depression” consisting of somatic symptoms, weight loss/gastro-intestinal symptoms, loss of libido/genital symptoms) [20, 22]. Moreover, previous studies found evidence for limited longitudinal invariance, where the number of factors did not hold across time [24, 48] which is supported by our and previous data that the Omegas and Cronbach’s alphas were not stable over time, but improved during hospital admission [49]. An internal validation of our findings using a random sample of 128 and 127 patients of our sample revealed the same dynamical clusters (see Additional file 2: Fig. S4). Further validation of these findings in an independent sample is necessary.

Third, we found that patients who reached response or remission during hospitalization had a more densely connected symptom network compared to patients that failed to reach response or remission. This contrasts with the findings of Van Borkulo et al. [50], who identified a more densely connected cross-sectional depression symptom network in not remitters compared to patients reaching remission. Although the method of quantifying network connectivity was not the same (average DTW distance versus network comparison test), this shows, once again, the importance of studying longitudinal networks besides cross-sectional symptom networks. Our findings could be related to the literature reviewed by Scheffer [51], showing that networks with high connectivity can change more abruptly (for better and worse) in response to external events (so-called critical transitions). Applied on the DTW network analysis, when symptoms have a low level of connectivity, they seem to behave more independently from each other and in response to an external factor such as admission and treatment, which may have lowered the probability of an acute response or remission to treatment. These findings need to be confirmed in further studies, as the definition of response and remission was also based on the HRSD sum scores, which is not independent of the DTW assessments from HRSD time-series data.

The DTW method has a promising potential for clinical practice, and it builds further upon the already available evidence of the value of measurement-based care in psychiatry [52]. First, the DTW symptom clusters allow the clinician to gain insight into the dynamics of individual depression symptoms and longitudinal symptom clusters. Second, as illustrated in the two idiographic analyses (Fig. 2), the DTW method has the potential to facilitate clinical decision making. More specifically, treatment interventions targeted at the most central symptom (i.e., symptoms with the most dense connections with other symptoms) could lead to a rapid resolution of the depressive syndrome. Third, the graphical representation of the DTW clusters is easily amenable as a feedback tool for patients to gain more insight into the central symptoms that tend to covariate with a variety of other symptoms or in symptom clusters that tend to move in a more independent matter. This could lead to a more nuanced insight in reaching response or remission or lack thereof.

An important strength of our study is the use of the innovative DTW clustering method to study the time-series of individual symptom severity scores. The DTW method is able to process the highly dimensional ROM time-series data in order to reduce the complexity of the data while still maintaining the essential characteristics of the dataset. By using an elastic measurement, DTW provides an optimal time alignment between two time-series. Furthermore, DTW can be accurately used in smaller datasets and individual patients [31]. Another strength of our study is the relatively complete dataset of ROM data from real-world consecutive inpatients. Nonetheless, our results must be considered in light of some limitations. First, exclusively inpatients were recruited from one center which may limit the generalizability of our results to outpatients and other patient groups. Second, patients were treated with a variety of different combinations of psychotropic drugs which likely affected the course and dynamical characteristics of individual symptoms (such as concentration difficulties in those receiving ECT). Future studies using data from randomized trials may help to unravel the influence of different treatment strategies on the dynamic symptom dimensions. Third, the HRSD-17 is not designed to investigate individual symptoms, and its items are scored on a crude scale with only three or five answer categories resulting in low variability and precision. Fourth, assessments were done with 2-week intervals, and DTW analyses may be more useful in more frequent time-series like those collected with ESM. Fifth, the DTW method allows some flexibility in how it is applied to study MDD symptom trajectories, e.g., in terms of the global constraint (Sakoe-Chiba Band). We adopted default settings based on simulation studies in the prior literature and hope that future methodological studies working with psychiatric data specifically will investigate how robust empirical results are to changes in default settings of the DTW method, e.g., using multiverse analyses [53].


MDD is a heterogeneous disorder consisting of dynamic symptom clusters that varied between patients. The use of repeated, standardized clinical rating scales yields extensive information on patient-specific symptoms dynamics. DTW may be a promising new methodology for the study of the complex dynamic system of interacting psychiatric symptoms [9, 15, 54] with the potential to facilitate personalized psychiatry care.

Availability of data and materials

The datasets used analyzed during the current study are available from the corresponding author on reasonable request.


d :

Distance measure


Dynamic time warping


Electroconvulsive treatment


17-Item Hamilton Rating Scale for Depression


Major depressive disorder


Multidimensional scaling


Standard deviation


Vector autoregression


  1. 1.

    Borsboom D. Psychometric perspectives on diagnostic systems. J Clin Psychol. 2008 Sep;64(9):1089–108.

    PubMed  Article  PubMed Central  Google Scholar 

  2. 2.

    Schmittmann VD, Cramer AOJ, Waldorp LJ, Epskamp S, Kievit RA, Borsboom D. Deconstructing the construct: a network perspective on psychological phenomena. New Ideas Psychol. 2013;31(1):43–53.

    Article  Google Scholar 

  3. 3.

    Borsboom D, Mellenbergh GJ, Van Heerden J. The theoretical status of latent variables. Psychol Rev. 2003;110:203–19.

    PubMed  Article  PubMed Central  Google Scholar 

  4. 4.

    Fried EI. Problematic assumptions have slowed down depression research: why symptoms, not syndromes are the way forward. Front Psychol. 2015;6:309.

  5. 5.

    Fried EI, Nesse RM. Depression sum-scores don’t add up: why analyzing specific depression symptoms is essential. BMC Med. 2015;13(1):72 Available from: [cited 2020 Mar 15].

    PubMed  PubMed Central  Article  Google Scholar 

  6. 6.

    Trajković G, Starčević V, Latas M, Leštarević M, Ille T, Bukumirić Z, et al. Reliability of the Hamilton Rating Scale for Depression: a meta-analysis over a period of 49 years. Psychiatry Res. 2011;189(1):1–9.

    PubMed  Article  PubMed Central  Google Scholar 

  7. 7.

    Montgomery SA, Asberg M. A new depression scale designed to be sensitive to change. Br J Psychiatry. 1979;134(4):382–9 Available from: [cited 2020 Jul 10].

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  8. 8.

    Gibbons RD, Clark DC, Kupfer DJ. Exactly what does the Hamilton depression rating scale measure? J Psychiatr Res. 1993;27(3):259–73.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  9. 9.

    Borsboom D, Cramer AOJ. Network analysis: an integrative approach to the structure of psychopathology. Annu Rev Clin Psychol. 2013;9(1):91–121.

    PubMed  Article  PubMed Central  Google Scholar 

  10. 10.

    Cramer AOJ, Waldorp LJ, Van Der Maas HLJ, Borsboom D. Comorbidity: a network perspective. Behav Brain Sci. 2010;33:137–50.

    PubMed  Article  PubMed Central  Google Scholar 

  11. 11.

    Hasler G, Northoff G. Discovering imaging endophenotypes for major depression. Mol Psychiatry. 2011;16(6):604–19 Available from: [cited 2019 Nov 8].

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  12. 12.

    Myung W, Song J, Lim SW, Won HH, Kim S, Lee Y, et al. Genetic association study of individual symptoms in depression. Psychiatry Res. 2012;198(3):400–6.

    PubMed  Article  PubMed Central  Google Scholar 

  13. 13.

    Kendler KS, Aggen SH, Neale MC. Evidence for multiple genetic factors underlying DSM-IV criteria for major depression. JAMA Psychiatry. 2013;70(6):599–607.

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  14. 14.

    Faravelli C, Servi P, Arends JA, Strik WK. Number of symptoms, quantification, and qualification of depression. Compr Psychiatry. 37(5):307–15 Available from: [cited 2020 Mar 15].

  15. 15.

    Kendler KS, Zachar P, Craver C. What kinds of things are psychiatric disorders? Psychol Med. 2011;41(6):1143–50 Available from: [cited 2020 Mar 16].

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  16. 16.

    Fried EI, Nesse RM, Zivin K, Guille C, Sen S. Depression is more than the sum score of its parts: individual DSM symptoms have different risk factors. Psychol Med. 2014;44(10):2067–76 Available from: [cited 2020 Mar 15].

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  17. 17.

    Beltz AM, Wright AGC, Sprague BN, PCM M. Bridging the nomothetic and idiographic approaches to the analysis of clinical data. Assessment. 2016;23(4):447–58 Available from: [cited 2020 Mar 15].

    PubMed  PubMed Central  Article  Google Scholar 

  18. 18.

    Insel T, Cuthbert B, Garvey M, Heinssen R, Pine DS, Quinn K, et al. Research Domain Criteria (RDoC): toward a new classification framework for research on mental disorders. Am J Psychiatry. 2010;167:748–51.

    PubMed  Article  PubMed Central  Google Scholar 

  19. 19.

    Insel TR. The NIMH Research Domain Criteria (RDoC) project: precision medicine for psychiatry. Am J Psychiatry. 2014;171:395–7.

    PubMed  Article  PubMed Central  Google Scholar 

  20. 20.

    Shafer AB. Meta-analysis of the factor structures of four depression questionnaires: Beck, CES-D, Hamilton, and Zung. J Clin Psychol. 2006;62(1):123–46 Available from: [cited 2020 May 6].

    PubMed  Article  PubMed Central  Google Scholar 

  21. 21.

    Bagby RM, Ryder AG, Schuller DR, Marshall MB. The Hamilton Depression Rating Scale: has the gold standard become a lead weight? Am J Psychiatry. 2004;161:2163–77.

    PubMed  Article  PubMed Central  Google Scholar 

  22. 22.

    Hamilton M. A rating scale for depression. J Neurol Neurosurg Psychiatry. 1960;23(1):56–62 Available from: [cited 2018 Oct 31].

    CAS  PubMed  PubMed Central  Article  Google Scholar 

  23. 23.

    Hamilton M. Development of a rating scale for primary depressive illness. Br J Soc Clin Psychol. 1967;6(4):278–96.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  24. 24.

    Fried EI. Are more responsive depression scales really superior depression scales? J Clin Epidemiol. 2016;77:4–6.

    PubMed  Article  PubMed Central  Google Scholar 

  25. 25.

    Kasper S, Dienel A. Cluster analysis of symptoms during antidepressant treatment with Hypericum extract in mildly to moderately depressed out-patients. A meta-analysis of data from three randomized, placebo-controlled trials. Psychopharmacology (Berl). 2002;164(3):301–8 Available from: [cited 2020 Oct 15].

    CAS  Article  Google Scholar 

  26. 26.

    Chekroud AM, Gueorguieva R, Krumholz HM, Trivedi MH, Krystal JH, Mccarthy G. Reevaluating the efficacy and predictability of antidepressant treatments a symptom clustering approach supplemental content. JAMA Psychiatry. 2017;74(4):370–8 Available from:

    PubMed  PubMed Central  Article  Google Scholar 

  27. 27.

    de Beurs E, den Hollander-Gijsman ME, van Rood YR, van der Wee NJ, Giltay EJ, van Noorden MS, van der Lem R, van Fenema E, Zitman FG. Routine outcome monitoring in the Netherlands: practical experiences with a web-based strategy for the assessment of treatment outcome in clinical practice. Clin Psychol Psychother. 2011;18(1):1-12.

  28. 28.

    Washington AE, Lipstein SH. The Patient-Centered Outcomes Research Institute—promoting better information, decisions, and health. N Engl J Med. 2011;365(15):e31 Available from: [cited 2019 Feb 6].

    PubMed  Article  PubMed Central  Google Scholar 

  29. 29.

    Sakoe H, Chiba S. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoust. 1978;26(1):43–9.

    Article  Google Scholar 

  30. 30.

    Introduction. In: Information retrieval for music and motion. Berlin, Heidelberg: Springer Berlin Heidelberg; 2007. p. 1–13. Available from: [cited 2020 Mar 30].

  31. 31.

    Ding H, Trajcevski G, Scheuermann P, Wang X, Keogh E. Querying and mining of time series data. Proc VLDB Endow. 2008;1(2):1542–52.

    Article  Google Scholar 

  32. 32.

    Dandu SR, Engelhard MM, Qureshi A, Gong J, Lach JC, Brandt-Pearce M, et al. Understanding the physiological significance of four inertial gait features in multiple sclerosis. IEEE J Biomed Heal Informatics. 2018;22(1):40–6 Available from: [cited 2020 Mar 30].

    Article  Google Scholar 

  33. 33.

    Engelhard M, Dandu SR, Lach J, Goldman M, Patek S. Toward detection and monitoring of gait pathology using inertial sensors under rotation, scale, and offset invariant dynamic time warping. In: Proceedings of the 10th EAI International Conference on Body Area Networks. ICST; 2015. Available from: [cited 2020 Mar 30].

  34. 34.

    Li M, Tian S, Sun L, Chen X. Gait analysis for post-stroke hemiparetic patient by multi-features fusion method. Sensors (Basel). 2019;19(7):1737.

  35. 35.

    Zhang G, Kinsner W, Huang B. Electrocardiogram data mining based on frame classification by dynamic time warping matching. Comput Methods Biomech Biomed Engin. 2009;12(6):701–7 Available from: [cited 2020 mar 30].

    PubMed  Article  PubMed Central  Google Scholar 

  36. 36.

    Csikszentmihalyi M, Larson R. Validity and reliability of the experience-sampling method. J Nerv Ment Dis. 1987;175(9):526–36.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  37. 37.

    Fisher AJ, Newman MG, Molenaar PCM. A quantitative method for the analysis of nomothetic relationships between idiographic structures: dynamic patterns create attractor states for sustained posttreatment change. J Consult Clin Psychol. 2011;79(4):552–63.

    PubMed  PubMed Central  Article  Google Scholar 

  38. 38.

    Hebbrecht K, Stuivenga M, Birkenhäger T, Van Der Mast RC, Sabbe B, Giltay EJ. Symptom profile and clinical course of inpatients with unipolar versus bipolar depression. Neuropsychobiology. 2019;79:4–5 Available from: [cited 2020 Jul 27].

    Google Scholar 

  39. 39.

    Epskamp S, Borsboom D, Fried EI. Estimating psychological networks and their accuracy: a tutorial paper. Behav Res Methods. 2018;50(1):195–212.

    PubMed  Article  PubMed Central  Google Scholar 

  40. 40.

    Opsahl T, Agneessens F, Skvoretz J. Node centrality in weighted networks: generalizing degree and shortest paths. Soc Networks. 2010;32(3):245–51.

    Article  Google Scholar 

  41. 41.

    Fisher AJ. Toward a dynamic model of psychological assessment: implications for personalized care. J Consult Clin Psychol. 2015;83(4):825–36.

    PubMed  Article  PubMed Central  Google Scholar 

  42. 42.

    Fried EI, Epskamp S, Nesse RM, Tuerlinckx F, Borsboom D. What are “good” depression symptoms? Comparing the centrality of DSM and non-DSM symptoms of depression in a network analysis. J Affect Disord. 2016;189:314–20.

    PubMed  Article  PubMed Central  Google Scholar 

  43. 43.

    Epskamp S, van Borkulo CD, van der Veen DC, Servaas MN, Isvoranu AM, Riese H, et al. Personalized network modeling in psychopathology: the importance of contemporaneous and temporal connections. Clin Psychol Sci. 2018;6(3):416–27 Available from: [cited 2020 Jul 9].

    PubMed  PubMed Central  Article  Google Scholar 

  44. 44.

    Beltz AM, Wright AGC, Sprague BN, PCM M. Bridging the nomothetic and idiographic approaches to the analysis of clinical data. Assessment. 2016;23(4):447–58 Available from: [cited 2020 May 2].

    PubMed  PubMed Central  Article  Google Scholar 

  45. 45.

    Bringmann LF, Ferrer E, Hamaker EL, Borsboom D, Tuerlinckx F. Modeling nonstationary emotion dynamics in dyads using a time-varying vector-autoregressive model. Multivariate Behav Res. 2018;53(3):293–314.

    PubMed  Article  PubMed Central  Google Scholar 

  46. 46.

    Bulteel K, Tuerlinckx F, Brose A, Ceulemans E. Improved insight into and prediction of network dynamics by combining VAR and dimension reduction. Multivariate Behav Res. 2018;53(6):853–75.

    PubMed  Article  PubMed Central  Google Scholar 

  47. 47.

    Fisher AJ, Reeves JW, Lawyer G, Medaglia JD, Rubel JA. Exploring the idiographic dynamics of mood and anxiety via network analysis. J Abnorm Psychol. 2017;126(8):1044–56.

    PubMed  Article  PubMed Central  Google Scholar 

  48. 48.

    Steinmeyer EM, Möller HJ. Facet theoretic analysis of the Hamilton-D scale. J Affect Disord. 1992;25(1):53–61.

    CAS  PubMed  Article  PubMed Central  Google Scholar 

  49. 49.

    Fried EI, van Borkulo CD, Epskamp S, Schoevers RA, Tuerlinckx F, Borsboom D. Measuring depression over time...or not? lack of unidimensionality and longitudinal measurement invariance in four common rating scales of depression. Psychol Assess. 2016;28(11):1354–67.

    PubMed  Article  PubMed Central  Google Scholar 

  50. 50.

    Van Borkulo C, Boschloo L, Borsboom D, Penninx BWJH, Lourens JW, Schoevers RA. Association of symptom network structure with the course of longitudinal depression. JAMA Psychiatry. 2015;72(12):1219–26.

    PubMed  Article  PubMed Central  Google Scholar 

  51. 51.

    Van De Leemput IA, Wichers M, Cramer AOJ, Borsboom D, Tuerlinckx F, Kuppens P, et al. Critical slowing down as early warning for the onset and termination of depression. Proc Natl Acad Sci U S A. 2014;111(1):87–92.

    PubMed  Article  CAS  PubMed Central  Google Scholar 

  52. 52.

    Trivedi MH, Rush AJ, Wisniewski SR, Nierenberg AA, Warden D, Ritz L, et al. Evaluation of outcomes with citalopram for depression using measurement-based care in STAR*D: implications for clinical practice. Am J Psychiatry. 2006;163(1):28–40.

    PubMed  Article  PubMed Central  Google Scholar 

  53. 53.

    Steegen S, Tuerlinckx F, Gelman A, Vanpaemel W. Increasing transparency through a multiverse analysis. Perspect Psychol Sci. 2016;11(5):702–12.

    PubMed  Article  PubMed Central  Google Scholar 

  54. 54.

    Cramer AO, van Borkulo CD, Giltay EJ, van der Maas HL, Kendler KS, Scheffer M, Borsboom D. Major depression as a complex dynamic system. PLoS One. 2016;11(12):e0167490.

Download references


We thank all the clinicians who performed and coordinated the routine outcome monitoring in the University Psychiatric Centre of Duffel.


The study was funded by the Hercules Project (42/FA0201000/17/6780).

Author information




B.S. devised the project. B.S. and E.G. supervised the project. K.H., M.S., and E.G. processed the data. K.H. and E.G. analyzed and interpreted the patient data with the contribution of E.F. K.H. took the lead in writing the manuscript in consultation with E.G., M.S., M.M., T.B., and E.F. All authors read and approved the final manuscript.

Corresponding authors

Correspondence to K. Hebbrecht or E. J. Giltay.

Ethics declarations

Ethics approval and consent to participate

Our study was approved by the Committee for Medical Ethics of the University Hospital Antwerp and the Antwerp University: protocol number B300201837075. The study complied with the Declaration of Helsinki. Data were gathered using ROM and Good Clinical Practice. Patients were informed of ROM data collection, and we requested patients’ permission to use their data for research. The two patients presented in the case reports provided consent for publication. In order to secure patients’ confidentiality, all patient-identifiable data were removed from the database.

Competing interests

The authors have no conflict of interest to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Sample R script for paper.

Additional file 2: Figure S1.

Network plots based on the DTW analyses in the 255 patients. We compared the network structure based on all data from all patients, and the analyses based only on symptoms that did not score as 0 throughout the follow-up. Such symptom pairs with scores of 0 will result in a distance of 0, solely because they were absent in some patients. Figure S2. Average DTW distance according to response and remission, including symptoms that scored zero throughout the hospitalization. Figure S3. Network plots based on the DTW analyses in 231 of the 255 patients, who had a clinical diagnosis of either MDD of BD. We compared the network structure [A and B] and calculated the mean distance only on symptoms that did not score as 0 throughout the follow-up. Although the network structure was largely similar, on average patients with BD had a denser distance matric than patients with MDD (P=0.0028). Figure S4. Network plots of two subsamples [A and B] of the 255 patients. We used an automated split with a subset of 128 and 127 patients, in which we conducted separate DTW analyses. Node placement was done by using the Procrustes algorithm (from the R Package ‘networktools’), to aid the visual comparison between the two networks. As a result, configurations were brought into a similar space in which statistically meaningless differences were removed without changing the fit. This analysis showed that the network (based on each of the average distance matrixes were stable. The congruence coefficient was high at 0.994, when we compared both sets of compromise factors derived from each Distatis analysis.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Hebbrecht, K., Stuivenga, M., Birkenhäger, T. et al. Understanding personalized dynamics to inform precision medicine: a dynamic time warp analysis of 255 depressed inpatients. BMC Med 18, 400 (2020).

Download citation


  • Major depressive disorder
  • Routine outcome monitoring
  • Cluster analysis
  • Symptom dynamics
  • Inter-individual variation
  • Intra-individual variation
  • Symptom trajectories