Professional Documents
Culture Documents
An Interdisciplinary Journal
Copyright © 2015 ASCR Publishing House. All rights reserved.
ISSN: 1224-8398
Volume XIX, No. 4 (December), 299-311
ABSTRACT
The ambition to understand why and how psychotherapy works has guided
theorists, researchers, and practitioners for decades. This has led to an
accumulation of literature, both theoretical and empirical, exploring the
mechanisms that facilitate change in the psychotherapeutic process. Over the past
decades there has been considerable advancement in the areas of investigating the
psychotherapy process (i.e., course of change, predictors of outcome, mediators
and moderators of change). The primary aim of our paper is to draw attention to
the importance of studying mechanisms of change and to delineate the most
important theoretical and methodological milestones for evaluating the processes
through which clinical change occurs. We first discuss prior work addressing
mechanisms of change and argue how mechanisms are linked to other related
concepts. We then outline several strategies in data analysis and briefly discuss
their role in investigating mechanisms of change. Finally, we suggest key
recommendations to be considered by researchers designing studies investigating
mechanisms of change in psychological treatments, as well as recommendations
for future research in this area.
*Corresponding author:
E-mail: ramonamoldovan@psychology.ro
300 R. Moldovan, S. Pintea
group treatment), these variables are moderators (Kazdin, 2007). To show that a
variable is a moderator of treatment the variable must be a baseline or pre
randomization characteristic (in other words, it precedes treatment); second, the
variable must be uncorrelated with treatment; third, the variable has to be shown to
have an interaction effect with treatment on the outcome, that is ”explain”, in a
statistical sense, individual differences in the treatment effects (Kraemer et al.,
2002).
Clearly, the mediator is proximal to the mechanism of change and also
necessary (though not sufficient) for demonstrating mechanisms of change; in the
following section we concentrate on several methodological and statistical aspects
related to mediation testing in randomized clinical trials.
hypotheses need to be derived from the theory underpinning the treatment and
formulated in terms of the putative mechanisms of change of the treatment
investigated. Then, the treatment, the putative mediators and the outcome need to be
clearly operationalized and appropriately assessed (Murphy, Cooper, Hollon, &
Fairburn, 2009).
There are two important features of the typical RCT design that can limit
researchers' ability to address questions of process and mechanisms of change
(Laurenceau et al., 2007). First,all measures are usually performed at pretreatment
and again at post treatment; this often used pre–post design is not effective for
adequately examining hypothesized mechanisms of change (Collins & Graham,
2002). Second, even when an outcome is measured at multiple points between the
beginning and end of treatment, rather few studies include measures of putative
mediators at multiple points between pre- and post-treatment; it is preferable to
obtain a minimum of three or more repeated measurements in order to adequately
evaluate a mediation model. Nevertheless, even with a pre–mid-post design, the
mediation effect can vary dramatically depending on the measurement interval used
to assess the putative mediator (Collins & Graham, 2002; Laurenceau et al., 2007)
(say, for instance, the middle assessment is far from the period when the treatment
has its strongest effect on the mediator).
next review the most frequently used methods, delineating their underpinning
theoretical principles and procedures. RCTs have the advantage of providing
longitudinal data therefore we are not explicitly addressing cross-sectional
mediation procedures, but suggest solutions for mediation with longitudinal data. A
number of comprehensive reviews detailing the limitations of cross-sectional
mediation procedures when applied to longitudinal data are available (MacKinnon,
2008; Cole & Maxwell, 2003,Gollob & Reichardt, 1985).
The difference scores solution. RCTs with two waves data (pretest-posttest
measures) offers the simplest case of longitudinal data. In such cases, one solution
to testmediation is using difference scores (or delta change scores). In other words,
the difference between the first and second measure of the mediator and the
outcome is calculated for each individual, and these difference scores are used in
the mediation equations (Baron & Kenny, 1986), along with the independent
variable, coded as a dummy variable.
One of the major advantages of this solution is that it includes information
about the dynamics of the mediator and the outcome. Even if in RCTs the timeline
between treatment and mediator or between treatment and outcome is clearly
established, the timeline between mediator and outcome is not always empirically
demonstrated. If the mediator and the outcome are measured simultaneously, the
statistical relationship between changes found in those variables does not show
which one has changed first. In order to overcome this limit, a growing body of
literature (Gelfand et al., 2009; DeRubeis & Feeley, 1990; Tenhave et al., 2007)
suggests that the temporal order between the mediator and the outcome should be
empirically investigated based on changes observed in these variables using non-
overlapping periods of time to reduce temporal ambiguity.
The ANCOVA solution. Another procedure that uses the baseline adjustment is the
analysis of covariance (ANCOVA). In a RCT, the mediator and outcome baseline
scores are included as covariates in the analysis. We indicate bellow the equations
for such a procedure, treated as regression (the treatment variable X is dummy
coded, the mediator is M and the outcome is Y). We have excluded the intercept
and the residuals from each of the following equations, in order to simplify the
presentation and make it more comprehensible.
In these equations there are two estimators of the mediated effect: ab1 for
the longitudinal relations and ab2showing the relation across time for a and within
time for b2. Among the two estimators, ab1has more support as it reflects change
across time (Cole & Maxwell, 2003; McKinnon, 2008).
Two other models are frequently suggested when dealing with longitudinal
data: the autoregressive model and the Latent Growth Curve (LGC) model. Both
models show good potential for use in data obtained from RCTs. We will present
them briefly, concentrating more on their theoretical principles rather than their
technical aspects.
We further indicate the procedure for three waves data. The terms in
brackets are not included in the first autoregressive model; they represent the
contemporaneous relations among variables. Variable X, the experimental
treatment, remains the same in all equations.
M2 = a1X + s2M1
M3 = a2X + s2M2
Y2 = b1M1 + c′1X + s3Y1 (+ b3M2)
Y3 = b2M2 + c′2X + s3Y2 + (b4M3)
With three waves data, there are several mediated effects, estimated by
a1b1 for the first lag, a2b2 for the second lag, and a1b2 reflecting the temporal
ordering of the mediated effect. It is also possible to consider two lag effects
(effects two waves apart).
The second autoregressive model, is depicted in the same equations from
above, but including the terms in brackets. By including the contemporaneous
relations among variables, this second model can compute autoregression and
longitudinal mediation effects (autoregressive mediated effects are estimated by
a1b1and a2b2, and the longitudinal mediated effect is estimated by a1b2) as well as
contemporaneous mediation relations (estimated by a1b3 at time 2 and a2b4 at time
3).
The third autoregressive model violates the temporal precedence of X to M
to Y specified by the mediation model because paths in the reverse direction are
estimated as M to X and Y to M. In the context of a RCT, where the timeline
between the experimental treatment on the one hand and the mediator and the
outcome on the other is clear, the only cross-lagged relation that makes sense to be
tested is from the outcome to the mediator. As a consequence, the mediation
equations in such a case are as follows:
The Latent Growth Curve (LGC) Model solution. This model was developed in
order to overcome the limitations of the autoregressive models. In this case, the
mediation model examines whether the growth in the independent variable affects
the growth trajectory of the mediating variable which affects the growth trajectory
of the dependent variable (MacKinnon, 2008).
The solution of difference scores that we mentioned earlier for RCTs with
two data waves isin fact a particular case of the growth curve approach. For RCTs
with three or more data wavesthe mediation model examines whether the
experimental condition (i.e., treatment) affects the growth trajectory of the
mediating variable, which then affects the growth trajectory of the dependent
variable. The growth trajectory, for both the mediator and the outcome, is
represented by the slope factor which is specified in the model as a latent variable
(Cheong, MacKinnon, & Khoo, 2003).
The LGC model can be implemented in at least two versions: a single-stage
parallel process model and a two-stage piecewise parallel process model. The first
aims to demonstrate the relationships between treatment and changes in the
mediator and the outcome, without proving that a prior change in M is related to a
later change in Y. In the second version, the growth of the mediator and the
outcome process can be modeled separately for the earlier and for the later periods.
As a consequence, the mediated effects can be evaluated in different periods, as it is
more sensitive in estimating mediated effects when the trajectory shape changes
across time.
As one might expect, the LGC model is not perfect. The major criticism of
this model is that the measure itself may change over time, which may yield a
confusing representation of change over time.
With any of these mediational procedures in mind, it is important to note
that the mediated effects must be first tested for statistical significance; computing
the size of the mediated effect is also recommended. One way to test for the
significance of the mediated effect is to construct the confidence interval for the
mediated value and assess whether zero is included in the confidence interval.
Another way consists in calculating the standard error of the mediated effect (for
example using the formula derived by Sobel, 1982) and dividing the estimate of the
mediated effect by its standard error and by comparing this value to tabled values of
the normal distribution. Regarding the size of the mediated effect, there are three
categories of such measures: proportion or ratio measures, R squared measures and
standardized effect measures. Among them, one of the most common is the ratio
ab/c (where the ab is the mediated effect and c the total effect) which represents the
proportion of the total effect that is mediated. Such a measure has the advantage of
being easy to compute and also very intuitive.
Beyond the statistical procedures presented here, there are additional
methods to test for mediation such as the Autoregressive Latent Trajectory (ALT)
Model (Curran & Hussong, 2003; Bollen & Curran, 2004), differential equation
models (Boker & Nesselroade, 2002) and the Person-Centered Mediation Models
(Witteman et al., 1998). Yet as far as our goal is concerned getting into more details
might be redundant as there is a vast body of research addressing these very specific
issues.
REFERENCES
Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social
psychological research: Conceptual, strategic, and statistical considerations.
Journal of Personality and Social Psychology, 51, 1173-1182.
Boker, S. M., & Nesselroade, J. R. (2002). A method for modeling the intrinsic dynamics of
intraindividual variability: Recovering the parameters of simulated oscillators in
multi-wave panel data. Multivariate Behavioral Research, 37, 127–160.
Bollen, K. A., & Curran, P. J. (2004). Autoregressive latent trajectory (ALT) models: A
synthesis of two traditions. Sociological Methods and Research, 32, 336–383.
Borenstein, M. (1994). The case for confidence intervals in controlled clinical trials.
Controlled Clinical Trials, 15, 411-428.
Burr, J. A., & Nesselroade, J. R. (1990). Change measurement. In A. von Eye (Ed.),
Statistical methods in longitudinal research (Vol. I, pp. 3–34). New York:
Academic Press.
Cheong, J., MacKinnon, D. P., & Khoo, S. T. (2003). Investigation of mediational processes
using parallel process latent growth curve modeling. Structural Equation Modeling,
10, 238–262.
Cole, D. A., & Maxwell, S. E. (2003). Testing mediational models with longitudinal data:
Questions and tips in the use of structural equation modeling. Journal of Abnormal
Psychology, 112, 558–577.
Collins, L. M., & Graham, J. W. (2002). The effect of the timing and spacing of observations
in longitudinal studies of tobacco and other drug use: temporal design
considerations. Drug and Alcohol Dependence, 68, S85-S96.
Cronbach, L. J., & Furby, L. (1970). How should we measure “change” or should we?
Psychological Bulletin, 74, 68–80.
Curran, P. J., & Hussong, A. M. (2003). The use of latent trajectory models in
psychopathology research. Journal of Abnormal Psychology, 112, 526–544.
David, D., & Montgomery, G. (2011). The Scientific Status of Psychotherapies: A New
Evaluative Framework for Evidence-Based Psychosocial Interventions. Clinical
Psychology: Science and Practice, 18, 89-99.
David, D. (2004). Special issue on the cognitive revolution in clinical psychology: Beyond
the behavioral approach-Conclusions: Toward and evidence-based psychology and
psychotherapy. Journal of Clinical Psychology, 4, 447-451.
DeRubeis, R. J., & Feeley, M. (1990). Determinants of change in cognitive therapy for
depression. Cognitive Therapy and Research, 14, 469–482.
Doss, B. D. (2004). Changing the way we study change in psychotherapy. Clinical
Psychology-Science and Practice, 11, 368-386.
Elkin, I. (1999). A major dilemma in psychotherapy outcome research: Disentangling
therapists from therapies. Clinical Psychology-Science and Practice, 6, 10-32.
Gelfand, L. A., Mensinger, J. L., & Tenhave, T. (2009). Mediation analysis: a retrospective
snapshot of practice and more recent directions. The Journal General Psychology,
136, 153-76.
Gibbons, M. B. C., Crits-Christoph, P., Barber, J. P., Stirman, S. W., Gallop, R., Goldstein,
L. A., et al. (2009). Unique and common mechanisms of change across cognitive
and dynamic psychotherapies. Journal of Consulting and Clinical Psychology, 77,
801-813.
Gollob, H. F., & Reichardt, C. S. (1985). Building time lags into causal models of cross-
sectional data. Proceedings of the Social Statistics Section of the American
Statistical Association, 165–170.
Haaga, D. A. F., & Stiles, W. B. (2000). Randomized clinical trials in psychotherapy
research: Methodology, design, and evaluation. In Snyder, C. R., & Ingram, R. E.
(Eds.), Handbook of psychological change: Psychotherapy processes and practices
for the 21st Century (pp. 14−39). New York: Wiley.
Jacobson, N. S., & Truax, P. (1991). Clinical-significance - A statistical approach to
Defining meaningful change in psychotherapy-research. Journal of Consulting and
Clinical Psychology, 59, 12-19.
Judd, C. M., & Kenny, D. A. (1981). Estimating the effects of social interventions. New
York: Cambridge University Press.
Kazdin, A. E., & Nock, M. K. (2003). Delineating mechanisms of change in child and
adolescent therapy: methodological issues and research recommendations. Journal
of Child Psychology and Psychiatry, 44, 1116–1129.
Kazdin, A. E. (2007). Mediators and mechanisms of change in psychotherapy research.
Annual Review of Clinical Psychology, 3, 1-27.
Kazdin, A. E. (2009). Understanding how and why psychotherapy leads to change.
Psychotherapy Research, 19, 418-428.
Kazdin, A. E., & Weisz, J. R. (1998). Identifying and developing empirically supported child
and adolescent treatments. Journal of Consulting and Clinical Psychology, 66,
19-36.
Kraemer, H. C. (1993). Reporting the size of effects in research studies to facilitate
assessment of practical or clinical significance. Journal of Consulting and Clinical
Psychology, 17, 527-536.
Kraemer, H. C., Wilson, G. T., Fairburn, C. G., & Agras, W. S. (2002). Mediators and
moderators of treatment effects in randomized clinical trials. Archives of General
Psychiatry, 59, 877-883.