In The Expectation of Recovery
In The Expectation of Recovery
In The Expectation of Recovery
by George Faulkner
"In the
Expectation
of Recovery"
MISLEADING MEDICAL RESEARCH
AND WELFARE REFORM
by George Faulkner
Published by The Centre for Welfare Reform
Publishing Information
Recovery George Faulkner 2016
First published April 2016
"In the Expectation of Recovery" is published by the Centre for Welfare Reform
If you copy and reuse any part of the material in this report then you must always cite
both the author and the publisher and, whereever possible, provide a direct link to the
Centre for Welfare Reform's website.
www.centreforwelfarereform.org
Designed by Henry Iles: www.henryiles.com
64 pp
ISBN download: 978-1-907790-79-9
Acknowledgements:
While I take full responsibility for the fact checking and accuracy of this report, it is founded on the
work of others. As David Tuller says in the introduction to his recently published pieces on the PACE
trial, "much of what I report here will not be news to the patient and advocacy communities, which
have produced a voluminous online archive of critical commentary on the PACE trial". I do not know
who first raised many of the points highlighted in this report, so may not have given credit to those
who deserve it, but I hope that I have fairly and accurately presented the evidence in a way that does
justice to the work done by others.
Contents
Foreword. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
Summary. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
The Biopsychosocial Model . . . . . . . . . . . . . . . . . . . . . . . . . . 11
The responsibility to expect recovery. . . . . . . . . . . . . . . . . . . . . . . . . . 12
The PACE trial . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 14
1. What is 'Chronic Fatigue Syndrome'? . . . . . . . . . . . . . . . . . . . . . . . 14
2. The problem with self-reported outcomes. . . . . . . . . . . . . . . . . . . . 15
3. The presentation of results . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 16
The PACE trial's objective outcome measures . . . . . . . . . . . . . . . . . . . 16
Redefining 'recovery' . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 19
Conclusion. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Policy implications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Dangerous assumptions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 32
Appendix . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 35
1. Selected criteria from the PACE trial . . . . . . . . . . . . . . . . . . . . . . . . 35
2. Patient expectations and the danger of bias . . . . . . . . . . . . . . . . . . 39
3. Primary trial outcomes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 40
4. Exaggerated positive claims. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 42
5. Informed consent . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 43
6. Recent developments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 44
The Centre for Welfare Reform. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 60
Foreword
by Simon Duffy, Director of the Centre for Welfare Reform
This is the world weve created for ourselves, a world where sick
and disabled people are now expected to recognise that the sick
role is temporary, in the expectation of recovery.
How things get twisted. In the past there was a rather patronising
attitude that of course we should provide disabled people with an
income, because they 'can't work'. Against this disabled people have
had to assert their desire and their right to work. What is more, they
have gone on to show the valuable role that disabled people can play as
workers and, more importantly, as citizens.
But what happens when politicians are desperate to cut benefits? What
happens when private insurance companies want to increase their
market share? What happens when people start to value research for
positive results rather than accuracy?
As George Faulkner explains, in this important report, it seems that
standards for academic research can easily drop out of sight when the
political and financial conditions are right. A treatment is hailed as a
great success, but pain and fatigue have been reclassified as recovery,
and now medical researchers fight to keep important information
from the public. Furthermore misleading medical research is disguised
behind layers of complex jargon and statistical manipulation. It takes
careful work to expose the array of falsehoods that lie hidden behind
the press releases, research papers and briefings.
Addressing the problems that George Faulkner outlines will take more
than a renewed sense of intellectual rigour and honesty by researchers.
More fundamentally we need to pay much more attention to our
basic human instinct to turn groups with little political power into
scapegoats for social problems that they clearly did not create.
I am honoured that independent researchers like George Faulkner
continue to use the Centre for Welfare Reform to publish and share
such important research. I hope that this research helps to further
strengthen the confidence of all those fighting injustice and resisting
the ongoing efforts to undermine the welfare state.
Summary
Recent government reforms to UK disability benefits have been
presented as an attempt to improve the lives and increase the
opportunities of disabled people, yet the available evidence indicates
that they have not been successful in this regard.
The 'biopsychosocial' model of disability has played an important
role in shaping these reforms, and is often portrayed as providing an
evidence based approach to the management and understanding of
disability.
This report will show how important claims about the value of
biopsychosocial approaches have been founded upon evidence which
was already potentially misleading, but has also been exaggerated and
distorted in ways that further misrepresent the reality of living with ill
health and disability.
The Biopsychosocial
Model
When ill health and disability limits people's ability to compete
in the labour market, opportunities are lost and costs created
for the individual, the welfare system, private insurers, potential
employers and society at large. It is in everyone's interest to see
those with health problems recover, and efficacious treatments
for common health problems would help us to avoid difficult
decisions about our priorities as a society. There will always be a
desire to curtail the cost of supporting those with ill health and
disabilities, yet this is balanced against a wish to avoid further
reducing the quality of life of those already facing hardship.
While effective medical treatments and rehabilitation would
help to minimise this dilemma, medical science does not always
progress at the speed we would like. That is not to say that
people will be unable to find research which tells them what
they want to hear.
Recent reforms to disability benefits have been founded on, and justified by, the
biopsychosocial model of disability. This model emphasises the role an individual's
cognitions, behaviour and social setting can play in perpetuating disability and a reliance
on benefit payments, while assuming that these factors can be altered and managed in
ways which help to restore functionality. Such an approach to disability and ill health
raises fundamental questions about the extent to which benefit claimants bear personal
responsibility for their own rehabilitation and return to work. It also leads to the concern
that a welfare system which provides a livable income to those with disabling health
problems may entrench worklessness and a culture of dependency. Instead of being
viewed as a way of diversifying risk and supporting those who have suffered misfortune,
social and private insurance systems can be understood as perverse incentives that pay
people to remain ill and keep them from the paid work which could be the most effective
treatment available to them.
To many people these concerns have an intuitive appeal, fitting with their own
ideological perspectives, yet they should still be treated with caution when they have
the potential to so profoundly impact the lives of those relying upon disability benefits.
Collecting robust evidence on the psychological and social aspects of disability is difficult
and problems with the systems surrounding medical research can lead to unfounded
and exaggerated claims. In this report a particularly large and expensive medical trial,
the first to have received funding from the Department of Work and Pensions (DWP),
will be used as an example of the problems which can affect medical research and
11
12
distort our understanding of important issues. This trial led to misleading claims about
biopsychosocial rehabilitation's recovery rates and attempts to discredit those seeking the
release of information which would have helped correct these misunderstandings. These
problems will be placed within the context of the use of the biopsychosocial model to
change the British state's relationship with those who live with ill health and disability.
Recent attempts to cut the cost of disability benefits may have been sold with the
rhetoric of empowerment and emancipation yet convincing evidence that they've led to
real improvements in the lives of disabled people has yet to be produced. The government
has refused to conduct a cumulative impact assessment on the effect of their changes on
the lives of disabled people[1], but recently released government figures report that the
proportion of disabled people who do not believe that they frequently have "choice and
control" over their lives has increased from 24% in 2008 to 35% in 2014[2-4].
Atos, the firm first contracted by the DWP to carry out their new assessments
of claimants for disability benefits, has stated that their examinations follow a
biopsychosocial model[5], yet generally disabled people do not see these assessments
as having helped to improve their lives[6-13]. Treating people as if they have more
power to overcome the burden of their health problems than they actually do can be
disempowering, even without the threat of a further loss of income. The good news
that one's health is less of a restriction than one believes needs to be accurate before it
can be welcomed, so it is important that the claims made about people's ability to find
employment, and the value of rehabilitative approaches, are reasonable and supported
by the evidence. Attempts to create a more positive outlook, and confident attitude, can
destroy trust, promote prejudices, and leave those suffering with health problems even
more isolated from society.
Within this report suggestions will be made for both the development of policy
and medical research in an attempt to help reduce the likelihood of similar problems
occurring in the future.
"we have gone for the biopsychosocial model. That model has now garnered very
significant academic support, as those noble Lords to whom I sent that very
interesting piece of research will recognise."[14]
The circulated document had been written by Mansel Aylward and Gordon Waddell[15].
At the time of the debate Aylward, a former DWP chief medical officer, ran the Unum
Provident Centre for Psychosocial and Disability Research[16] while sitting on Atos
Healthcare's Clinical Governance Board.[17] He had helped develop LiMA, the software
used in Atos's disability assessments.[18] Their document laid out the biopsychosocial
model and explained that this model promoted a new conception of the 'sick role' which
served to dramatically increase the responsibilities of those living with health problems,
stating that "there needs to be a fundamental shift in the culture that surrounds work and
health, sickness and disability, and incapacity benefits."[15]
The biopsychosocial model allowed the banal observation that psycho-social factors
play an important role in how people feel and behave to be used as an excuse for dramatic
changes in the way the state interacts with those who have disabilities and ill health, even
though all human experience will include a psychological and social component. Those
with 'common health problems' are told that they must now recognise that "rehabilitation
depends on your own motivation and effort" and new obligations for these patients are
listed, such as:
"Recognize that the sick role is temporary, in the expectation of recovery
Be motivated and cooperate with rehabilitation"
So what are 'common health problems' and how good is the evidence that the
rehabilitative approaches patients supposedly have a responsibility to engage in truly
lead to the recovery which we are now told they should expect? The document cites a
DWP report, also co-authored by Gordon Waddell, Concepts of rehabilitation for the
management of common health problems. [19] Here it is claimed that 'common health
problems' "cause most long-term disability and incapacity" and "often consist primarily of
symptoms with limited evidence of objective disease or impairment" while "the obstacles
to recovery are often predominantly psychosocial in nature rather than the severity of
pathology or impairment."
On the matter of recovery it is stated that the biopsychosocial model changes how
disability is approached:
"it is no longer what makes some people develop long-term incapacity, but
why do some people with common health problems not recover as expected?
The development of long-term incapacity is a process in which biopsychosocial
factors, separately and in combination, aggravate and perpetuate disability.
Crucially for the present argument, these factors can also act as obstacles to
recovery and return to work. The logic of rehabilitation then shifts from attempts
to overcome, adapt or compensate for impairment to addressing factors that
delay or prevent expected recovery. Thus, management for common health
problems must specifically address and overcome those factors acting as obstacles
to recovery."
While this may sound like good news, the poor quality of the evidence supporting
biopsychosocial theories and approaches needed to be repeatedly recognised within the
report. The two areas where it was claimed there was stronger evidence were low back
pain and Chronic Fatigue Syndrome (CFS). For CFS it was stated that "there is promising
evidence on the effectiveness of graded exercise combined with cognitive behavioural
therapy". When Mansel Aylward was Chief Medical Adviser at the DWP he helped secure
DWP funding for a trial testing the efficacy of these interventions for CFS, and went on
to sit as an observer on the Trial Steering Committee.[20,21] Evidence to support the claims
being made about the value of the biopsychosocial model was needed and the 5+ million
PACE trial, the largest and most expensive of its kind, was expected to provide it.[22,23]
13
14
There are a wide range of contradictory views on CFS, with disagreement even on who
should be considered to have the condition. The PACE trial required all patients to fulfil
the Oxford criteria for CFS, a definition which has been widely criticised and requires
only that a patient has severe and disabling fatigue as the principal symptom, that other
fatiguing diseases have been excluded, and that the fatigue is not life-long but has lasted at
least six months.[24,25] A report for the National Institutes of Health recently recommended
that the Oxford criteria be retired, stating that "continuing to use the Oxford definition
may impair progress and cause harm".[26] Nonetheless, patients were selected for the
PACE trial using the Oxford criteria, and so this is how CFS will be defined within this
report (see the Appendix for more details on the Oxford criteria).
Beyond concerns about the specific criteria for diagnosing CFS, there are even
broader concerns about the value of Chronic Fatigue Syndrome as a label, with another
recent report, this one from the Institute of Medicine, concluding that 'Chronic Fatigue
Syndrome' was a misleading and unhelpful term which can lead to stigmatisation and
trivialisation of patients' health problems while placing undue emphasis upon 'fatigue'
(a concern shared by many patient organisations).[27] Despite the controversies and
uncertainty that surround CFS, it seems widely believed that patients with a range of
different and poorly understood health problems are being given the diagnosis and
that many of these people continue to be treated unfairly. The chair of the UK CFS/ME
Research Collaborative summarised the current understanding of CFS by stating that:
The patients receiving CBT and GET were told during treatment that these therapies had
already been shown to be effective and were provided with models of their illness that
emphasised their own ability to alter their behaviour in a way that would actively improve
their symptoms, while these claims were not made to those in the other two groups.[35]
Self-report outcomes can be affected by peoples' desire to be viewed favourably by
others. This is known as social desirability bias.[36] The therapists providing both CBT and
GET were trained to encourage gradual increases in activity (mostly walking for GET)
15
while in contrast those providing APT were told to encourage patients to follow the 70%
rule: never going beyond 70% of your perceived energy limit.[35] Approaches to illness
which emphasise patients' ability to overcome the limitations of their health through their
own efforts increase the danger of social desirability bias distorting self-report measures:
there's an added incentive to reporting an improvement in symptoms if you feel that
you can take some credit for it. The psychosocial components of CBT and GET included
elements intended to affect how patients think about their symptoms, possibly improving
self-report questionnaire scores merely by altering how patients view and talk about their
symptoms or disability without there being any real change in symptoms or disability.
These aspects of the PACE trial all added to the likelihood that self-report questionnaires
would be unreliable measures of patients' actual symptoms and disability.
16
Another potential problem with medical trials is that researchers can make important
decisions about the presentation of results that dramatically alter how these results are
interpreted. When researchers want to be associated with successful interventions there
is a danger that they have an incentive to misrepresent their own data. To help avoid
problems with results being spun in this way, before all data had been collected the PACE
research team published a trial protocol which laid out how results were to be analysed
and released.[37] Whilst publishing the protocol after the trial had already started was not
ideal, as non-blinded trials will allow researchers a sense of treatment efficacy even before
results are collected, this protocol should still have reduced the danger of results being
presented in a misleading manner.
The decision to not measure the effect of these interventions on patients' activity levels
was therefore a surprising one.
The explanation for this decision provided by the PACE team was that while they had
intended to use actometers as an outcome measure, it was then decided "that a test that
required participants to wear an actometer around their ankle for a week was too great a
burden at the end of the trial".[38] After the PACE trial's protocol was published actometer
results from three earlier trials of CBT for CFS were released.[42] If real improvements
in patients' disabling fatigue were occurring as a result of CBT, then one would expect
treatment to allow patients to increase their activity levels, yet this data showed that CBT
led only to improvements in self-report measures and did not lead to increases in patients
actual activity levels.
In response to broader concerns about the lack of objective measures of outcome, the
PACE team stated that:
We have used several objective outcome measures; the six-minute walking test, a
test of physical fitness, as well as occupational and health economic outcomes.[38]
Results for these outcomes have now been released and they show that, despite adherence
to treatment being rated highly for both CBT and GET, CBT did not lead to improvement
in employment, physical fitness, or 6-min walking test outcomes.[20,43,44] GET did not
lead to improvement in employment or physical fitness, and the six-minute walking test
showed an improvement that was statistically significant but fell short of the criteria used
elsewhere in the trial to define a clinically useful difference.[20,43,44]
The poor results from these more objective outcome measures have not been focused
upon by the trial's researchers, who have chosen not to mention them in the abstracts of
any of the nine papers they published on the PACE trial since results have been
released.[20,43-51] Nor, as we will see, have they led to a more tempered promotion of the
results for the trial's more subjective self-report measures. Table 1 shows the result of the
subjective self-report measures.
Data from the non-blinded PACE trial showed that randomisation to CBT and
GET was associated with greater improvements in self-reported fatigue and physicalfunctioning questionnaire scores at 52 weeks post randomisation, but we cannot know
if this reflects any genuine improvement in patients' health. Results for the trial's more
objective outcome measures would seem to indicate that it does not. Results for the PACE
trial's primary outcome measures were not released in the manner laid out in the trial's
published protocol.
17
160 assigned
to SMC alone
161 assigned
to SMC+CBT
160 assigned
to SMC+GET
160 assigned
to SMC+APT
Likert Chalder
Fatigue
Questionnaire
(CFQ): mean
(SD)
283 (36)
277 (37)
282 (38)
285 (40)
SF36-Physical
Functioning
scale: mean
(SD)
392 (154)
390 (153)
367 (154)
372 (169)
8 lost to follow
up
14 withdrew
13 lost to
follow up
17 withdrew
6 lost to follow
up
10 withdrew
6 lost to follow
up
11 withdrew
157 analysed
155 analysed
159 analysed
159 analysed
Reported results
at 52 weeks post
randomisation[20,45]
SMC
SMC + CBT
SMC + GET
SMC + APT
Likert CFQ:
mean (SD)
23.8 (6.6)
20.3 (8.0)
20.6 (7.5)
23.1 (7.3)
Mean CFQ
difference from
SMC (95% CI)
34 (50 to
18)
32 (48 to
17)
07 (23 to
09)
58.2 (24.1)
57.7 (26.5)
459 (24.9)
Mean SF36-PF
difference from
SMC (95% CI)
Baseline scores
18
'Back to
normal'
15%
30%
28%
16%
Trial recovery
7%
22%
22%
8%
Clinical
recovery
7%
21%
21%
8%
Redefining 'recovery'
When results from the PACE trial were first released in The Lancet in 2011, they led
to widespread claims of a recovery rate of just under a third for CBT and GET, with
the British Medical Journal reporting that 30% and 28% of patients respectively had
been "cured" by these treatments.[52-59] These claims were not based upon results for the
recovery criteria laid out in the trial's protocol, but upon a new outcome devised by the
trial's researchers after they had seen the trial's results.[20]
Accompanying the release of results was a Lancet commentary, reviewed and approved
by the trial's researchers, which claimed that "about 30%" of patients who'd received CBT
and GET satisfied a "strict criterion for recovery", even though the criterion used was in
fact so loose that patients could have reported a worsening of all their symptoms during
the trial and yet still been classed as recovered.[54] The PACE team had created a post-hoc
outcome for patients who had an SF36-Physical Function score of 60 or over and a
Chalder Fatigue Scale score of 18 or under, describing these patients as "back to normal"
to the media and in a leaflet for patients.[59,60] This meant that, even ignoring potential
problems with bias on self-report questionnaires, patients could start the trial being
classed as suffering from fatigue which was severe and disabling, then report a worsening
of both their fatigue and physical functioning following treatment, and yet still be classed
as "back to normal", "recovered" and "cured".[20,52-54,59,60]
Within the Lancet paper these participants were described as "within normal ranges for
both primary outcomes at 52 weeks", with these normal ranges having been newly created
for this paper in response to a suggestion made during peer review.[20] The new SF36-PF
and Chalder Fatigue Questionnaire normal ranges were the foundation of the PACE
team's "back to normal" outcome, and also for later released criteria for "trial recovery"
and "clinical recovery". These new ranges differed from those described in the PACE trial
protocol, and there were problems with the justifications for changing both.
For the Chalder Fatigue Questionnaire, patients could now be counted as recovered
even if they had a Likert score of up to 18 (out of 33, with a higher score indicating
greater fatigue), when that is worse than the score of 12 which patients could have
reported at the start of the trial when being classed as suffering from fatigue which was
"severe, disabling and affects physical and mental functioning".[20,22,24] This change to the
'recovery' criteria was justified by reference to a paper recently published[61] by one of the
PACE trial's principal investigators (Trudie Chalder) which re-analysed data collected for
a paper which she had co-authored in 1994[62], long before the PACE trial's protocol was
written and published.[37] This 'new' data was used to claim that higher levels of fatigue
within the general population justified a looser interpretation of fatigue scores both in the
initial Lancet paper, and in their later publication dedicated to the PACE trial's recovery
rates.[45] Further information on the Chalder Fatigue Questionnaire and how it is scored is
available in Appendix.
For the Physical Functioning Questionnaire (SF36-PF), the trial protocol had required
patients to have a score of at least 85 (out of a maximum of 100, with a higher score
indicating greater physical function) in order to be classed as recovered, while those
scoring 75 or more, or whose score improved by 50% or more, could be counted as
having a "positive outcome".[37] A score of 65 or under was part of the trial's entry criteria,
which required that patients be suffering from fatigue which was "severe, disabling and
affects physical and mental functioning".[20,22,24]
19
20
Once the trial was over the PACE team decided that those scoring as low as 60 could
be counted as recovered. The claim that patients with a score of 60 had returned to a
normal level of physical functioning was initially justified by stating that 60 was "the
mean minus 1 SD scores of the UK working age population of 84(24)"[20,60], but it was
later acknowledged that this mean and standard deviation was from a population which
included the scores of all those aged over 65.[63] As people tend to report lower levels
of physical functioning when they get older this lowered the sample's mean physical
function score as well as increasing the standard deviation. The mean minus 1 SD for
those of working age was actually 71.[64,65]
The PACE team had chosen new SF-36 PF population data to devise their new normal
range, and it was reported that they now "believed this to be the most representative study
for the trial sample".[66] Fortunately, the new population data cited by the PACE team is
available at the UK Data Archive, allowing us to look more closely at the validity of the
justifications used for their redefinition of recovery.[64,65] After acknowledging that they
had included data from elderly members of the population to derive a score of 60, the
PACE team then again used a cut-off of 60 in their later paper specifically on recovery
rates from the PACE trial.[45] They reported that the recovery criteria pre-specified in the
trial's protocol was abandoned as a cut-off 85 was too demanding, supposedly meaning
that approximately half the general working age population would fall outside the
normal range. The data they cite actually shows that only 17.7% of the general working
age population, including all those with short and long-term health problems, scored
under 85 (illustrated in Figure 1)[65]. Furthermore, the trial's protocol indicates that the
criteria for recovery (which included requiring that patients have a physical functioning
score of 85 or over) was intended to be more demanding than the criteria for the mean
-1SD normal range, stating that "A score of 70 is about one standard deviation below the
mean... for the UK adult population.[37]
1,000
800
600
frequency in
working-age
sample
400
200
0
10
15
20
25
30
35
40
45
50
55
SF36-PF score
60
65
70
75
80
85
Source: Frequency of SF-36 Physical Functioning scores within the working-age population, including
all those suffering from ill health and disability. OPCS Omnibus Survey, November 1992
90
95 100
While one of the PACE trial's principal investigators has argued that the inclusion of
some elderly patients among the PACE trial participants means that it is fair to compare
results to scores from a population including all those aged over 65, only 3% of the PACE
trial's participants were aged 60 and over[67], compared 32% of the population actually
used to define the recovery criteria, which would be reduced to 9% if those aged 65
and over are removed from the sample.[65] The PACE trial's participants were actually a
marginally younger group than the working age sample, with a mean age of 38 (SD 12)
compared to 40(13), while the general population data actually used by the PACE team
had a mean age of 48(19).[65,67]
The data cited by the PACE trial, and illustrated in Figure 1, shows that the majority of
the working age population reported the maximum SF36-PF score of 100, and that 91%
of this population scored over 60, even though 15% reported having a long term health
problem and an additional 13% reported needing to visit their doctor in the previous
two weeks.[65] Within the PACE trial's recovery paper it was claimed that another study
assessing recovery after CBT for CFS had used a similar criteria to their own, "but the
definition for normal range used was the more liberal population mean -2 SD rather
than the more conservative 1 SD that we used".[45] This was not true, and the study cited
actually used a more stringent criteria of "the mean plus (or minus) 1 standard deviation
(SD) of the healthy population", requiring patients to have an SF36-PF score of at least
80.[68] Claiming that those patients scoring just 60 had been returned to a normal level
of function, and could be considered recovered, served to mislead people about both
the efficacy of the treatments developed by the PACE trial's principal investigators, and
the extent to which managing patients' cognitions and behaviours could help them to
overcome their health problems.[52-60]
For the PACE trial's later, and less widely covered, recovery paper[45] there were also
additional components to the recovery criteria, which again deviated from those laid out
in the trial's protocol. [37] Patients were asked to self-rate their health improvement, giving
a score from 1-7 with 1 representing "very much better" and 7 "very much worse". The
protocol recovery criteria had required patients have a score of 1, but this was changed to
include those with a score of 2, representing 'much better'. No research was cited to justify
this change, just the researchers' claim that they now "considered that participants rating
their overall health as much better represented the process of recovery.
In order to satisfy the 'trial recovery' criteria[45] it was stated that patients could
not simultaneously fulfil the Oxford criteria for CFS, and this was not presented as a
deviation from the protocol recovery criteria. However, by the time of the recovery paper
it was decided that fulfilling the Oxford criteria now required that patients have a Chalder
Fatigue Questionnaire score of 6 or more and a SF36-PF sub-scale score of 65 or less. In
the 2011 Lancet paper those requirements for entry to the trial were described separately
from the Oxford criteria, and listed as "other eligibility criteria". During the screening
process for the PACE trial 235 patients were excluded because they reported a SF36-PF
score of over 65 and 29 were excluded for have a Chalder Fatigue score of less than 6,
separately from the 1011 excluded for not fulfilling the Oxford criteria.[20] It appears that
this was an undeclared deviation from the trial's protocol. The entry criteria for the FINE
trial, described as PACE's sister trial, also required the Oxford criteria for CFS be fulfilled,
but included patients who had a SF36-PF score of 70, and a bimodal Chalder Fatigue
score of 4. Patients who fulfilled the most demanding recovery criteria for which results
were released from the PACE trial could still have fulfilled the entry criteria for FINE, and
been considered to suffer from severe and disabling
fatigue. [159]
21
"the requested data relating to the recovery rates and positive outcomes do not
exist."[70]
22
More recently it was argued that performing the analysis needed to generate these results
would cost more than the appropriate limit laid out in the Freedom of Information
Act (450): supposedly Queen Mary University of London, who hold the data, would
need to hire and train a new statistician in order to do the work.[71] It is surprising that a
university does not already employ someone able to perform this analysis.
Regardless of the justification given it is clear that the PACE team do not want to
release this information, and there have even been attempts to stigmatise concerns about
the PACE trial and the way in which CBT and GET have been promoted, presenting
complaints as stemming from an unreasonable opposition to psychiatry, while Freedom
of Information requests are portrayed as a form of harassment.[56,72-79] These attempts
may now be starting to crumble, with researchers from outside the interconnected
community of British medical research beginning to intervene. Last year an article in
the American Psychology Association's magazine, Monitor, reported that a number of
experts have taken issue with the PACE trial's definition of recovery[80] and an Australian
researcher wrote a commentary which focused on problems with the way the PACE trial's
team presented their results on recovery.[81] This was followed by an Evidence Review
conducted for the American government which singled out the PACE trial's new recovery
criteria for criticism, describing it as "contradictory".[82] Even the British Medical Journal,
having played an important role in attempts to discredit concerns about the PACE
trial[52,73], recently published an editorial by two (non-British) long-term supporters of
CBT and GET for CFS acknowledging problems with the "unduly liberal" way recovery
was defined in the PACE trial.[83] A summary of more recent developments is included in
the Appendix.
Conflicts of Interest
The failure to release results for the pre-specified analyses laid out in the PACE trial's
protocol is of particular note as concerns had already been expressed about the
ideological biases of the trial's three principal investigators. All three have built their
careers upon the development of biopsychosocial interventions for CFS, and the two who
had been part of the Chief Medical Officer's CFS working group both resigned because
the active biopsychosocial approaches of CBT and GET were not endorsed over 'pacing'
in the way that they had wanted.[84-86] The trial's protocol reported that "all staff involved
in the PACE trial recorded their expectations as to which intervention would be most
efficacious"[37], and while this data has yet to be released it seems reasonable to assume
that the trial's principal investigators favoured CBT and GET.
All three principal investigators also reported conflicts of interest involving the
insurance industry.[20] There has long been concern about private insurance companies
influencing changes to the UK welfare state, a system of social insurance that they must
compete against.[8,87-90] These concerns seem likely to continue following reports of
David Cameron's interest in encouraging individuals to fund their own unemployment
or sickness benefits privately through financial products.[91,92] When Michael ODonnell
was the Chief Medical Officer at Unum insurance (and before he moved on to Atos, and
then Maximus[90]), he wrote an internal document promoting the biopsychosocial model
and claiming that Unum's thinking, along with that of their close associates, was driving
government policy.[93,94] More recently Unum funded a report from the think-tank Demos
which encouraged the UK government to use private financial products to supplement
social welfare.[95]
Back in 1995 a Unum report on CFS stated that they could "lose millions if we do
not move quickly to address this increasing problem".[96] It was argued that CFS claims
should be managed "more aggressively and in a proactive rather than a reactive fashion"
while attempting to present CFS as "neurosis with a new banner". Emphasising the
importance of psychosocial factors and classing CFS as a mental health problem could
bring immediate financial benefits to insurance companies when policies limit payouts
for mental health problems. One of the PACE trial's principal investigators gave a
presentation on the results of the PACE trial to Swiss Re insurance. Swiss Re's report of
his talk detailed the potential use of mental health exclusions to cut payments[97], while a
2013 Swiss Re presentation on their approaches to mental health problems describes their
use of specific exclusions for CFS and ME.[98]
During the Swiss Re presentation on PACE no mention seems to have been made of the
fact that PACE found neither CBT nor GET were associated with improved employment
outcomes, and instead Swiss Re's claims managers continued to be encouraged to believe
that promoting these active rehabilitative approaches would assist return to work.[97]
There has been concern about insurance companies pushing some patients with CFS to
take part in CBT and GET against their wishes. A response to the paper which published
the PACE trial's data on employment outcomes was titled Coercive practices by insurance
companies and others should stop following the publication of these results[99], but has yet to
receive a response from the PACE team.
23
In 2006 a Parliamentary All Party Group inquiry into CFS/ME claimed that:
"There have been numerous cases where advisors to the DWP have also had
consultancy roles in medical insurance companies. Particularly the company
UNUM Provident. Given the vested interest private medical insurance companies
have in ensuring CFS/ME remain classified as a psychosocial illness there is
blatant conflict of interest here. The Group find this to be an area for serious
concern and recommends a full investigation of this possibility by the appropriate
standards body."[100]
Perverse incentives
"It is difficult to get a man to understand something, when his salary depends
upon his not understanding it!"[101]
24
"Of course, investigators working in any field are likely to resist accepting that the
whole field in which they have spent their careers is a 'null field'."[103]
It is not just those researchers directly involved in the biopsychosocial project who have
incentives to avoid recognising the problems with research in this area, but also the
network of journals, research funders and universities whose own reputation and prestige
might be damaged by acknowledging error, exaggeration and incompetence. When
the biopsychosocial model serves the interests of so many of those with authority and
influence it increases the danger that legitimate criticism will be resisted and denounced
rather than recognised and acted upon.
The first time a trial indicated that CBT was no more effective than placebo at allowing
CFS patients to increase their activity levels[104] those who had developed CBT for CFS
argued that this result meant that the CBT could not have been conducted properly, as
patients who were not able to increase their activity levels as a part of the therapy would
have needed to drop out, leaving only those with raised activity levels to complete the
programme:
"At the heart of CBT is a behavioral approach to the impairment of activity that
is part of the definition of CFS" and
A REPORT FROM THE CENTRE FOR WELFARE REFORM
"if a patient completes the program, he or she must have increased their
activity, even if everything else remains unchanged. We therefore suggest that
patients... may have attended the sessions, but did not comply with the program
by gaining targets and carrying out homework. If the patients were compliant
with the program, then by definition the number of sedentary hours must have
decreased."[39]
As evidence from other trials continued to indicate that CBT failed to increase patients'
activity levels, researchers in this area seemed to decide amongst themselves that actually
CBT should not be expected to lead to increases in activity, and that performing like a
placebo in changing only subjective self-report measures in non-blinded trials would
be all that is needed to claim success.[20,42,82,105] In response to concern that changes in
self-report outcomes in non-blinded trials of CBT may reflect only biases and placebo
response rather than real changes in health, particularly given the failure to improve
objective outcome measures, the PACE team merely asserted that self-rated outcomes
25
Research Distorted
by Politics
Cruel to be kind
"Behavioural approaches try to extinguish observed illness behaviour by
withdrawal of negative reinforcements such as medication, sympathetic
attention, rest, and release from duties, and to encourage healthy behaviour by
positive reinforcement: operant-conditioning using strong feedback on progress."
Waddell and Burton[19]
26
Emphasising the role that reversible psychosocial factors play in benefit claimants'
disability allows politicians to present plans to 'slash' welfare spending as a 'moral
mission' to help people overcome a culture of dependency.[110-122] Claiming that changes
to disability benefits are needed to account for 'today's understanding of disability',
supported by the work of medical researchers, helps politicians sidestep important moral
and political debates, even if the research is poor and the results misrepresented.[116-119]
Curing the sick would be a good way of cutting the social cost of disability, but if these
cures involve nothing more than encouraging people to complete questionnaires more
positively, and then changing how those questionnaires are interpreted, an emphasis on
'rehabilitation' is unlikely to be as useful as might be assumed.
Were a politician to argue that those whose health prevents them from working should
be refused disability benefits if they do not to try to adopt the cognitions, attitudes
and behaviour desired by the state many voters would instinctively recoil. They may
be less likely to do so in response to the argument that, instead of just 'writing-off '
disabled people to a life on benefits, it would be better to make benefits conditional
on co-operation with evidence-based rehabilitative approaches that will help people
re-engage with, and feel valued by, society. The power to re-label and re-classify, changing
official uses of language, helps academics and politicians further their own interests.
The general public will find it easier to understand an announcement that from now on
many of those who receive Incapacity Benefit will have payments reduced by nearly a
third, than the news that the incomes of those joining the Work-Related Activity Group
(WRAG) of Employment and Support Allowance (ESA) will now be aligned with that of
those on Job Seekers Allowance. Such tongue-twister labels makes communicating clearly
and concisely on these topics difficult.
The most recent disability cuts reduce ESA WRAG payments for new claimants from
102.15 a week to 73.10. A leaked Whitehall paper attempted to justify these cuts by
arguing that ESA was a "passive" benefit which does not "incentivise" people to find
a job.[120,121]
Calling for Labour to support the legislation making these cuts, George Osborne
argued that:
"We will protect the most vulnerable disabled people, pensioners, who cannot
change their circumstances, and those most in need."[122]
Those being encouraged to adopt positive beliefs about recovery and their ability to
change their circumstances may now be seeing these beliefs used as a justification for
cutting their income. This well-meaning attempt to proactively provide the empowering
poverty needed to help people overcome their adoption of the sick role reflects a view of
those with health problems that may appeal to the British Establishment, but is poorly
supported by the evidence.
The biopsychosocial model had been gaining influence within the British government for
some time. In 1993 Mansel Aylward invited psychiatrist Simon Wessely to give a talk on
his biopsychosocial approach to CFS before the then Minister for Social Security.
It was recorded that Wessely claimed:
27
see more public spending on 'disabled people who cannot work' dropped from 74% in
1998 to 53% in 2011.[134] It was suggested that this drop was a result of the Labour party's
changing attitude to disabled people and also a growing belief that people are wrongly
claiming to be unable to work.[134]
In 2002 all three of the PACE trial's principal investigators, along with Aylward,
Waddell and Wessely, contributed to a conference and book which promoted the use
of the biopsychosocial model.[127] The book was made up of conference papers and
transcripts of discussions, and includes Waddell explaining how the biopsychosocial
model was gaining political influence:
"It is all about money. The main thing was to persuade the treasury that there
was an opportunity for keeping costs down, particularly over the longer term."
28
In response to another participant saying "if you go to Gordon Brown (UK Chancellor)
and say, 'We can prove to you that if we address this issue, we can save 2 billion', then
you will have his full attention", Mansel Aylward replied: "That is the approach that has
been taken, but not in such a robust fashion."[127]
Their discussions explained how, within government, the antipathy caused by the
view that the biopsychosocial model lacked a hard evidence base had been overcome
by the softer evidence of "authoritative and expert opinion". Unfortunately, those
selected for their authoritative and expert opinions may not have risen to positions of
influence because of their moral integrity and intellectual rigour. Systematic reviews were
also described as being important for changing the views of key opinion makers, yet
systematic reviews may merely combine results from a number of different non-blinded
trials, putting aside problems with bias and making potentially misleading results appear
more reliable than they truly are. [135]
If politicians are not willing and able to engage critically with the scientific and medical
evidence presented to them they could easily be manipulated.
Gordon Waddell pointed out that evidence may not even be what is needed to change
people's minds:
"To take this a stage further, I am not sure that evidence is what convinces people.
We do need an evidence base, but it is ideas that really influence people. People
go to war for ideas, not for evidence. When you look at changing practice, it is
really about ideas rather than evidence."
The biopsychosocial approach to disability was an appealing idea (to some) lacking a
solid evidence base. It has now been used to present cuts to the incomes of sick and
disabled people as a caring intervention in their lives.
"We will review how best to support those suffering from long-term yet treatable
conditions, such as drug or alcohol addiction, or obesity, back into work. People
who might benefit from treatment should get the medical help they need so they
can return to work. If they refuse a recommended treatment, we will review
whether their benefits should be reduced."[137]
Waddell's DWP report on Common Health Problems[19] had suggested the same thing:
29
30
but do not support claims for permanent disability or medical retirement until all
reasonable efforts at rehabilitation have been tried"[143], and that for sickness benefits
"individual [CFS] cases should be treated on their merits, but it is reasonable to expect
a patient to cooperate with treatment before being labelled as chronically disabled."[144]
One of the experts called upon to promote the PACE trials stated that the trial's results
suggested "every patient who wishes to be helped should be willing to try one or both
of the treatments."[145] I do not believe that patients should be expected to engage in
treatments that they do not want, especially when the evidence for their efficacy is as poor
as that seen for CBT and GET for CFS.
Threatening to strip patients of financial support for not pursuing particular
interventions may be seen as a step too far, but misrepresenting a treatment's recovery
rates already serves to rob patients of the ability to make informed decisions about their
healthcare and their lives. It is important that those with health problems are able to trust
the information provided by their doctors, but too often the biopsychosocial model's
emphasis on the benefits of 'reassuring' and 'empowering' cognitions has encouraged
manipulation and dishonesty as a form of therapeutic wish-thinking that also plays in to
the self-interest and prejudices of those working in government, the insurance industry
and in medicine.[144-147]
Exaggerating the extent to which patients can recover from their health problems
through changing their cognitions and behaviour does not only distort patients'
behaviour and how they think of themselves, but has political and social effects upon
how others treat them too. There is a danger that attempts to promote positive and
empowering cognitions amongst the sick has led to a dangerous spread of 'positive'
delusions about ill health and disability, and that policy-makers will now resist a bumpy
and expensive return to reality.
Prior to the publication of the 2015 Conservative Party manifesto, their intent to
include a proposal for mandatory treatments for those claiming benefits was floated in
The Daily Telegraph, and justified by a 'senior government source' with the claim that:
"Cognitive behavioural therapies work and they get people stable again but you
cant mandate people to take that treatment" and
there are loads of people who claim ESA who undergo no treatment whatsoever.
It is bizarre. This is a real problem because we want people to get better."[119]
The source was reported to suggest that:
"successful treatments could reduce the numbers of people with mental health
issues claiming the benefits by up to 90 per cent."
It is difficult to see how this figure could be justified by the evidence, however we have
seen how a desire to be 'positive' can lead to cumulative distortions as information is
passed from one person to another and it is difficult to know how far from reality senior
members of the government have now drifted.[148,149] (As illustrated in the Appendix.)
In Waddell's DWP report on Common Health Problems[19], aside from CFS, the other
bright spot for evidence of the benefits of a biopsychosocial approach was low back pain.
Unfortunately, results from medical trials have been disappointing here too. A recent
Cochrane review of biopsychosocial rehabilitation for low back pain found that nonblinded trials showed some improvements in questionnaire scores prone to bias, but no
improvement in the harder outcome of work status.[150]
"it is important to bear in mind that the lack of scientific evidence is not the same
as evidence that something is ineffective".[19]
This is true, but not a good foundation for cuts to spending on support for those with
health problems, where it is fair to expect a degree of caution from those who could
further their careers with bold speculations. The way in which the biopsychosocial model
has been used and promoted, without good supporting evidence for many of the claims
being made, is unethical.
31
Conclusion
Policy implications
32
Medical research can be used to justify assertions of political power and any attempt
to reform the state's relationship with those with disabilities and ill health should be
founded upon a rigorous examination of the available evidence. Researchers need to be
honest and clear about the limitations of their research and their ability to accurately
measure subjective symptoms.
Policy makers need to recognise that researchers can be influenced by their own selfinterest, and that those who rise to prominence may do so through their own ability to
play political games rather than because of the high quality of their work. The political
power that comes with classing any rehabilitative approach as 'evidence-based' means
that those involved in medical research need to do more to acknowledge the limitations
of non-blinded trials using subjective self-report questionnaires as their outcomes, and
results from these trials need to be placed in the context of what we know about the
dangers of bias and the effect of placebos.
We also need to ensure that results are presented clearly and fairly so that patients and
policy makers can make informed judgments about the value of available interventions. A
small first step in this regard would be to ensure that results for all the outcome measures
laid out in the PACE trial's protocol are now made available to the public who paid for it.
Dangerous assumptions
The biopsychosocial model has played a significant role in shaping the UK government's
approach to disability and welfare over the last two decades, yet some important claims
made about the value and benefits of biopsychosocial approaches have been based upon
poor quality evidence and misleading claims. Even as awareness of these problems
grows, many aspects of the biopsychosocial model are so advantageous to those wishing
to justify cuts to state disability benefits that they are unlikely to be abandoned. While
it may be that explicit references to the biopsychosocial model will now be avoided, the
tactic of using the positive language of empowerment to promote policies which will
cut the incomes of members of society living with ill health and disability looks likely
to continue. So long as cuts to disability spending can go on being sold in this manner
they will be a politically soft target for a government committed to finding 12 billion of
welfare savings.[137]
It is not just in the political sphere that the biopsychosocial model has caused problems.
While there can be an assumption that medical researchers are more trustworthy than
politicians, and that the interventions they promote as being 'evidence-based' will benefit
patients, results from medical research can be exaggerated and misrepresented. When the
biopsychosocial model encourages researchers and medical staff to see the management
of patients' cognitions and expectations as a routine part of medical practice this can be
seen as legitimatising the manipulation of the information provided about prognosis,
treatment efficacy and recovery rates. There seems to be a belief that informed consent is
not required for this psychosocial treatment. It should not be surprising that presuming
certain groups of patients deserve to be manipulated in this way will be stigmatising,
and risks creating a culture of cynicism and distrust as knowledge of what has occurred
spreads.
The PACE trial shows the danger of allowing researchers with an interest in reporting
positive results to use subjective self-report outcome measures for a non-blinded trial.
While the more objective outcome measures from the PACE trial indicated that the
biopsychosocial interventions tested were not useful to patients, results were released in a
way which led to a range of excited claims being made about them leading to recovery for
patients.
In 2011 the chair of BACME, a professional organisation for those providing CBT and
GET to CFS patients, was the corresponding author on a paper which cited the PACE
trial to make the unjustifiable claim that:
"Miracles are being wrought by the Sacred Tickbox at the Healing WCA Temples.
We want to share the news of these miracles that are being performed upon us!
Praise Be!"[152]
Atos Miracles
For a welfare system to be genuinely enabling for disabled people it needs to be founded
upon a reasonable understanding of disability, how it affects people, and the likelihood
of recovery. An unduly positive view of peoples' health problems, and the benefits of
psychosocial management and rehabilitation, can lead to policies which reduce disabled
peoples' control over their own lives and how they manage their health. Until the serious
33
and ongoing problems distorting medical research in this area have been overcome, it
is important to avoid assuming that civil servants and medical researchers have a better
understanding of how people with disabilities should live their lives than disabled people
themselves.
34
Appendix
1. Selected criteria from the PACE trial
For ease of reference and comparison, some of the criteria referred to within the PACE
trial are provided here in full. The criteria laid out in the trial's 2007 protocol[37] are
consistently more demanding than those newly devised criteria for which results were
later released. The operationalised Oxford criteria for Chronic Fatigue Syndrome
used within the PACE trial is also included so that readers can better understand how
participants were selected.
OUTCOME MEASURES:
35
Recovery:
"Recovery" will be defined by meeting all four of the following criteria: (i) a Chalder
Fatigue Questionnaire score of 3 or less, (ii) SF-36 Physical Function score of 85 or
above, (iii) a CGI score of 1, and (iv) the participant no longer meets Oxford criteria
for CFS, CDC criteria for CFS or the London criteria for ME.
36
Required i) a Likert fatigue score of 18 or less, ii) an SF36-PF score of 60 or more, iii) a
CGI score of under 2 and iv) not fulfilling the Oxford criteria for CFS*.
Clinical Recovery Criteria[45]:
Required i) a Likert fatigue score of 18 or less, ii) an SF36-PF score of 60 or more, iii) a
CGI score of under 2 and iv) not fulfilling the Oxford criteria for CFS*, CDC criteria for
CFS or the London criteria for ME .
* In the recovery paper, fulfilling the Oxford criteria required that patients have
a Chalder Fatigue Questionnaire score of 6 or more and a SF-36 Physical Function
sub-scale score of 65 or less. At baseline 235 patients were excluded from the trial
because they reported a SF36-PF score of over 65, separately from the 1011 excluded
for not fulfilling the Oxford criteria.[20] The entry criteria for the FINE trial, PACE's
sister trial, also required the Oxford criteria be fulfilled, but included patients who
had an SF36-PF score of 70, and a bimodal Chalder Fatigue score of 4. Patients who
fulfilled the most demanding recovery criteria used in the PACE trial could still have
fulfilled the Oxford criteria for FINE.[159]
SMC
SMC+CBT
SMC+GET
SMC+APT
23.8 (6.6)
20.3 (8.0)
20.6 (7.5)
23.1 (7.3)
34
(50 to 18)
32
(48 to 17)
07
(23 to 09)
58.2 (24.1)
57.7 (26.5)
459 (24.9)
71
(20 to 121)
94
(44 to 144)
34
(84 to 16)
50.8 (24.7)
Mean SF36-PF
difference from SMC
(95% CI)
'Back to normal'
15%
30%
28%
16%
Trial recovery
7%
22%
22%
8%
Clinical recovery
7%
21%
21%
8%
[20,45]
37
38
Medical exclusions:
Established medical conditions known to produce chronic fatigue (see medical
screening SOP). RN to check that this has been done and documented by the clinic
doctor.
Psychiatric Exclusions:
Schizophrenia, Manic depressive (bipolar) illness, Substance misuse, Eating disorder,
Proven organic brain disease.
Other psychiatric disorders (including depressive illness, anxiety disorders, and
hyperventilation syndrome) are not reasons for exclusion.
The changes from the outcome criteria laid out in the trial's 2007 protocol[37] consistently
served to make it easier to report positive results, and this will have served to inflate
the claims that could be made about the benefits of treatments. While the PACE team
continue to fight against the release of results for the criteria which they themselves had
devised for their published protocol we cannot know exactly how great an impact these
protocol changes will have had.
Graded
exercise
therapy
(n=160)
Specialist
medical care
alone (n=160)
Treatment is
logical
134 (84%)
115 (71%)
135 (84%)
79 (49%)
Confident
about
treatment
114 (72%)
91 (57%)
112 (70%)
65 (41%)
However, as part of both CBT and GET patients were told that their treatments had
already been shown to be effective (e.g. from the CBT participant's manual: "Cognitive
behaviour therapy (CBT) is a powerful and safe treatment which has been shown to be
effective in a variety of illnesses, including CFS/ME, headaches and back pain."[35]) and no
equivalent claims were made as a part of APT. Receiving these claims from clinicians in
positions of authority during treatment may have affected patient beliefs and expectations
in a way which biased results. Furthermore, the models of illness provided as a part
CBT and GET were likely to encourage patients to believe that they had greater control
over their symptoms, and that a failure to improve would reflect poorly upon their own
efforts. There is a danger that simply promoting these models of illness to patients would
encourage them to report their symptoms more positively.
APT was a therapy devised for the PACE trial and unlike the pacing most commonly
used by patients, which is self-learned, is taught and supervised by a therapist.[154] It was
stated that this was done in order to reduce to danger of bias distorting results: "Given
that having a sympathetic therapist usually influences the success of a therapy, having
two parts of the trial supported by a therapist but one not, would have risked not giving
pacing a fair chance."[154]
This early awareness that the PACE trial was designed in such a way that the primary
outcomes could be so easily distorted seemed to have faded away by the time results were
being presented to the media.
The PACE team published the following graph, showing results for an objective
measures of fitness[44], but have refused to release the exact figures for this data, classing
a request for this information as vexatious.[76] Therapists providing APT were told that an
important consideration in APT is the 70% rule: never going beyond 70% of a person's
perceived energy limit[35], while those providing CBT and GET encouraged patients to
39
gradually increases activity.[35] This did not seem to lead to the differences in patients'
fitness levels that one might expect.
40
We cannot be confident in any interpretation of the primary outcomes for the PACE trial.
There are reasons that they could have been biased for or against any of the treatment
groups. It is important that these problems with interpreting results are acknowledged
when they are being presented, and that results for the trial's more objective outcome
measures are provided in addition to those for the SF-36 Physical Functioning Scale and
Chalder Fatigue Questionnaire.
"We would like to know more about any problems you have had with feeling
tired, weak or lacking in energy in the last month.... If you have been feeling tired
for a long while, then compare yourself to how you felt when you were last well."
People are scored depending upon which of the four answers that they choose and the
scoring method used.
Less than usual
No more than usual
More than usual
Much more than usual
(Likert scoring: 0
(Likert scoring: 1
(Likert scoring: 2
(Likert scoring: 3
Bimodal scoring: 0)
Bimodal scoring: 0)
Bimodal scoring: 1)
Bimodal scoring: 1)
The PACE team had classed the bimodal scoring of the Chalder Fatigue scale as the trial's
primary outcome.[37] Before the PACE trial's results were released its sister trial, FINE[153],
released results without deviating from its protocol and reported that biopsychosocial
rehabilitation did not lead to an improvement in the trial's primary outcome compared
to a 'treatment as usual' control. They also reported that had they used Likert rather than
bimodal scoring for the Chalder fatigue scale then a small but statistically significant
41
improvement could have been reported. The PACE team have decided to only release
results for Likert scoring of the Chalder Fatigue scale.
The trial's post-hoc recovery criteria uses Likert scoring, making it slightly more
difficult to compare to the original criteria for recovery and entry to the trial, both of
which used bimodal scoring. Within the main report's discussion of the changes to
criteria, the original boundaries for the bimodal score were converted to Likert scoring,
while the full original criteria are outlined above.
42
1. In the 2011 PACE paper researchers reported results for those who were "within
normal ranges for both primary outcomes at 52 weeks"[20]: 15% (SMC), 30%
(SMC+CBT), 28% (SMC+GET) and 16% (SMC+APT). Patients could have entered the
trial being classed as suffering from fatigue which was "severe, disabling and affects
physical and mental functioning", reported a worsening of their fatigue and physical
functioning following treatment, and yet still have fallen within the PACE team's
post-hoc normal ranges for fatigue and physical function.
2. To the press and to patients the PACE team described these patients as being "back to
normal" and stated that "the number of patients returning to normal levels of fatigue
and physical function was about three out of ten after CBT or GET; about twice as
many as those who received APT or SMC."[59,60]
3. In a commentary in The Lancet that accompanied the publication of the PACE paper,
and was reviewed and approved by the PACE team, it was stated that: "PACE used
a strict criterion for recovery: a score on both fatigue and physical function within
the range of the mean plus (or minus) one standard deviation of a healthy persons
score. In accordance with this criterion, the recovery rate of cognitive behavioural
and graded exercise therapy was about 30%although not very high, the rate is
significantly higher than that with both other interventions."[54] It was not true that
PACE had used healthy people's score to derive their normal range and it is difficult
to see how a 'strict criterion for recovery' could overlap with the trial's own entry
criteria.
4. Those reporting on the PACE trial continued to promote the claim that about one
third of patients had recovered with CBT and GET, with the BMJ reporting that "Less
than a third of patients were cured by either treatment (30% (44/148) after CBT and
28% (43/154) after graded exercise therapy)."[52,55-57]
5. In a column for The Telegraph, which has since received some alterations, Max
Pemberton wrote that: "The current gold standard for treatment is a combination of
supervised exercise and talking therapies. A major British trial published in The Lancet
found that at least one in three patients with ME recovered using this approach. The
biggest hurdle faced by doctors is persuading people to actually attend and engage
with treatment. They resist because they refuse to be seen as mentally unwell. It
does seem bizarre that those with such a debilitating disease would refuse treatment
because it was given by a psychiatrist."[56]
6. In a paper on the impact and costs of CFS/ME the PACE trial was cited to support
the claim that: "Evidence from a recent evidence trial of cognitive behavioural
therapy and graded exercise therapy indicated a recovery rate of 30-40% one year
after treatment."[58] The corresponding author for this paper was Esther Crawley,
chair of BACME, a professional organisation for those providing CBT and GET to CFS
patients, and she stated that she hoped that this paper would be read by the NHS
commissioner who decide which services should be funded.[151]
There is a danger that even more extreme misrepresentations of the evidence are made
behind closed doors. If politicians and NHS commissioners assume that they can
trust the claims being made in peer-reviewed medical papers then they are likely to be
making many important decisions based upon a seriously distorted understanding of the
evidence.
5. Informed consent
Even when randomised controlled trials are rigorously conducted and appropriately
reported their results may still be misleading and differ from those seen outside of a
research setting. Those patients selected for entry in to a trial may not be representative
of the patient population, and volunteering for participation shows that these patients
are happy to take part in the trial's treatments, so results cannot be used to claim that
the forced treatment of others would be beneficial. Patients and therapists who know
that they are being assessed as part of a trial may behave and respond differently to
those outside of trials. Medical trials can also feature higher levels of supervision and
oversight during treatment than those seen elsewhere, potentially leading to greater care
and attention and therefore improved results. It is important that people are aware of
the limitations which surround even relatively robust medical knowledge, that patients
are made aware of these limitations before being asked to consent to treatment, and that
systems are in place to ensure patient concerns about the treatments they receive outside
of trials are listened to.
Information on treatment effects and patient satisfaction has been collected by those
providing CBT and GET to CFS patients and by patient charities.[155-157] Results from
patient surveys are likely to be skewed by the self-selection of those who complete them,
who are unlikely to be representative of the general patient population. There are other
potential problems with such evidence too, such as a lack of independent confirmation
of a patient's diagnosis, or the possibility that the treatment they received had not been
provided properly. While results from surveys conducted by patient charities need to
be treated with caution, they do provide an opportunity for patient voices to be heard
without being filtered through researchers and medical staff. Perhaps unsurprisingly,
43
those providing CBT and GET to patients tend to report more positive findings for their
interventions than patient groups, which routinely report that many patients found CBT
and GET to be harmful.[155-157]
A recently released report from one charity included patient statements which could
help explain the discordancy of results: "They taught us positive mental attitude, so it was
impossible to report back the truth without being accused of negativity."[157] This sort of
attitude can also be seen in the medical literature. For example, therapists from PACE's
sister trial, FINE[153], found that dealing with patients after they had been trained to
provide biopsychosocial rehabilitation was frustrating.
This was illustrated by the quote:
"From the moment you walk out of this room your recovery is beginning.
There is no disease
Go for 100% recovery"[159]
44
If people are encouraged to believe that patients' health problems are entirely reversible
though rehabilitation, then their failure to recover is likely to lead to irritation.
Genuinely informed consent requires that the claims made to patients are not shaped
by a desire to be positive or reassuring. A course intended to reduce unemployment
which leaves the unemployed reporting greater confidence in their ability to find work,
but does not lead to real improvements in employments rates could be a harmful waste
of time and resources, and should not be sold as helping people to get back to work. A
non-blinded trial of a medical intervention which enables patients to report less disabling
fatigue on questionnaires but not increase their activity levels or show other more
objective evidence of improvement should not be sold as an evidence-based treatment for
disabling fatigue. It is important to be clear about the problems with relying upon selfreport measures in non-blinded trials, and the danger that results for these outcomes may
be misleading.
6. Recent developments
Since this report was first submitted for publication, there have been a number of
interesting developments that I will attempt to briefly summarise here, as well as
providing references to further reading.
First, David Tuller, a science journalist and academic coordinator of the concurrent
masters degree program in public health and journalism at the University of California,
Berkeley, began publishing a series of lengthy investigative pieces detailing problems
with the PACE trial.[160,161] Some of these problems have been covered within this
report, but many were not. His pieces included criticism of PACE from a number
of prominent researchers, who then went on to write an open letter expressing their
concerns to Richard Horton, editor of The Lancet, arguing that such flaws have no place
in published research.[162] Following Horton's failure to respond, the letter was re-sent,
with an additional thirty six signatories.[163] Following publication of a piece by Tuller on
problems with the PACE trial researchers' conflicts of interest involving the insurance
industry, Swiss Re removed from its website one of the pages cited in this report.[164,165]
Fortunately this page had been backed up and made available elsewhere.[97]
Soon after David Tuller had published his first piece a new PACE trial paper was
published, providing mean Chalder Fatigue scale scores and SF-36 Physical Functioning
scores for the trial's treatment groups at 2.5 year follow up.[166] These results showed that
patients randomised to receive CBT and GET in addition to Specialist Medical Care
reported scores no better than those randomised to Specialist Medical Care alone.
In a press release promoting CBT and GET titled 'Treatments offer hope for Chronic
Fatigue Syndrome (CFS/ME)' one of the PACE trial's researchers argued that:
"We found that participants who had originally been given SMC or APT
appeared to be doing as well as those who had CBT or GET in the longer term.
However as many had received CBT or GET after the trial, it does not tell us that
these treatments have as good a long term outcome as CBT and GET."[167]
This is true, yet within the paper's appendix is data which had been included at request
of a reviewer which showed that the scores of those participants randomised to the SMC
or SMC+APT groups who received no additional treatment improved by as much as the
scores of those who received additional CBT or GET. The press release did not mention
this evidence.
At 2.5 years follow-up the additional therapies provided had broken randomisation and
made it difficult to claim anything with confidence. That did not prevent the researchers
presenting results in a way which led to a front page article in The Daily Telegraph which
began by claiming that:
"Chronic Fatigue Syndrome is not actually a chronic illness and suffers can
overcome symptoms by increasing exercise and thinking positively, Oxford
University has found."[168]
The headline was Exercise and positivity 'can overcome ME'.
David Tuller's work, and problems with the way result for this new paper were
presented, served to draw the attention of further academics, including James Coyne and
Keith Laws, two researchers known for their attempts to raise standards within mental
health research.[169,170] In a co-authored response titled Results of the PACE follow-up study
are uninterpretable they criticised the way in which previous concerns about the PACE
trial had been responded to:
45
Meanwhile, the Information Commisioner's Office released a decision notice that ordered
the release of anonymised data from the PACE trial which would allow for the calculation
of results for many of the outcomes laid out in the trial's protocol, including their original
recovery criteria.[75,172] The decision notice reveals the range of arguments Queen Mary
University of London attempted to use to avoid the release of this data; including that the
data release could contravene confidentiality agreements given to participants as, even
though no plausible way third parties could re-identity participants was provided, they
raised the concern that the participants themselves might be able to identify their own
data, somehow potentially breaching their own confidentiality. Rather than releasing
the requested data Queen Mary decided that they would prefer to appeal against the
Information Commissioner's decision, and a three day tribunal hearing is now due to
take place over 20-22 April 2016.[173]
A separate refusal to release data from the PACE trial then attracted wider attention
from the scientific community.[174] An earlier PACE paper had been published in
a scientific journal, PLOS ONE, that requires authors make data available to other
researchers (the data used for this paper would not allow for the calculation of results
for the recovery criteria laid out in the trial's protocol). James Coyne requested this data,
and the PACE team's refusal to honour their commitment to data sharing drew the ire
of a wide range of campaigners concerned about problems with the reliability of medical
research, leading to yet further requests for access to this data.[175, 176]
The refusal letter argues that:
46
"the active campaign to discredit the project has caused distress to the
universitys researchers who hold legitimate concerns that they will be subject to
public criticism and reputational damage."
Such concerns should not be allowed to interfere with the critical assessment of
scientific research. PLOS has now issued an editor's note stating that:
"several readers have raised concerns regarding the analyses reported in this
article. We are also aware that there have been requests for the data from this
study"
and concluding:
"As part of our follow up we are seeking further expert advice on the analyses
reported in the article, and we will evaluate how the request for the data from
this study relates to the policy that applies to the publication. These evaluations
will inform our next steps as we look to address the concerns that have been
noted."[177]
Coyne has claimed that he and PLOS had:
"currently seeking further ethical and scientific advice, as well as the advice of
patients, on how best to provide independent decisions about appropriate access
to relevant data".[189]
In response to this a string of major ME/CFS patient organisations from around the
world have written to Queen Mary arguing for the release of the requested data, including
Action for ME, the patient charity which had been involved in assisting with the trial.[190,
191]
Over twelve thousand signatures have also been collected for a patient petition calling
for the correction of misleading claims made within PACE trial papers and the release
of results for the recovery criteria laid out in the trial's published protocol.[192] So far, this
advice from patients does not seem to have led to Queen Mary abandoning their appeal
47
48
to the Information Tribunal. While concerns have been expressed about protecting
the personal data of trial participants, no explanation has been provided as to how the
limited data request Queen Mary is appealing against could lead to the identification of
participants. The closest we have seen is a vague reference to it being a 'very rich' data
set by Simon Wessely, President of the Royal College of Psychiatrists.[193] Sir Simon has
also offered an attempted defence of the PACE trial in a blog post, however he failed
to address the central concerns raised by the trial's critics, and he raised no points that
required changes to be made to this report.[194]
Since submitting this report awareness of the problems which surround the PACE
trial, and criticism of it, has grown dramatically.[161,169,170,195-198] Yet this change has largely
occurred outside of the UK, while British reporting of the controversies around the PACE
remains less well informed and seemingly more readily affected by the prejudices which
can surround CFS.[168,199-202] The PACE trial illustrates concerns about British medical
research, politics and also science reporting and the role of the Science Media Centre
in shaping public discourse. In parts of the British media it appears to have become
fashionable to use CFS and the controversy surrounding the PACE trial as a justification
for inane commentary on the problems of a dualistic understanding of body and mind,
ignoring the real problems with biopsychosocial approaches to CFS and the prejudices
that poorly researched work can promote.[56, 72, 199,200 202-205]
While recent developments have brought more attention to the problems with the
research at the centre of this report, we are still waiting for real progress to be made in
correcting these problems. It should not be assumed that the PACE trial is a uniquely
flawed piece of research, but it does serve as a useful case study for the political dangers
of poor quality medical research, and the harm it can do. It also helps illustrate problems
within the systems of science, that too often seem designed to serve the interests of
researchers and those in positions of authority rather than society at large. While there
are signs of some improvements to these systemic problems, progress is slow, and
the PACE trial indicates how committed some are to protecting their own privileged
positions. We must now wait to see if the Information Tribunal refuses Queen Mary's
appeal, in which case we may soon have access to data that could help correct some
of the misleading claims made about the PACE trial and the expectations patients can
reasonably hold about recovery.
Bibliography
1. Pring J (2015) Osborne refuses to assess impact of cuts on disabled people then slashes their benefits.
Disability News Service. http://www.disabilitynewsservice.com/osborne-refuses-to-assess-impact-of-cutson-disabled-people-then-slashes-their-benefits/
2. Office for Disability Issues (2011) Disability Equality Indicators. http://webarchive.nationalarchives.
gov.uk/20131128110838/http:/odi.dwp.gov.uk/disability-statistics-and-research/disability-equalityindicators.php
3. The Department of Work & Pensions (2014) Fulfilling Potential Outcomes and Indicators
Framework Progress Report. https://www.gov.uk/government/uploads/system/uploads/attachment_data/
file/348867/Fulfilling_Potential_Outcomes_and_Indicators_Framework_Progress_Report_2014.pdf
4. The Department of Work and Pensions (2015) Opinions and Lifestyle Survey data for the 2014
Fulfilling Potential Outcomes and Indicators Framework: Official Statistics. https://www.gov.uk/government/
statistics/opinions-and-lifestyle-survey-fulfilling-potential-outcomes-and-indicators-2014-data
5. Atos Orgin (2006) Professional Support for doctors working in Disability Assessment Medicine.
Archived at: http://web.archive.org/web/20061014191941/http://www.atosorigin.co.uk/industries/
medicalservices/newsite/expertteam/profsupport.htm
6. MS Society (2015) The benefits system is harming our health say people with multiple sclerosis.
http://www.mssociety.org.uk/ms-news/2015/09/benefits-system-harming-our-health-say-people-multiplesclerosis
7. Butler P (2015) Volunteer law project wins 95% of 'fit for work' test appeal cases. The Guardian.
http://www.theguardian.com/society/patrick-butler-cuts-blog/2015/sep/02/volunteer-law-project-wins95-of-fit-for-work-test-appeal-cases
8. Meaden B (2012) The perfect storm around disability. Ekklesia. http://www.ekklesia.co.uk/
node/16847
9. Vaux G (2005) Appliance of science. Community Care. http://www.communitycare.co.uk/2005/11/10/
appliance-of-science/
10. The British Medical Association (2012) Scrap work capability assessment, doctors demand.
http://bma.org.uk/news-views-analysis/news/2012/june/scrap-work-capability-assessment-doctorsdemand
11. Frances R (2015) The Tories are callously redefining what it means to be sick or disabled. The
Guardian. http://www.theguardian.com/society/2015/jul/21/conservatives-redefining-sick-disabledwelfare-bill
12. Meaden B (2015) Malingering, illness deception, and disability benefit reforms. Ekklesia.
http://www.ekklesia.co.uk/node/21751
13. Vale P (2012) Austerity In The United Kingdom Leaves Disabled In Fear For Their Lives.
http://www.huffingtonpost.com/2012/07/15/austerity-measures-uk-a-thousand-cuts_n_1670711.
html?utm_hp_ref=mostpopular
14. Freud D (2012) Lords Hansard. 17 Jan 2012 : Column 498 http://www.publications.parliament.uk/pa/
ld201212/ldhansrd/text/120117-0001.htm
15. Waddell G & Aylward M (2010) Models of Sickness and Disability. The Royal Society of Medicine.
Available at: http://www.craigliebenson.com/wp-content/uploads/2010/08/Models-final-proofs2.pdf
16. Rehab News (2004) New UnumProvident Centre for Psychosocial and Disability Research. Cardiff
University. http://www.rehabwindow.net/Display.aspx?ID=118
49
50
26. Green CR, Cowan P, Elk R, ONeil KM & Rasmussen AL (2015) Final Report. NIH Pathways to
Prevention Workshop: Advancing the Research on Myalgic Encephalomyelitis/ Chronic Fatigue Syndrome.
Executive Summary. Available at: https://prevention.nih.gov/programs-events/pathways-to-prevention/
workshops/me-cfs/workshop-resources
27. The Institute of Medicine (2015) Beyond myalgic encephalomyelitis/chronic fatigue syndrome:
redefining an illness. http://www.iom.edu/Reports/2015/ME-CFS.aspx
28. Action for ME (2013) Our 2013 research conference. Available at: http://www.
actionforme.org.uk/OneStopCMS/Core/TemplateHandler.aspx?NRMODE=Published&N
RNODEGUID={F6334701-81AA-4F47-828A-DC5B8793FD14}&NRORIGINALURL=%2f
get-informed%2fresearch%2four-research-related-activity%2four-2013-research-conference.
htm&NRCACHEHINT=NoModifyGuest
29. Hrbjartsson A, Emanuelsson F, Skou Thomsen AS, Hilden J & Brorson S (2014) Bias due to lack
of patient blinding in clinical trials. A systematic review of trials randomizing patients to blind and nonblind
sub-studies. International Journal of Epidemiology, 43(4), 12721283. http://www.ncbi.nlm.nih.gov/
pubmed/24881045
30. Savovi J et al (2012) Influence of reported study design characteristics on intervention effect estimates
from randomized, controlled trials. Ann Intern Med. 2012;157:429-438. http://www.ncbi.nlm.nih.gov/
pubmed/22945832
31. Jadad AR (1998) Bias in RCTs: beyond the sequence generation in Randomised Controlled
Trials: A Users Guide. BMJ Books. Available at: http://www1.cgmh.org.tw/intr/intr5/c6700/obgyn/f/
randomized%20tial/chapter3.html
32. Spiegel D, Kraemer H & Carlson RW (2001) Is the placebo powerless? N Engl J Med; 345: 1276-79.
http://www.ncbi.nlm.nih.gov/pubmed/11680452
33. Hrbjartsson A & Gtzsche PC (2010) Placebo interventions for all clinical conditions. Cochrane
Database Syst Rev; 1. http://www.ncbi.nlm.nih.gov/pubmed/20091554
51
52
59. Boseley S (2011) Study finds therapy and exercise best for ME. The Guardian. http://www.
theguardian.com/society/2011/feb/18/study-exercise-therapy-me-treatment
60. PACE participants newsletter 4. February 2011. http://www.wolfson.qmul.ac.uk/images/pdfs/
participantsnewsletter4.pdf
61. Cella M & Chalder T (2010) Measuring fatigue in clinical and community settings. Journal of
Psychosomatic Research , Volume 69 , Issue 1 , 17 - 22. http://www.ncbi.nlm.nih.gov/pubmed/20630259
62. Pawlikowska T, Chalder T, Hirsch SR, Wallace P, Wright DJ & Wessely SC (1994) Population based
study of fatigue and psychological distress. BMJ: British Medical Journal, 308(6931), 763766. http://www.
ncbi.nlm.nih.gov/pubmed/7908238
63. White PD, Goldsmith KA, Johnson AL, Walwyn R, Baber HL, Chalder T & Sharpe M (2011) The
PACE trial in chronic fatigue syndrome Authors' reply. The Lancet. Volume 377, No. 9780, p18341835
http://www.thelancet.com/journals/lancet/article/PIIS0140-6736%2811%2960651-X/fulltext
64. Bowling A, Bond M, Jenkinson C & Lampin DL (1999) Short Form 36 (SF-36) Health Survey
questionnaire: which normative data should be used? Comparisons between the norms provided by the
Omnibus Survey in Britain, the Health Survey for England and the Oxford Healthy Life Survey. J Public
Health Med. 1999 Sep;21(3):255-70.. http://www.ncbi.nlm.nih.gov/pubmed/10528952
65. Office of Population Censuses and Surveys. Social Survey Division OPCS Omnibus Survey,
November 1992 [computer file]. Colchester, Essex: UK Data Archive [distributor], September 1997. SN:
3660, http://dx.doi.org/10.5255/UKDA-SN-3660-1
66. Smallcombe P (2011) Queen Mary University of London Response to FOI. http://www.meassociation.
org.uk/wp-content/uploads/2011/06/FOI+from+Queen+Mary.pdf
67. Couch IC (2013) Re: PACE trial authors reply to letter by Kindlon. BMJ. http://www.bmj.com/
content/347/bmj.f5963/rr/675527
68. Knoop H, Bleijenberg G, Gielissen MFM, van der Meer JWM & White PD (2007) Is a Full
Recovery Possible after Cognitive Behavioural Therapy for Chronic Fatigue Syndrome? Psychotherapy &
Psychosomatics. 76(3):171-6. http://www.ncbi.nlm.nih.gov/pubmed/17426416
69. Riley N, Colby J & Colby N (2011) PACE Trial text of joint letter calling for more information.
http://www.meassociation.org.uk/2011/05/6171/
70. Smallcombe P (2012) PACE Trial: Recovery Rates and Positive Outcome Rates. https://www.
whatdotheyknow.com/request/pace_trial_recovery_rates_and_po#incoming-327302
71. Smallcombe P (2013) PACE Trial: Recovery Rates and Positive Outcome Rates (repeat request).
https://www.whatdotheyknow.com/request/pace_trial_recovery_rates_and_po_2#incoming-463991
72. Hanlon M (2013) This man faced death threats and abuse. His crime? He suggested that ME was a
mental illness. 5 May. The Sunday Times.
73. Hawkes N (2011) Dangers of research into chronic fatigue syndrome. The British Medical Journal.
22;342:d3780. http://www.ncbi.nlm.nih.gov/pubmed/21697226
74. Crawley E & Feilden T (2012) Threats of Persecution. Views From the Frontline. Science Media
Centre. http://www.sciencemediacentre.org/wp-content/uploads/2012/10/SMC-Views-from-the-frontline-essays-on-the-SMC.pdf
75. Matthees A (2014) Timing of changes to PACE Trial recovery criteria. What Do They Know. https://
www.whatdotheyknow.com/request/timing_of_changes_to_pace_trial#comment-59096
76. McPhee G (2015) Fitness data for PACE trial. What Do They Know. https://www.whatdotheyknow.
com/request/fitness_data_for_pace_trial#outgoing-464451
77. Smallcombe P (2014) Raw data for 6mwt. 14 July. What Do They Know. https://www.
whatdotheyknow.com/request/raw_data_for_6mwt#incoming-538863
78. Wessely S (2011) Health in mind and body. The Journal of the Foundation for Science and
Technology. Volume 20, Number 7. http://www.foundation.org.uk/journal/pdf/fst_20_07.pdf
79. Hope J (2011) Scientists investigating ME get 'death threats' for investigating psychological causes.
Daily Mail. 30 July. http://www.dailymail.co.uk/health/article-2020241/Scientists-investigating-ME-deaththreats-investigating-psychological-causes.html#
80. Weir K (2014) Beyond Tired. Monitor on Psychology. The American Psychological Association.
October. http://www.apamonitor-digital.org/apamonitor/201410#pg72
81. Matthees A (2015) Assessment of recovery status in chronic fatigue syndrome using normative
data. Quality of Life Research April, Volume 24, Issue 4, pp 905-907. http://www.ncbi.nlm.nih.gov/
pubmed/25304959
82. Smith MEB, Nelson HD, Haney E, Pappas M, Daeges M, Wasson N & McDonagh M (2014)
Diagnosis and Treatment of Myalgic Encephalomyelitis/Chronic Fatigue Syndrome. Evidence Report/
Technology Assessment No. 219. (Prepared by the Pacific Northwest Evidence-based Practice Center
under Contract No. 290-2012-00014-I.) AHRQ Publication No. 15-E001-EF. Rockville, MD: Agency for
Healthcare Research and Quality http://www.effectivehealthcare.ahrq.gov/search-for-guides-reviews-andreports/?pageaction=displayproduct&productID=2004
83. Lloyd JR & Meer JW (2015) The long wait for a breakthrough in chronic fatigue syndrome. The British
Medical Journal. May 5;350:h2087. http://www.ncbi.nlm.nih.gov/pubmed/25944462
84. Eaton L (2002) Chronic fatigue report delayed as row breaks out over content. The British Medical
Journal, 324(7328), 7. http://www.ncbi.nlm.nih.gov/pubmed/11777785
85. White P (2002) Chronic unexplained fatigue. Postgraduate Medical Journal, 78(922), 445446. http://
www.ncbi.nlm.nih.gov/pubmed/12185213?dopt=Abstract
86. White PD (2002) Power-sharing, not a take-over. The British Medical Journal. http://www.bmj.com/
rapid-response/2011/10/28/power-sharing-not-take-over
87. Stewart M (2013) From the British Welfare State to Just Another American State. Centre for Welfare
Reform. http://www.centreforwelfarereform.org/library/by-date/from-the-british-welfare-state.html
88. Private Eye (2011) Mutual Benefits. In the Back. Issue 1301, 8th November. http://www.private-eye.
co.uk/sections.php?section_link=in_the_back&issue=1301&article=450
89. Rutherford J (2008) E pluribus Unum. The Guardian. http://www.theguardian.com/
commentisfree/2008/mar/17/epluribusunum
90. Fearn H (2014) Senior Atos executive finds new role at the American company taking over disability
benefit. The Independent. http://www.independent.co.uk/news/uk/politics/senior-atos-executive-findsnew-role-at-the-american-company-taking-over-disability-benefit-9831973.html
91. Stone J (2015) David Cameron is open to people saving up for their own sickness and unemployment
benefits. The Independent. http://www.independent.co.uk/news/uk/politics/david-cameron-is-open-topeople-saving-up-for-their-own-sickness-and-unemployment-benefits-10386071.html
92. Mason R (2015) David Cameron open to idea of workers saving up to fund own sick pay. The
Guardian. http://www.theguardian.com/politics/2015/jul/13/david-cameron-open-to-workers-saving-upfund-own-sick-pay
93. Pring J (2013) Unum bragged about driving government thinking on incapacity benefit reform.
The Disability News Service. http://www.disabilitynewsservice.com/unum-bragged-about-drivinggovernment-thinking-on-incapacity-benefit-reform/
94. O'Donnell M (2005) Evolving - the way we look at claims. Unum Provident. Available at: http://issuu.
com/maxhead/docs/unum_biopsychosocial_cardiff
95. Wind-Cowine M (2011) Of mutual benefit - personalised welfare for the many. Demos. www.demos.
co.uk/files/Mutual_benefit_-_web.pdf?1299256527
96. Jackson CL (1995) Chronic Fatigue Syndrome Managment Program. Unum. This report now only
seems to be available at this archived site: http://web.archive.org/web/20040607111735/http://www.
corporatecrimefighters.com/html/unum_discreditting_cfs.html
97. Swiss Re (2013) Managing claims for chronic fatigue the active way. Client Newsletter. This has been
archived at: https://drive.google.com/file/d/0B1hvPDijFCa3bFEyVXl6djFnZjg/view http://www.swissre.
com/clients/newsletters/Managing_claims_for_chronic_fatigue_the_active_way.html
98. Hunt K, Ramsay K and Rosa R (2013) Does that Make Me Crazy? A Decade in Mental Health.
Swiss Re. http://www.select74.org/files/presentations/2013-03-14%20-%20A%20decade%20in%20
mental%20health.pdf
99. Kindlon T (2012) Coercive practices by insurance companies and others should stop following the
publication of these results. PLoS. http://www.plosone.org/annotation/listThread.action?root=52637
100. Gibson I, Taylor R, Cryer A, Meacher M, Turner D, Taylone D, Turnberg L, Mar M &
Cumberlege J (2006) Inquiry into the status of CFS / M.E. and research into causes and treatment. Group in
Scientific Research into Myalgic Encephalomyelitis (M.E.). http://www.erythos.com/gibsonenquiry/Docs/
ME_Inquiry_Report.pdf
101. Sinclair U (1935) I, Candidate for Governor: And How I Got Licked. University of California Press.
102. Wilshire CE (2015) Re: Tackling fears about exercise is important for ME treatment, analysis indicates.
BMJ. http://www.bmj.com/content/350/bmj.h227/rr-7
103. Ioannidis JPA (2005) Why Most Published Research Findings Are False. PLoS Medicine, 2(8), e124.
http://www.ncbi.nlm.nih.gov/pubmed/16060722
104. Lloyd AR, Hickie I, Brockman A, Hickie C, Wilson A, Dwyer J & Wakefield D (1993) Immunologic
and psychologic therapy for patients with chronic fatigue syndrome: a double-blind, placebo-controlled trial.
The American Journal of Medicine, 94(2), 197203. http://www.ncbi.nlm.nih.gov/pubmed/8430715
105. Cho HJ, Hotopf M & Wessely S (2005) The placebo response in the treatment of chronic fatigue
syndrome: a systematic review and meta-analysis. Psychosomatic Medicine; 67(2): 301-313. http://www.
ncbi.nlm.nih.gov/pubmed/15784798
106. Kindlon TP (2015) Objective measures found a lack of improvement for CBT & GET in the PACE
Trial: subjective improvements may simply represent response biases or placebo effects in this non-blinded
trial. BMJ. http://www.bmj.com/content/350/bmj.h227/rr-10
107. Chalder T, Goldsmith K, White P, Sharpe M & Pickles A (2015) Mediators of response to
behavioural treatments in CFS. BMJ. http://www.bmj.com/content/350/bmj.h227/rr-24
108. Faulkner G (2015) In non-blinded trials, self-report measures could mislead. Lancet Psychiatry.
Apr;2(4):e7. http://www.ncbi.nlm.nih.gov/pubmed/26360097
109. Chalder T, Goldsmith K, White P, Sharpe M & Pickles A (2015) Methods and outcome reporting
in the PACE trialAuthor's reply. Lancet Psychiatry. Apr;2(4):e10-1. http://www.ncbi.nlm.nih.gov/
pubmed/26360091
110. Daily Mail Comment (2015) Welfare reforms can only benefit Britain. Daily Mail, 22 June. http://
www.dailymail.co.uk/debate/article-3133927/DAILY-MAIL-COMMENT-Welfare-reforms-benefit-Britain.
html
111. Pemberton M (2015) Cutting benefits for drunks and the obese isn't cruel - it's kind. Daily Mail,
1 August. http://www.dailymail.co.uk/health/article-3181951/DR-MAX-MIND-DOCTOR-Cuttingbenefits-drunks-obese-isn-t-cruel-s-kind.html
112. Duncan Smith I (2015) We're Building a Welfare State That Is Finally Fit for Purpose. Huffington
Post. http://www.huffingtonpost.co.uk/iain-duncan-smith/welfare-reform-iain-duncan-smith_b_7977040.
html?ncid=tweetlnkushpmg00000067
113. The Economist - Special Report (2015) Benefits treat. The Economist, 11 Apr. http://www.
economist.com/news/special-report/21647793-expect-even-bigger-changes-welfare-system-benefits-treat
114. Guy C (2015) There's a reason Iain Duncan Smith looked so happy. The Telegraph, 08 Jul. http://www.
telegraph.co.uk/finance/budget/11727916/Theres-a-reason-Iain-Duncan-Smith-looked-so-happy.html
115. Duncan Smith I (2015) Iain Duncan Smith responds to open letter from Catholics on welfare reform.
Ekklesia. http://linkis.com/www.ekklesia.co.uk/n/21692 A reply to this response is also available here:
http://www.ekklesia.co.uk/node/21932
116. Hennesy P (2013) New welfare row as 600,000 are set to come off disability benefit. The Telegraph, 07
Apr. http://www.telegraph.co.uk/news/politics/9976558/New-welfare-row-as-600000-are-set-to-come-offdisability-benefit.html
117. Channel 4 News (2013) Disability benefits reform kicks in. Channel 4 , 10 June. http://www.channel4.
com/news/disability-benefits-pip-dla-change-reform
118. Butler P (2014) UK 'sleepwalking into violating disabled people's human rights'. The Guardian. 7 July.
http://www.theguardian.com/uk-news/2014/jul/07/uk-sleepwalking-violating-disabled-peoples-humanrights-charities
119. Ross T (2014) Tories discuss stripping benefits claimants who refuse treatment for depression. The
Telegraph. 12 Jul. http://www.telegraph.co.uk/news/politics/conservative/10964125/Tories-discussstripping-benefits-claimants-who-refuse-treatment-for-depression.html
120. Buchanan M (2015) Sickness benefit shake-up considered. BBC News. 2 July. http://www.bbc.co.uk/
news/uk-33347511
121. Osborne G (2015) The Summer Budget speech in full. HM Treasury. 8 July. https://www.gov.uk/
government/speeches/chancellor-george-osbornes-summer-budget-2015-speech
122. Osborne G (2015) Calling all progressives: help us reform the welfare state. The Guardian. 19 July.
http://www.theguardian.com/commentisfree/2015/jul/19/george-osborne-progressive-reform-welfarebenefits-system
123. Land J (2012) Freud on the couch. 24housing Magazine. June. http://www.24housing.co.uk/feature/
freud-couch
124. Mc Grath M Secretary DLAAB Record of talk on Chronic Fatigue Syndrome given by Thomas, PK.
and Wessely, S. 2 November 1993. Ref BN 141/1 508554. UK National Archives. Available at: https://
valerieeliotsmith.files.wordpress.com/2015/01/natarchbn141dss.pdf
125. Dwyer P, McNeil J & Scullion L (2014) Conditionality Briefing: Disabled People. Welfare
Conditionality: Sanctions, Support and Behaviour Change. http://www.welfareconditionality.ac.uk/
wp-content/uploads/2014/09/Briefing_Disability_14.09.10_FINAL.pdf
126. Rutherford J (2011) New Labour, the market state, and the end of welfare. Soundings. Available at:
http://www.midmoors.co.uk/Unum/unum_in_uk.pdf
127. White PD (2005) Biopsychosocial medicine: An integrated approach to understanding illness. Oxford
University Press.
128. MacAskill E & Brindle D (1999) Labour revolt that spun out of control. The Guardian. 3 November.
http://www.theguardian.com/politics/1999/nov/03/welfarereform.labour
129. MacAskill E (1999) Labour rebels go for Darling on welfare cut. The Guardian. 4 November. http://
www.theguardian.com/politics/1999/nov/04/welfarereform.politicalnews
130. BBC News (1997) Protesters throw 'Blair's blood'. BBC. 23 December. http://news.bbc.co.uk/1/hi/
uk/41746.stm
131. Lister R (2013) Benefit cuts: how the language of welfare poisoned our social security. The Guardian. 1
April. http://www.theguardian.com/commentisfree/2013/apr/01/language-welfare-social-security
132. Hayes P (2011) From working class to incapacitated class. Spiked. 27 July. http://www.spiked-online.
com/newsite/article/10931#.VibwzG4srOg
133. Department for Work & Pensions (2006) A new deal for welfare: Empowering people to work. DWP.
www.official-documents.gov.uk/document/cm67/6730/6730.pdf
134. Park A, Clery E, Curtice J, Phillips M & Utting D (2012) Welfare. British Social Attitudes: the 29th
Report. NatCen Social Research. http://www.bsa.natcen.ac.uk/media/38852/bsa29_full_report.pdf
135. Larun L, Brurberg KG, Odgaard-Jensen J & Price JR (2015) Exercise therapy for chronic fatigue
syndrome. Cochrane Database of Systematic Reviews, Issue 2. Art. No.: CD003200. http://www.ncbi.nlm.
nih.gov/pubmed/25674924
136. Ratcliffe L & Aylward M (2013). Getting better at work. New Zealand Doctor. Youtube. https://www.
youtube.com/watch?v=vPNqBJ4n-x0&feature=youtu.be
137. The Conservative Party (2015) Party Manifesto. United Kingdom. http://issuu.com/
conservativeparty/docs/ge_manifesto_low_res_bdecb3a47a0faf?e=16696947/12362115#search
138. The British Psychological Society (2015) BPS response to announcement of Government review of
sickness benefit system. 29 July. http://www.bps.org.uk/news/bps-response-announcement-governmentreview-sickness-benefit-system
139. British Association of Behavioral & Cognitive Psychotherapies Board (2015) 'Coercive' therapy
proposals for Jobcentres - Statement from the BABCP Board. 25 June. http://www.babcp.com/About/Press/
Coercive-Therapy-Proposals-for-Jobcentres-Statement-From-BABCP-Board.aspx
140. Clark DM (2011) Implementing NICE guidelines for the psychological treatment of depression and
anxiety disorders: The IAPT experience. International Review of Psychiatry (Abingdon, England), 23(4),
318327. http://www.ncbi.nlm.nih.gov/pmc/articles/PMC3212920/
141. British Association of Behavioral & Cognitive Psychotherapies (2010) Standards of Conduct,
Performans and Ethics. BABCP. http://www.babcp.com/files/About/BABCP-Standards-of-ConductPerformance-and-Ethics.pdf
142. Howe A (2012) Department of Health consultation: No decision about me, without me. Royal College
of General Practitioners. 31st August. http://www.rcgp.org.uk/policy/rcgp-consultations/~/media/Files/
Policy/Closed%20consultations/RCGP_response_to_No_decision_about_me_without_me.ashx
143. Wessely S, David A, Butler S & Chalder T (1989) Management of chronic (post-viral) fatigue
syndrome. The Journal of the Royal College of General Practitioners, 39(318), 2629. http://www.ncbi.nlm.
nih.gov/pubmed/2553945
144. Sharpe M, Chalder T, Palmer I & Wessely S (1997) Chronic fatigue syndrome. A practical guide to
assessment and management. General Hospital Psychiatry. Volume 19, Issue 3, pp. 185199. http://www.
ncbi.nlm.nih.gov/pubmed/9218987
145. Science Media Centre (2011) Expert reaction to Lancet study looking at treatments for Chronic
Fatigue Syndrome/ME. http://www.sciencemediacentre.org/expert-reaction-to-lancet-study-looking-attreatments-for-chronic-fatigue-syndromeme-2-2/
146. Bleijenberg G, Prins JB & Bazelmans E (2003) Cognitive-behavioral therapies. In Handbook of
Chronic Fatigue Syndrome (ed. L. A. Jason, P. A. Fennell and R. R. Taylor). pp. 493526. Wiley. New York.
147. Page LA & Wessely S (2003) Medically unexplained symptoms: exacerbating factors in the doctor
patient encounter. Journal of the Royal Society of Medicine, 96(5), 223227. http://www.ncbi.nlm.nih.gov/
pubmed/12724431
148. Arends I, Bruinvels DJ, Rebergen DS, Nieuwenhuijsen K, Madan I, Neumeyer-Gromen A,
Bultmann U & Verbeek JH (2012) Interventions to facilitate return to work in adults with adjustment
disorders. Cochrane Database Syst Rev CD006389 http://www.ncbi.nlm.nih.gov/pubmed/23235630
149. Nieuwenhuijsen K, Faber B, Verbeek JH, Neumeyer-Gromen A, Hees HL, Verhoeven AC, van
der Feltz-Cornelis CM & Bltmann U (2014) Interventions to improve return to work in depressed people.
Cochrane Database of Systematic Reviews CD006237. http://www.ncbi.nlm.nih.gov/pubmed/25470301
150. Kamper SJ, Apeldoorn AT, Chiarotto A, Smeets RJ, Ostelo RWJG, Guzman J & van Tulder MW
(2014) Multidisciplinary biopsychosocial rehabilitation for chronic low back pain. Cochrane Database of
Systematic Reviews CD000963. http://www.ncbi.nlm.nih.gov/pubmed/25180773
151. Chesterton A & Crawley E (2011) The cost of chronic fatigue. The Naked Scientists. http://www.
thenakedscientists.com/HTML/science-news/news/2384/
152. Atos Miracles (2011) About ATOS Miracles. Facebook. https://www.facebook.com/ATOSM/
info?tab=page_info
153. Wearden AJ et al (2010) Nurse led, home based self help treatment for patients in primary care with
chronic fatigue syndrome: randomised controlled trial. British Medical Journal, 340, c1777. http://www.ncbi.
nlm.nih.gov/pubmed/20418251
154. Action for ME (2003) PACE Research Study Q & A. Action for ME. http://web.archive.org/
web/20030804230351/www.afme.org.uk/news/pace-q&a.shtml
155. Crawley E, Collin SM, White PD, Rimes K, Sterne JAC, May MT & CFS/ME National Outcomes
Database (2013) Treatment outcome in adults with chronic fatigue syndrome: a prospective study in England
based on the CFS/ME National Outcomes Database. QJM: An International Journal of Medicine, 106(6),
555565. http://www.ncbi.nlm.nih.gov/pubmed/23538643
156. Kindlon T (2011) Reporting of Harms Associated with Graded Exercise Therapy and Cognitive
Behavioural Therapy in Myalgic Encephalomyelitis/Chronic Fatigue Syndrome. Bull IACFS ME.
2011;19:59-111. http://iacfsme.org/ME-CFS-Primer-Education/Bulletins/BulletinRelatedPages5/
Reporting-of-Harms-Associated-with-Graded-Exercise.aspx
157. ME Association (2015) ME/CFS Illness Management Survey Results: No decisions about me without
me http://www.meassociation.org.uk/wp-content/uploads/2015-ME-Association-Illness-ManagementReport-No-decisions-about-me-without-me-30.05.15.pdf
158. Peters S, Wearden A, Morriss R, Dowrick CF, Lovell K, Brooks J, Cahill G, Chew-Graham C &
FINE Trial Group (2011) Challenges of nurse delivery of psychological interventions for long-term conditions
in primary care: a qualitative exploration of the case of chronic fatigue syndrome/myalgic encephalitis.
Implementation Science: IS, 6, 132. http://www.ncbi.nlm.nih.gov/pubmed/22192566
159. The Fine Trial (2004) The Pragmatic Rehabilitation Initial Presentation. http://www.fine-trial.net/
downloads/CFS%20patient%20presentation.pdf
160. Tuller D (2015) Trial By Error: The Troubling Case of the PACE Chronic Fatigue Syndrome Study.
Virology Blog. http://www.virology.ws/2015/10/21/trial-by-error-i/
161. Tuller D and Racaniello VR (2009-2016) ME/CFS. Virology Blog. http://www.virology.ws/mecfs/
162. Davis RW, Edwards JCW, Jason LA, Levin B, Racaniello VR and Reingold AL (2015) An open
letter to Dr. Richard Horton and The Lancet. Virology Blog. http://www.virology.ws/2015/11/13/an-openletter-to-dr-richard-horton-and-the-lancet/
163. Davis RW et al (2015) An open letter to Dr. Richard Horton and The Lancet, again. Virology Blog.
http://www.virology.ws/2016/02/10/open-letter-lancet-again/
164. Tuller D (2015) Trial by error, Continued: PACE Teams Work for Insurance Companies Is Not
Related to PACE. Really? Virology Blog. http://www.virology.ws/2015/11/17/trial-by-error-continuedpace-teams-work-for-insurance-companies-not-related-to-pace-really/
165. Swiss Re (2013) Managing claims for chronic fatigue the active way. Client Newsletter. This had been
available at: http://www.swissre.com/clients/newsletters/Managing_claims_for_chronic_fatigue_the_
active_way.html
166. Sharpe M, Goldsmith KA, Johnson AL, Chalder T, Walker J & White P (2015) Rehabilitative
treatments for chronic fatigue syndrome: long-term follow-up from the PACE trial. The Lancet Psychiatry:
2,12. http://www.thelancet.com/journals/lanpsy/article/PIIS2215-0366%2815%2900317-X/fulltext
167. Kings College London (2015) Treatments offer hope for Chronic Fatigue Syndrome (CFS/ME). Press
Release. http://www.kcl.ac.uk/ioppn/news/records/2015/October/Treatments-offer-hope-for-ChronicFatigue-Syndrome-%28CFSME%29.aspx
168. The Daily Telegraph (2015) Front Page. Wednesday, 28th October. https://pbs.twimg.com/media/
CSWu6sEXIAA7ljZ.png:large
169. Coyne JC (2015) Uninterpretable: Fatal flaws in PACE Chronic Fatigue Syndrome follow-up study.
Mind the Brain, PLOS Blogs. http://blogs.plos.org/mindthebrain/2015/10/29/uninterpretable-fatal-flawsin-pace-chronic-fatigue-syndrome-follow-up-study/
170. Laws KR (2015) PACE - Thoughts about Holes. LawsDystopiaBlog. http://keithsneuroblog.blogspot.
co.uk/2015/11/pace-thoughts-about-holes.html
171. Coyne JC & Laws KR (2016) Results of the PACE follow-up study are uninterpretable. The Lancet
Psychiatry: 3,2. http://www.thelancet.com/journals/lanpsy/article/PIIS2215-0366%2815%2900551-9/
fulltext
172. Cragg R (2015) Decision notice FS50565190. The Information Commissioner's Office. https://ico.org.
uk/media/action-weve-taken/decision-notices/2015/1560081/fs_50565190.pdf
173. Information Tribunal (2016) Current Cases at 09/03/2016. Case FS50565190, Queen Mary
University of London and Mr Alem Matthees. https://www.gov.uk/government/uploads/system/uploads/
attachment_data/file/499044/information-rights-tribunal-register-cases.pdf
174. ME Action (2015) Vexatious: Kings College London dismisses James Coynes request for PLOS One
PACE data. Meaction.net http://www.meaction.net/2015/12/12/vexatious-kings-college-london-dismissesjames-coynes-request-for-plos-one-pace-data/
175. Daley B (2015) King's College London response to data request from Prof Coyne. 11th December.
https://dl.dropboxusercontent.com/u/23608059/PACE%20F325-15%20-%20Prof.%20James%20Coyne%20
-%20Response-2.pdf
176. Oransky I & Marcus A (2015) To keep science honest, study data must be shared. STAT. http://www.
statnews.com/2015/12/23/sharing-data-science/
177. PLOS ONE Group (2015) Notification from PLOS staff. PLOS One. http://www.plosone.org/
annotation/listThread.action?root=87754
178. Gelman A (2015) Tug of War: Epic battle over data in controversial paper on chronic fatigue syndrome.
Statistical Modeling, Causal Inference, and Social Science. http://andrewgelman.com/2015/12/18/28362/
179. Lewandowsky S (2015) Science and Society at the Crossroads: Skepticism vs. Denial and Elitism vs.
Public Engagement. Royal Society. https://figshare.com/articles/RS_scienceandsociety_September_2015_
pdf/2061696
180. Sharpe M & Chalder T (2011) CFS/ME trial. Briefing for journalists. Science Media Centre. http://
www.sciencemediacentre.org/cfsme-trial/
181. Sharpe M & McCrone P (2012) Do the best treatments for CFS cost more? Briefing for journalists.
Science Media Centre. http://www.sciencemediacentre.org/do-the-best-treatments-for-cfs-cost-more-3/
182. Crawley E, Hamilton W & Miller A (2013) Expert reaction to new research into therapies for
Chronic Fatigue Syndrome/ME [recovery paper]. Round up for journalists. Science Media Centre. http://
www.sciencemediacentre.org/expert-reaction-to-new-research-into-therapies-for-chronic-fatiguesyndromeme/
183. Science Media Centre (2013) Chronic Fatigue Syndrome unravelling the controversy. Science Media
Centre. http://www.sciencemediacentre.org/chronic-fatigue-syndrome-unravelling-the-controversy/
184. Chalder T & Goldsmith K (2015) CFS/ME: The next step in the controversy. Briefing for journalists.
Science Media Centre. http://www.sciencemediacentre.org/cfsme-the-next-step-in-the-controversy-2/
185. Bithell C (2013) Review of the first three years of the mental health research function at the Science
Media Centre. Science Media Centre. http://www.sciencemediacentre.org/wp-content/uploads/2013/03/
Review-of-the-first-three-years-of-the-mental-health-research-function-at-the-Science-Media-Centre.pdf
186. Fox F & White PD (2013) FOI Letter final. 31st October. Copy available at: https://mobile.twitter.
com/maxwhd/status/674567886460076032
187. White PD (2015) On-line response to Freedom of Information Act review. https://www.gov.uk/
government/uploads/system/uploads/attachment_data/file/487271/Online_Responses_CitizenSpace.xls
188. Queen Mary University London (2015) The PACE trial; A RCT of CBT, graded exercise, adaptive
pacing and usual medical care for the chronic fatigue syndrome. Gateway to Research. Research Councils
UK. http://gtr.rcuk.ac.uk/project/7EC0DBA0-0FC2-44F1-8708-8676EBEDA4C9#tabOutcomes
189. Investigators of the PACE trial (2015) Statement: release of individual patient data from the PACE
trial. Queen Mary University of London http://www.qmul.ac.uk/media/news/items/smd/168729.html
190. #ME Action (2016) 24 organisations in 14 countries tell QMUL: release PACE data. ME Action http://
www.meaction.net/2016/03/13/24-organisations-in-14-countries-tell-qmul-release-pace-data/
191. Action for ME (2016) Our letter in support of PACE trial data release. Action for ME https://www.
actionforme.org.uk/news/our-letter-in-support-of-pace-trial-data-release/
192. ME Action (2015) Misleading PACE claims should be retracted. ME Action http://my.meaction.net/
petitions/pace-trial-needs-review-now
193. Schneider L (2016) PACE trial and other clinical data sharing: patient privacy concerns and parasite
paranoia. For Better Science https://forbetterscience.wordpress.com/2016/02/08/pace-trial-and-otherclinical-data-sharing-patient-privacy-concerns-and-parasite-paranoia/
194. Wessely S (2015) The PACE trial for chronic fatigue syndrome: choppy seas but a prosperous voyage.
The Mental Elf http://www.nationalelfservice.net/other-health-conditions/chronic-fatigue-syndrome/thepace-trial-for-chronic-fatigue-syndrome-choppy-seas-but-a-prosperous-voyage/
195. Rehmeyer J (2015) Hope for Chronic Fatigue Syndrome. Slate http://www.slate.com/articles/health_
and_science/medical_examiner/2015/11/chronic_fatigue_pace_trial_is_flawed_should_be_reanalyzed.
html
196. Tuller D (2016) Reexamining Chronic Fatigue Syndrome Research and Treatment Policy. Health
Affairs http://healthaffairs.org/blog/2016/02/04/reexamining-chronic-fatigue-syndrome-research-andtreatment-policy/
197. Cohen J (2015) Criticism mounts of a long-controversial chronic fatigue study. Science http://www.
sciencemag.org/news/2015/10/criticism-mounts-long-controversial-chronic-fatigue-study
198. Marcus AD (2016) Patients, Scientists Fight Over Research-Data Access. The Wall Street Journal
http://www.wsj.com/articles/patients-scientists-fight-over-research-data-access-1457394712
199. Liddle R (2015) It's time to admit that chronic fatigue syndrome is not actually a chronic illness. The
Spectator. http://blogs.spectator.co.uk/2015/11/lets-just-admit-that-chronic-fatigue-syndrome-is-notactually-a-chronic-illness/
200. Liddle R (2015) The ME lobby is just a symptom of our stupidity about mental illness. The Spectator.
http://www.spectator.co.uk/2015/11/the-me-lobby-is-just-a-symptom-of-our-stupidity-about-mentalillness/
201. Science Media Centre (2015) Expert reaction to long-term follow-up study from the PACE trial on
rehabilitative treatments for CFS/ME, and accompanying comment piece. Science Media Centre.
http://www.sciencemediacentre.org/expert-reaction-to-long-term-follow-up-study-from-the-pace-trialon-rehabilitative-treatments-for-cfsme-and-accompanying-comment-piece/
202. Marchant J (2016) 'It was like being buried alive': battle to recover from chronic fatigue syndrome. The
Guardian. http://www.theguardian.com/society/2016/feb/15/it-was-like-being-buried-alive-victim-ofchronic-fatigue-syndrome
203. O'Sullivan S (2015) It's All In Your Head: True Stories of Imaginary Illness. Chatto & Windus.
204. Blakemore C (2011) Disease of the brain, not the mind, has no stigma. The Times. http://www.
thetimes.co.uk/tto/opinion/columnists/article3112079.ece
205. Liddle R (2015) Selfish Whining Monkeys: How we Ended Up Greedy, Narcissistic and Unhappy.
Fourth Estate.
Relevant Publications
A FAIR SOCIETY?
This report explains how government
cuts in the UK target disabled people
and offers explanations for the
underlying politics.
http://bit.ly/afscuts
PEOPLE, PLACES,
POSSIBILITIES
In this report Ralph Broad outlines
the progress made in implementing
Local Area Coordination in England and
Wales between 2012 and 2015.
http://bit.ly/LAC-2
WHO CARES?
Robin Jackson offers a critique of
the UK's social care system and
the negative impact of ideology,
marketisation and bureaucracy.
http://bit.ly/care-crisis
PUBLISHED BY
THE CENTRE FOR WELFARE REFORM