Comprehensive Cost-Utility Analysis of Newborn Screening Strategies
Comprehensive Cost-Utility Analysis of Newborn Screening Strategies
Comprehensive Cost-Utility Analysis of Newborn Screening Strategies
The online version of this article, along with updated information and services, is
located on the World Wide Web at:
http://www.pediatrics.org/cgi/content/full/117/5/S1/S287
a Children’s Health Services Research, Indiana University School of Medicine, Indianapolis, Indiana; bRegenstrief Institute for Health Care, Indianapolis, Indiana
The authors have indicated they have no financial relationships relevant to this article to disclose.
ABSTRACT
BACKGROUND. Inborn errors of metabolism are a significant cause of morbidity and
death among children. Inconsistencies in how individual states arrive at screening
www.pediatrics.org/cgi/doi/10.1542/
strategies, however, lead to marked variations in testing between states. peds.2005-2633H
OBJECTIVE. To determine the cost-effectiveness of each component test of a multitest doi:10.1542/peds.2005-2633H
newborn screening program, including screening for phenylketonuria, congenital The views expressed in this article are
those of the authors and do not necessarily
adrenal hyperplasia, congenital hypothyroidism, biotinidase deficiency, maple represent the views of the Indiana
syrup urine disease, galactosemia, homocystinuria, and medium-chain acyl-CoA University School of Medicine.
dehydrogenase deficiency. Key Words
newborn, screening, decision analysis,
METHODS. A decision model was used, with cohort studies, government reports, cost-effectiveness, cost utility
secondary analyses, and other sources. Discounted costs, quality-adjusted life- Abbreviations
PKU—phenylketonuria
years (QALYs), and incremental cost-effectiveness ratios were measured. MS/MS—tandem mass spectrometry
CAH— congenital adrenal hyperplasia
RESULTS. All except 2 screening tests dominated the “no-test” strategy. The 2 excep- CH— congenital hypothyroidism
tions were screening for congenital adrenal hyperplasia, which cost slightly more MSUD—maple syrup urine disease
than $20 000 per QALY gained, and screening for galactosemia, which cost QALY— quality-adjusted life-year
CP— cerebral palsy
$94 000 per QALY gained. The screening test with the lowest expected cost was MCAD—medium-chain acyl-CoA
tandem mass spectrometry. The results found in our base-case analysis were stable dehydrogenase
across variations in nearly all variables. In instances in which changes in risks, Accepted for publication Dec 27, 2005
Address correspondence to Aaron E. Carroll,
sequelae, costs, or utilities did affect our results, the variation from base-case MD, MS, Riley Research 330, 699 West Dr,
estimates was quite large. Indianapolis, IN 46074. E-mail: aaecarro@iupui.
edu
CONCLUSIONS. Newborn screening seems to be one of the rare health care interven- PEDIATRICS (ISSN Numbers: Print, 0031-4005;
tions that is beneficial to patients and, in many cases, cost saving. Over the long Online, 1098-4275); published in the public
domain by the American Academy of
term, funding comprehensive newborn screening programs is likely to save money Pediatrics
for society.
uria. PKU was associated with a risk of mild, moderate, ical and administrative data sources. We searched Med-
or severe developmental delay and/or seizure disorder. line (from January 1980 to November 2002) for studies
CAH could lead to early childhood death (average life with the terms “newborn screening” and any of the
expectancy: 1 year). CH could cause mild, moderate, or disease entities we were investigating. We also searched
severe delay. Biotinidase deficiency could lead to any online Internet databases for the same terms. We sup-
combination of seizure disorder, severe developmental plemented this strategy by hand-searching citation lists
delay, hearing loss, or blindness. MSUD could lead to from articles identified in the electronic search and re-
any combination of severe or mild cerebral palsy (CP) or cent reviews and cost-effectiveness analyses of other
mild, moderate, or severe developmental delay. Galac- newborn screening strategies.
tosemia could lead to death in infancy or moderate or The prevalence of each disease was estimated, when
severe delay. Homocystinuria had a risk of mild, mod- possible, from the National Newborn Screening Report.18
erate, or severe delay and/or vision loss. MCAD defi- Supplemental information was taken from the American
ciency could lead to early death (modeled as death at 1 Academy of Pediatrics newborn screening fact sheets
year, on average) or CP and/or mild-to-severe develop- and secondary analyses.8,19 We determined the sensitiv-
mental delay. Children with no disease face a risk of a ities and specificities of the various screening tests
false-positive newborn screening result and its attendant through national reports and other secondary analy-
expenses. ses.10,13,18,20 Probabilities of various sequelae and the ef-
The probability of each of the outcomes with screen- fectiveness of early intervention in preventing these se-
ing, P(outcome兩screen), was represented by the formula quelae were also estimated from the newborn screening
P(outcome兩screen) ⫽P(outcome) ⫻ [1 ⫺ (efficacy ⫻ sen- fact sheets, secondary data analyses, and cohort studies
sitivity)], where P(outcome) is the probability of the of patients with the diseases in question.19,21–28 Base-case
outcome (eg, CP or delay), without screening or treat- probabilities for major complications are summarized in
ment, derived from the literature (see below), efficacy is Table 1.
the efficacy of early detection and treatment in prevent-
ing the outcome, and sensitivity is the sensitivity of the Estimation of Life Expectancy
screening test for the disease. We estimated the average life expectancy of normal
patients from the National Vital Statistics Reports published
Data and Assumptions by the Centers for Disease Control and Prevention.29 We
Probabilities of sequelae, quality-adjusted survival rates, estimated the effect of disability on life expectancy
and costs for treatment were derived from various clin- through a cohort study on the subject.30
SUPPLEMENT S289
Downloaded from www.pediatrics.org by on September 20, 2010
TABLE 1 Data Used In Decision Tree
Base Case Reference Threshold
Test characteristics
Sensitivity of newborn screening tests (for all conditions) 1 13 Table 4
Specificity of BIOT screening test 0.9998 13 0.958
Specificity of CAH screening test 0.992 13
Specificity of CH screening test 0.985 13 0.970
Specificity of GAL screening test 0.997 13
Specificity of HCY screening test 0.9993 20 0.994
Specificity of MS/MS testing 0.9975 10 0.854
Specificity of MSUD screening test 0.9987 10 0.997
Specificity of PKU screening test 0.998 13 0.881
Disease prevalence, cases per 100 000 infants
BIOT 1.1 18 0.2
CAH 4.9 18 3500
CH 39.6 18 28.0
GAL 1.5 18
HCY 0.4 18 0.16
MCAD deficiency 9.0 19
MSUD 0.6 18 0.48
PKU 6.6 18 0.8
Probability of disease causing sequelae
BIOT, hearing loss 0.76 25
BIOT, severe developmental delay 0.50 24
BIOT, seizure disorder 0.70 24
BIOT, vision loss 0.50 24
Risk of death from CAH in first 5 y 0.10 Expert opinion
CH, mild developmental delay 0.27 19 0.018
CH, moderate developmental delay 0.021 19
CH, severe developmental delay 0.019 19 0.0082
GAL, neonatal death 0.14 27 ⬎0.27
GAL, moderate developmental delay 0.90 26
GAL, severe developmental delay 0.10 26
HCY, blindness 1 22 0.4
HCY, mild developmental delay 0.11 21
HCY, moderate developmental delay 0.33 21
HCY, severe developmental delay 0.05 21
MCAD deficiency, moderate CP 0.10 28
MCAD deficiency, neonatal death 0.204 21
MCAD deficiency, mild developmental delay 0.05 9
MCAD deficiency, severe developmental delay 0.05 9
MSUD, moderate CP 0.50 23
MSUD, severe CP 0.25 23 0.14
MSUD, severe developmental delay 0.50 23 0.34
PKU, mild developmental delay 0.05 24
PKU, moderate developmental delay 0.475 24
PKU, severe developmental delay 0.475 24
PKU, seizure disorder 0.25 24
Effectiveness of early screening in preventing sequelae
BIOT, developmental delay 1 19
BIOT, hearing loss 1 19
BIOT, seizure disorder 1 19
BIOT, vision loss 1 19
CAH, preventing death from crisis 0.8 Expert opinion
CH, developmental delay 1 19 0.67
GAL, neonatal death 0.66 21
GAL, developmental delay 0 21
HCY, blindness 1 22 0.31
HCY, developmental delay 1 22
MCAD deficiency, neonatal death 0.98 21
MSUD, CP 0.93 23 0.59
MSUD, developmental delay 0.53 19, 24 0.36
PKU, developmental delay 1 24 0.01
PKU, seizure disorder 1 24
Quality-of-Life Adjustments urban emergency department. These were the most rel-
We adjusted life expectancy for quality of life by using evant utilities available for these outcomes. Utilities for
health state utilities.17 We calculated QALYs by multiply- blindness were taken from a study that developed an
ing remaining years of life by the utility value for each equation for estimating utility on the basis of visual
health state. Utilities for most disabilities were drawn acuity.32 We did not adjust utility if a disease state did not
from a study assessing parents’ utilities by using a stan- result in a disability that was thought to affect quality of
dard gamble, adjusting for different severities when nec- life. Base-case estimates for utilities are summarized in
essary.31 The study assessed utilities for outcomes of Table 1.
occult bacteremia and meningitis, which resemble
closely outcomes of the diseases for which newborns are Costs
screened. Specifically, parent utilities were assessed for The costs for the specific screening tests were derived
deafness and various degrees of developmental delay from 2 sources, ie, a PriceWaterhouseCoopers analysis of
and CP. Respondents in the study were parents of chil- newborn screening costs and a prior cost-effectiveness
dren between 2 and 24 months of age who visited an study of MS/MS screening.9,33 These costs incorporated
SUPPLEMENT S291
Downloaded from www.pediatrics.org by on September 20, 2010
amortized start-up costs and operating costs. The costs of to $1 million. To test the impact of changing multiple
treating selected diseases over the course of a lifetime assumptions, we developed a “pessimistic” case analysis
were estimated with data from the Office of Technology that biased the model against newborn screening. In the
Assessment analysis of strategies for newborn screening, pessimistic case, we eliminated indirect costs from the
data from a Washington State report on the cost-effec- estimated costs of developmental delay and CP.35 We
tiveness of some screening strategies, and, in 1 case, eliminated the costs of developmental delay from any
expert opinion.21,34 Costs of treating sequelae of different outcomes that included CP. We increased the cost of
diseases were estimated from sources including a Mor- MS/MS to $20, the high end of published estimates. We
bidity and Mortality Weekly Report on economic costs as- increased the cost of evaluating false-positive screening
sociated with mental retardation, CP, hearing loss, and test results to $1000. We used low-end estimates for the
visual impairment; an epidemiologic study of end-of-life prevalence of MCAD deficiency (1 case per 18 000 in-
care costs; and prior secondary analyses.14,21,35,36 All costs fants) and PKU (1 case per 20 000 infants). We also used
were adjusted to 2004 US dollars with an inflation cal- a low-end estimate of the risk of death resulting from
culator on the Web site of the Department of Labor, CAH (3%).
Bureau of Labor Statistics.37 For this study, costs were a
complex mixture of medical and nonmedical costs, and
RESULTS
we elected to adjust costs with the General Consumer
Price Index, rather than the Medical Care Component Base-Case Analysis
Consumer Price Index. Base-case estimates for costs are The results of the base-case analysis are shown in Table
summarized in Table 1. 2. The first column of Table 2 shows the testing strategies
in ascending order of average cost. The second column
Time Preference shows the average cost of each strategy. This includes
To reflect patient preferences for health outcomes and the cost of the test and the average costs (per person
having material goods sooner rather than later, we dis- screened) associated with all of the treatments and out-
counted all costs and health effects at an annual rate of comes for the diseases represented in the model. The
3%. third column shows the difference in average costs be-
tween the testing strategy and not testing. A negative
Calculation of Incremental Cost-Effectiveness Ratios number means the strategy saves money, on average,
For each treatment strategy, we calculated the expected over not screening. The fourth column shows the aver-
total costs by multiplying the probability of each unique age effectiveness of each strategy in QALYs. The fifth
outcome with its associated costs and then adding these column shows the difference in effectiveness between
values for all possible outcomes. Total QALYs for each each strategy and not testing. A positive number means
treatment were calculated in a similar manner. We then there is a gain in QALYs. The sixth column is the average
calculated the incremental cost-effectiveness of each cost-effectiveness ratio for each strategy, and the sev-
screening strategy by dividing the difference in costs by enth column is the incremental cost-effectiveness ratio,
the difference in QALYs. the incremental cost per QALY gained. Tests marked as
“Dominates” save money and improve outcomes rela-
Sensitivity Analysis tive to not testing.
We used 1-way sensitivity analysis to identify important All except 2 screening tests dominated the no-testing
model uncertainties. All probabilities were tested across strategy. That is, these screening tests improved out-
the full range from 0 to 1. Costs were analyzed from $0 comes and reduced costs relative to not screening. The 2
SUPPLEMENT S293
Downloaded from www.pediatrics.org by on September 20, 2010
disease costs were between 2 and 10 times reported costs sults must be minimized to realize the cost savings of
of screening tests. Conversely, screening for galactosemia these screening strategies.
or CAH was not cost saving even if tests could be per- Our pessimistic case analysis was intended to elimi-
formed for free. nate biases favoring newborn screening. With these as-
Lifetime costs of diseases and their sequelae are diffi- sumptions, newborn screening with conventional test-
cult to estimate. However, we found that the cost saving ing or MS/MS methods was not cost saving. However,
for most of these screening tests was either insensitive or the incremental costs per QALY were very low, com-
sensitive at values significantly below reported rates. pared with conventional health economic bench-
Our pessimistic case analysis biased the model against marks.38,39
screening. Under this set of assumptions, newborn As with all cost-effectiveness analyses, our study is
screening with MS/MS methods was not cost saving limited by the validity of our assumptions about risks,
relative to a conventional screening panel, and the costs, and quality of life. For example, we assumed that
screening panel was not cost saving relative to no data from small cohort studies would predict accurately
screening (Table 5). The conventional screening panel the occurrence of sequelae in the population at large.
cost $310.56 per QALY saved over not screening. Com- We were forced to make some broad assumptions about
pared with this panel, MS/MS screening cost $4838.71 lifetime costs that could not take into account changes in
per QALY saved. technology or care. It is also inherently difficult to esti-
mate quality of life across different disease states, espe-
cially with respect to children. However, we found that
DISCUSSION incremental cost-effectiveness was relatively unaffected
Newborn screening for PKU, CH, biotinidase deficiency, by even large changes in nearly all of our variables.
MSUD, and homocystinuria individually not only was Another serious weakness of this study is the cost
cost-effective but actually was cost saving in our base- estimates for most of the conventional screening tests.
case analysis. Use of MS/MS to screen for PKU, biotini- We used estimates from PriceWaterhouseCoopers.33 This
dase deficiency, MSUD, and homocystinuria, as well as study merely compiled global estimates by various new-
MCAD deficiency, had even greater cost savings because born screening programs. There was no effort to divide
of the multiplicity of conditions detected with a single fixed and marginal costs, and programs were not con-
test. This was true even when MS/MS was compared sistent in which costs were included in their estimates.
directly with a panel of available conventional tests for Nevertheless, these are the best estimates currently
the same conditions. Screening for CAH had a net cost available. A more-careful microeconomic analysis of
per QALY gained; however the cost was less than the screening program costs would be needed to improve these
$50 000 per QALY used conventionally as a benchmark estimates; however, considering our sensitivity analyses, it
for cost-effectiveness.38,39 seems unlikely that more carefully derived costs would
At more than $90 000 per QALY, screening for galac- show that newborn screening was not cost-effective.
tosemia generally would not be considered cost-effec- Newborn screening seems to be one of the rare health
tive. This is because identifying galactosemia early may care interventions that is beneficial to patients and, with
prevent a neonatal death but doing so induces high some assumptions, cost saving. Over the long term,
lifetime costs because of sequelae. In our sensitivity anal- funding comprehensive newborn screening programs
yses, we found that under no circumstances would may save money for society. Even with pessimistic as-
screening for galactosemia be cost saving. However, if sumptions, newborn screening seems to be highly cost-
the risk of neonatal death resulting from galactosemia is effective. Although additional refinements of cost esti-
as high as 27%, then screening for galactosemia is cost- mates may be justified, they are unlikely to change these
effective according to conventional criteria. In addition, conclusions materially. Cost-effectiveness analysis will
the marginal cost of screening for galactosemia with continue to be a useful way to consider which screening
MS/MS or in a panel of newborn screens seems to be tests to include.
cost-effective.
Some results are sensitive to changes in the effective- ACKNOWLEDGMENTS
ness of screening and therapy, which emphasizes the This work was conducted under a subcontract from the
importance of an effective timely system for notification American College of Medical Genetics (agreement 240-
and follow-up evaluation of positive screening tests. Loss 01-0038), with funding from the Maternal and Child
of effectiveness in many areas may nullify the cost sav- Health Bureau, Health Resources and Services Adminis-
ings and health benefits of the screen. Similarly, the tration. Dr Carroll is supported by a grant from the
quality of the screening tests is important, specifically in National Institutes of Health (K23 DK67879-01).
minimizing false-positive results. The sensitivity of our We thank Alex Kemper, MD, MPH, MS, Tracy Lieu,
results to the specificity of tests and the cost of evaluating MD, MPH, and Scott Grosse, PhD, for their thoughtful
false-positive results emphasizes that false-positive re- comments on a draft of this manuscript.
SUPPLEMENT S295
Downloaded from www.pediatrics.org by on September 20, 2010
Comprehensive Cost-Utility Analysis of Newborn Screening Strategies
Aaron E. Carroll and Stephen M. Downs
Pediatrics 2006;117;S287-S295
DOI: 10.1542/peds.2005-2633H
Updated Information including high-resolution figures, can be found at:
& Services http://www.pediatrics.org/cgi/content/full/117/5/S1/S287
Citations This article has been cited by 5 HighWire-hosted articles:
http://www.pediatrics.org/cgi/content/full/117/5/S1/S287#othera
rticles
Subspecialty Collections This article, along with others on similar topics, appears in the
following collection(s):
Premature & Newborn
http://www.pediatrics.org/cgi/collection/premature_and_newbor
n
Permissions & Licensing Information about reproducing this article in parts (figures,
tables) or in its entirety can be found online at:
http://www.pediatrics.org/misc/Permissions.shtml
Reprints Information about ordering reprints can be found online:
http://www.pediatrics.org/misc/reprints.shtml