Journal Expulsion of IUD
Journal Expulsion of IUD
Journal Expulsion of IUD
org
Introduction
Intrauterine devices (IUDs) provide OBJECTIVES: To provide updated and more detailed pooled intrauterine device expulsion
highly effective contraception and are rates and expulsion risk estimates among women with postpartum intrauterine device
commonly placed at an interval post- placement by timing of insertion, delivery type, and intrauterine device type to inform
partum visit typically 46 weeks after current intrauterine device insertion practices in the United States.
delivery for women who desire intra- DATA SOURCES: We searched PubMed, Cochrane Library, and ClinicalTrials.gov through
uterine contraception. However, the June 2019.
timing of providing postpartum STUDY ELIGIBILITY CRITERIA: We included all studies, of any study design, that
contraception around 6 weeks after de- examined postpartum placement of Copper T380A (copper) or levonorgestrel-containing
livery is based on historical precedent, intrauterine devices that reported counts of expulsion.
not evidence.1 By 6 weeks postpartum, STUDY APPRAISAL AND SYNTHESIS METHODS: We evaluated intrauterine device
more than half of women have resumed expulsion among women receiving postpartum intrauterine devices in the “immediate”
(within 10 minutes), “early inpatient” (>10 minutes to <72 hours), “early outpatient” (72
hours to <4 weeks), and interval (4 weeks) time periods after delivery. We assessed
From the Department of Obstetrics, study quality using the US Preventive Services Task Force evidence grading system. We
Gynecology, and Reproductive Sciences (Dr calculated pooled absolute rates of partial and complete intrauterine device expulsion
Averbach), School of Medicine, University of separately and estimated adjusted relative risks by the timing of postpartum placement,
California San Diego, San Diego, CA; School of
delivery type, and intrauterine device type using log-binomial multivariable regression.
Medicine (Ms Ermias), University of California
San Diego, San Diego, CA; Division of RESULTS: We identified 48 level I to II-3 studies of poor to good quality that reported a total of 7661
Reproductive Health (Drs Jeng, Curtis, intrauterine device placements. Complete intrauterine device expulsion rates varied by timing of
Whiteman, Berry-Bibee, Marchbanks, Tepper, placement as follows: 10.2% (range, 0.026.7) for immediate; 13.2% (3.546.7) for early
and Jatlaoui), Centers for Disease Control and inpatient; 0% for early outpatient; and 1.8% (0.04.8) for interval placements. Complete intra-
Prevention, Atlanta, GA; Department of
uterine device expulsion rates also varied by delivery type: 14.8% (range, 4.843.1) for vaginal
Gynecology and Obstetrics (Dr Jamieson),
Emory University School of Medicine, Atlanta, and 3.8% (0.021.1) for cesarean deliveries. Among immediate postpartum vaginal placements,
GA. the expulsion rate for levonorgetrel intrauterine devices was 27.4% (range, 18.845.2) and
Received Nov. 12, 2019; revised Feb. 13, 2020; 12.4% (4.843.1) for copper intrauterine devices. Compared with interval placement, immediate
accepted Feb. 24, 2020. and early postpartum placements (inpatient and outpatient combined) were associated with greater
The authors report no conflict of interest. risk of complete expulsion (adjusted risk ratio, 8.33; 95% confidence interval, 4.3216.08, and
Dr. Averbach is supported by the National adjusted risk ratio, 5.27; 95% confidence interval, 2.56e10.85, respectively). Among immediate
Institutes of Health Eunice Kennedy Shriver postpartum placements, risk of expulsion was greater for placement after vaginal compared with
National Institute of Child Health & Human cesarean deliveries (adjusted risk ratio, 4.57; 95% confidence interval, 3.495.99). Among
Development (NICHD) physician scientist career immediate placements at the time of vaginal delivery, levonorgestrel intrauterine devices were
development award (K12 HD001259).
associated with a greater risk of expulsion compared with copper intrauterine devices (adjusted risk
The findings and conclusions in this report are
ratio, 1.90; 95% confidence interval, 1.362.65).
those of the authors and do not necessarily
represent the official position of the Centers for CONCLUSION: Although intrauterine device expulsion rates vary by timing of placement,
Disease Control and Prevention or the National type, and mode of delivery, intrauterine device insertion can take place at any time.
Institutes of Health. Understanding the risk of intrauterine device expulsion at each time period will enable
Corresponding author: Sarah Averbach, MD, women to make an informed choice about when to initiate use of an intrauterine device in
MAS. [email protected] the postpartum period based on their own goals and preferences.
0002-9378/$36.00
ª 2020 Elsevier Inc. All rights reserved. Key words: contraception, copper, delivery, early, expulsion, immediate, interval, IUD,
https://doi.org/10.1016/j.ajog.2020.02.045 levonorgestrel, postpartum
Downloaded for Fakultas Kedokteran Universitas Sam Ratulangi ([email protected])AUGUST 2020 American
at Sam Ratulangi Journal
University of Obstetrics &byGynecology
from ClinicalKey.com 177 22,
Elsevier on August
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
Systematic Reviews ajog.org
178 American
Downloaded Journal
for Fakultas of Obstetrics
Kedokteran & Gynecology
Universitas AUGUST
Sam Ratulangi 2020
([email protected]) at Sam Ratulangi University from ClinicalKey.com by Elsevier on August 22,
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
ajog.org Systematic Reviews
divided into more clinically relevant including “ Postpartum AND IUD.” No follow-up, number of women enrolled
time periods, and assessed by IUD type. methodological filters were used. We or randomized, number of IUDs initially
In addition, we focused on IUD types hand-searched relevant articles and re- placed, number of women with any
currently used in the United States to views for additional references. Interim follow-up, and counts of expulsion
better inform patient-centered coun- results were not included; only trials (overall, complete, and partial).
seling in the United States. with full data were included. We used the
Preferred Reporting Items for Systematic Assessment of risk of bias
Objective Reviews and Meta-Analyses (PRISMA) Newly identified studies were indepen-
The purpose of this updated review and guidelines for reporting.16 dently assessed for quality separately by 2
secondary analysis was to calculate more co-authors (SHA and TCJ) according to
detailed pooled absolute expulsion rates Study selection the US Preventive Services Task Force
among women with postpartum IUD Our population of interest was women system17 as previously described.8 To
placement and to estimate relative risk who received a postpartum IUD after a assess study quality, 2 coauthors inde-
for expulsion in further detail. We vaginal or cesarean delivery. IUD place- pendently reviewed each study to eval-
sought to calculate updated pooled ment data were stratified by “immedi- uate study design and risk of bias, such as
expulsion rates for immediate post- ate” (within 10 minutes), “early potential for selection bias (eg, groups
partum placements (<10 minutes) and inpatient” (>10 minutes to <72 hours), not comparable at baseline for ran-
to provide new pooled expulsion rates “early outpatient’ (72 hours to <4 domized controlled trials), misclassifi-
for immediate postpartum placements weeks), and interval (4 weeks). Our cation (eg, outcome of expulsion
by delivery type and IUD type. We also primary outcome of interest was com- diagnosed inconsistently by nonblinded
sought to calculate pooled expulsion plete expulsion of the IUD. We included healthcare provider), and confounding
rates for early placements, further pre- all primary research studies with any (eg, parity and breastfeeding status not
sented as early inpatient (>10 minutes to study design, in any language, that re- collected or adjusted for). Studies were
<72 hours) and early outpatient (72 ported counts of IUD expulsion after classified as “good,” “fair,” or “poor”
hours to <4 weeks) placements, and postpartum IUD placement that clearly based on the risk of bias assessment. Any
additionally categorized by IUD type. defined the timing of IUD placement by discrepancies between authors for se-
Finally, we aimed to focus our analysis hours, days, or weeks from delivery. lection, abstraction, or risk of bias
on IUD types currently available in the Studies that straddled the early and in- assessment were resolved through
United States. terval timing categories of interest were discussion.
excluded. We included studies with any
Methods length and rate of follow-up. Data synthesis
Information sources We included only those studies that We calculated pooled expulsion rates by
We updated the previous search8 in reported expulsion rates for IUD types dividing the total pooled number of ex-
PubMed, Cochrane Library, and currently available in the United States, pulsions by the total pooled number of
ClinicalTrials.gov, published from May including copper (CuT380A) and levo- IUD placements within each strata
2018 through June 2019, that examined norgestrel (LNG) IUDs, to focus ana- weighted by study sample size. For our
placement of IUDs in the postpartum lyses on current practice in the United primary analysis, we assumed that ex-
period. States. We excluded studies that evalu- pulsions were “complete” if not other-
ated IUDs that were modified from their wise defined. We additionally collected
Search strategy standard structure. We included studies counts of partial expulsion when re-
We searched using the search strategy evaluating IUD placement after vaginal ported by study authors or when counts
previously published8:((((“ Intrauterine and/or cesarean delivery. were provided for IUDs visualized in the
Devices” [Mesh] OR “ Intrauterine De- cervix by speculum or ultrasound ex-
vices, Copper” [Mesh] OR “ Intrauterine Data extraction amination to calculate pooled partial
Devices, Medicated” [Mesh] OR ((in- Results from the initial search of the expulsion rates.
trauterine OR intrauterine) AND (de- previous publication and the new search We calculated pooled expulsion rates
vice OR system OR contracept*)) OR were reviewed by 2 co-authors (SHA and for IUDs placed in each of the following
IUD OR IUC OR IUCD OR IUS OR YE), including titles, abstracts, and full- time periods: immediate, early inpatient,
mirena OR Skyla OR liletta OR paragard text articles when necessary, to deter- early outpatient, early inpatient and early
OR “ Copper T380” OR CuT380 OR “ mine whether the studies met inclusion outpatient combined, mixed (immedi-
Copper T380a” OR “ Cu T380a” ) AND criteria. Two co-authors (SHA and TCJ) ate, early inpatient, and early outpatient
(postpartum OR Puerperium*) NOT independently reviewed newly identified combined), or interval placement, and
(“Animals” [Mesh] NOT “ Humans” studies and extracted the following: by delivery type (cesarean, vaginal, or
[Mesh])))). We searched Cochrane Li- author, year of publication, country, either cesarean or vaginal [mixed]). We
brary and ClinicalTrials.gov for any study design, IUD type, timing of IUD reported the rate of IUD expulsion over
published reviews or additional studies placement, delivery type, length of study each time period and the range of
Downloaded for Fakultas Kedokteran Universitas Sam Ratulangi ([email protected]) AUGUST 2020 American
at Sam Ratulangi UniversityJournal & Elsevier
of Obstetrics by
from ClinicalKey.com Gynecology 17922,
on August
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
Systematic Reviews ajog.org
expulsion rates reported. We stratified by additional articles. We excluded 6 that among 9 studies. Six studies contributed
IUD type when possible (copper, LNG did not meet inclusion criteria because to the early inpatient pooled complete
IUD, or either copper or LNG IUD they did not specify IUD type or timing expulsion rate of 13.2% (range,
[mixed]), and by length of study follow- of IUD placement, or did not provide 3.546.7%, n ¼ 273). Three studies
up. individual counts for expulsion. We including 216 copper IUD placements
We used a log-binomial regression included an additional 5 new contributed to a pooled complete
model to estimate adjusted risk ratios studies24e28 in this analysis for a total of expulsion rate of 6.9% (range,
(aRRs) of IUD expulsion (for complete 48 studies (Figure 1). 3.524.2%). Three studies including 57
and partial expulsions separately) with LNG IUD placements contributed to a
associated 95% confidence intervals. Study characteristics pooled complete expulsion rate of 36.8%
For IUDs placed in the immediate time Studies included were published be- (range, 26.746.7%).
period, we reported aRRs by delivery tween 1999 and 2019. The level of evi- For IUDs placed during the early
type and IUD type, and adjusted for the dence ranged from I to II-3. Five studies outpatient period, more than 72 hours
following covariates: World Health Or- were rated as good quality24,26,29e31 and but less than 4 weeks postpartum, there
ganization study region,18 study quality, the remainder were fair or poor quality. were no complete IUD expulsions
and length of study follow-up. We The majority of studies examined IUDs among 136 woman in 3 studies. All early
adjusted for study region because of placed in the immediate time period, outpatient IUD placements occurred
potential differences in regional prac- whereas 6 examined early inpatient28,32e36 between 13 days and 28 days
tice in which type of clinicians provide and 3 examined early outpatient postpartum.
IUDs and the technique that they use to placements.37e39 In all, 13 studies included
place them, as well as differences in IUD IUDs placed in the interval time period as a Interval. For IUDs placed during the in-
prevalence in different regions. For comparison group,30-35,37,38,40e44 A total terval time period, the risk of complete
IUDs placed in the early inpatient time of 24 studies included only copper expulsion was 1.8% (range, 0.04.8%,
period, we reported aRRs by IUD type, IUDs,24,26,28,29,32,34,41,45e61 14 studies n ¼ 502) among 13 studies.
adjusting for the same 3 covariates as included only LNG The pooled rate of complete IUD
immediate placements as well as for IUDs,25,30,33,35,36,39,40,42-44,62e65 and 10 expulsion varied by type of IUD when
delivery type. Analyses were completed studies included data on both types of placed after vaginal delivery.
using SAS 9.4 software (SAS Institute IUDs.27,31,37,38,66e71 A total of 16 studies Among women with IUDs placed
Inc, Cary NC). included only IUDs placed at cesarean immediately after vaginal deliveries, the
delivery,29,31,40e42,45,48,52,54e56,60,62,63,65,69 pooled complete expulsion rates varied
Results 14 studies included only IUDs placed at between women using LNG IUDs
Study selection vaginal delivery,24,26,30,32e36,43,57,59,64,68,70 (27.4%; range, 18.845.2%, n ¼ 299)
The previous meta-analysis included and 18 studies included data on both among 8 studies, and 13 studies
data from 48 studies. For this analysis, types of delivery.25,27,28,37e39,44, including women using copper IUDs
we excluded 4 studies from the pre- 46,47,49e51,53,58,61,66,67,71
Follow up ranged (12.4%; range, 4.837.5%, n ¼ 1586).
viously published meta-analysis that from 4 weeks to 5 years, and study sample However, among women with IUDs
described IUDs not currently available size ranged from 7 to 2733 women. All placed at the time of cesarean delivery,
or in use in the United States studies included are listed in Table 1. the expulsion rates were generally lower
(CuT200, Cu7)19-22 and 1 study that than after vaginal deliveries and were
included early postpartum placements Complete IUD expulsion similar between women using LNG
but did not report expulsions by our The pooled rate of complete IUD IUDs and copper IUDs (2.3%; range,
pre-identified timing categories: im- expulsion varied by timing of placement. 0.021.1%, n ¼ 261, 7 studies; and
mediate, early inpatient, early outpa- 3.8%; range, 0.015.0%, n ¼ 1320, 17
tient, or interval.23 Therefore, we Immediate expulsion. For IUDs placed studies), respectively.
included 43 studies from the original during the immediate period, within 10 The adjusted relative risk of complete
meta-analysis. minutes of the placenta, the pooled rate IUD expulsion varied by the timing of
We identified an additional 98 studies of complete IUD expulsion was 10.2% postpartum placement, delivery type,
in PubMed published between May 1, (range, 0.026.7%, n ¼ 4460) among 39 and IUD type.
2018, and June 1, 2019. There were no studies (Table 2).
new studies identified with published Timing of delivery. Compared with in-
data from ClinicalTrials.gov or Early expulsion. For IUDs placed during terval placement, immediate and early
Cochrane reviews. We removed 3 the early postpartum period (combined postpartum (combined inpatient and
duplicate studies and screened the titles inpatient and outpatient), from more outpatient) placements were associated
and abstracts of 95 records. We than 10 minutes to less than 4 weeks, the with increased risk of complete expul-
excluded 84 articles not relevant to our pooled complete expulsion rate was sion (aRR, 8.33; 95% CI, 4.32e16.08;
search. We read the full texts of 11 8.8% (range, 0.046.7%, n ¼ 409) and aRR, 5.27; 95% CI, 2.56e10.85,
180 American
Downloaded Journal
for Fakultas of Obstetrics
Kedokteran & Gynecology
Universitas AUGUST
Sam Ratulangi 2020
([email protected]) at Sam Ratulangi University from ClinicalKey.com by Elsevier on August 22,
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
ajog.org Systematic Reviews
Partial expulsion
When assessing partial IUD expulsions,
for IUDs placed during the immediate,
early (combined inpatient and outpa-
tient), and interval time periods, the
pooled partial expulsion rates were 6.3%
(range, 0.037.3%, n ¼ 2111; 21
studies), 13.8% (range, 0.066.7%; n ¼
196; 6 studies), and 1.9% (range, Averbach. Intrauterine device expulsion after placement in the postpartum period. Am J Obstet Gynecol 2020.
0.05.6%, n ¼ 319; 8 studies) respec-
tively (data not shown). When early
placement was further categorized into expulsion (aRR, 4.56; 95% CI, The previous meta-analysis grouped
the early inpatient period and outpatient 1.98e10.94, and aRR, 13.34; 95% CI, all IUDs occurring between immediate
postpartum time periods, the pooled 5.82e30.57, respectively) (data not and interval insertions as early post-
partial expulsion rates were 26.4% shown). partum IUD insertions, from more than
(range, 0.066.7%, n ¼ 87) among 4 10 minutes to less than 4 weeks after
studies and 3.7% (range, 3.04.7%, n ¼ Comment delivery, based on timing categories in
109) between 2 studies, respectively. This systematic review provides upda- the US Medical Eligibility Criteria for
Expulsion rates after early inpatient ted estimates of expulsion rates among Contraceptive Use.8 In this analysis, we
placement varied by IUD type, with women with postpartum IUD place- further estimated the risk of early
pooled partial expulsion rates of 48.9% ment by timing of insertion, further expulsion specifically in the time before
(range, 0.066.7%, n ¼ 45) between 2 described by delivery type, and/or IUD a woman typically leaves the hospital
studies of women receiving copper type when IUDs are placed within the (early inpatient) or at a follow-up visit
IUDs, and 2.4% (range, 0.03.7%, n ¼ immediate (<10 minutes), “early within 4 weeks of delivery (early
109) between 2 studies of women inpatient” (>10 minutes to <72 outpatient). In addition, we included
receiving LNG- IUDs. Compared with hours), and “early outpatient” (72 only IUDs currently available in the
interval placement, immediate and early hours to <4 weeks) postpartum time United States. We provided new pooled
postpartum IUD placements were asso- periods compared with interval place- rates of IUD expulsion when IUDs are
ciated with increased risks of partial ments (>4 weeks). placed in the immediate postpartum
Downloaded for Fakultas Kedokteran Universitas Sam Ratulangi ([email protected]) AUGUST 2020 American
at Sam Ratulangi UniversityJournal & Elsevier
of Obstetrics by
from ClinicalKey.com Gynecology 18122,
on August
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
Downloaded
Systematic Reviews
182 American
TABLE 1
Characteristics of included studies reporting counts of expulsions among postpartum women
for Fakultas
Agarwal, 201745
Kedokteran
37
Baldwin, 2016 N America I Fair Mixed Mixed Mixed 6 mo 201 139 Unknown (66g)
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
24
Blumenthal, 2018 SE Asia II-3 Good CuT380A Mixed Vaginal 6 wk 500 496 480 (97)
Universitas
40
Braniff, 2015 W. Pacific I Fair LNG IUD Mixed Cesarean 6 mo 48 42 Unknown (84g)
& Gynecology
29
Celen, 2011 E. Mediterranean II-3 Good CuT380A Immediate Cesarean 12 mo 245 245 245 (100)
30
Chen, 2010 N America I Good LNG IUD Mixed Vaginal 6 mo 124 96 84 (88)
AUGUST
66
Cohen, 2016 N America II-3 Poor Mixed Immediate Mixed 12 mo 82 82 67 (82)
2020
25
Cole, 2019 N America II-3 Poor LNG IUD Immediate Mixed 6 mo 116 116 87 (75)
46
Colwill, 2018 N America II-2 Fair CuT380A Immediate Mixed 6 wk 210 210 169 (80)
33
Dahlke , 2011 N America I Poor LNG IUD Mixed Vaginal 6 mo 53 46 45 (98)
Dias, 201547 SE Asia II-2 Poor CuT380A Immediate Mixed 6 wk 91 91 91 (100)
67
Eggebroten, 2017 N America II-2 Poor Mixed Immediate Mixed 6 mo 211 211 186 (88)
62
Elsedeek, 2012 E. Mediterranean II-3 Fair LNG IUD Immediate Cesarean 2y 65 65 62 (95)
at Sam Ratulangi University from ClinicalKey.com by Elsevier on August 22,
63
Elsedeek, 2015 E. Mediterranean II-3 Fair LNG IUD Immediate Cesarean 5y 80 80 80 (100)
34
Eroglu, 2006 E. Mediterranean II-2 Fair CuT380A Mixed Vaginal 12 mo 268 268 257 (96)
Goldthwaite, 201768 N America II-2 Fair Mixed Immediate Vaginal 12 wk 123 123 96 (78)
48
Gueye , 2013 Africa II-3 Fair CuT380A Immediate Cesarean 6 mo 46 46 39 (85)
61
Gupta, 2014 SE Asia II-3 Fair CuT380A Immediate Mixed 6 mo 100 100 92 (92)
26
Gurney, 2018 N America II-3 Good CuT380A Immediate Vaginal 6 mo 200 195 162 (83)
64
Hayes, 2007 N America II-3 Fair LNG IUD Immediate Vaginal 10 wk 20 20 16 (80)
Heller, 201669 Europe II-3 Fair Mixed Immediate Cesarean 12 mo 120 114 99 (87)
27
Hinz, 2019 N America II-3 Fair Mixed Immediate Mixed 6 mo 118 118 114 (97)
49
Hooda, 2016 SE Asia II-2 Poor CuT380A Immediate Mixed 6 wk 593 593 171 (29)
70
Jatlaoui, 2014 N America II-3 Fair Mixed Immediate Vaginal 6 mo 99 99 88 (89)
ajog.org
28
Kumar, 2019 SE Asia II-3 Poor CuT380A Mixed Mixed 12 mo 1200 1200 844 (70)
Averbach. Intrauterine device expulsion after placement in the postpartum period. Am J Obstet Gynecol 2020. (continued)
Downloaded for Fakultas Kedokteran Universitas Sam Ratulangi ([email protected]) AUGUST
ajog.org
TABLE 1
Characteristics of included studies reporting counts of expulsions among postpartum women (continued)
No. of women No. of women with
First author, year, Level of Study Placement Length of No. enrolled or with IUDs IUDs placed with
reference Regiona evidenceb qualityc IUD typed timinge Delivery typef follow-up randomized placed follow-up (%)
Kumar, 201450 SE Asia II-3 Poor CuT380A Mixed Mixed 6 wk 2733 2733 1730 (63)
41
Lester, 2015 Africa I Poor CuT380A Mixed Cesarean 6 mo 68 52 Unknown (90g)
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
Letti Müller, 200551 S America II-2 Fair CuT380A Immediate Mixed 1 mo 38 38 37 (97)
52
Levi, 2012 N America II-3 Fair CuT380A Immediate Cesarean 6 mo 90 90 42 (47)
Levi, 201531 N America I Good Mixed Mixed Cesarean 6 mo 112 87 Unknown (88g)
Mishra, 201453 SE Asia II-3 Poor CuT380A Immediate Mixed 46 wk 564 564 434 (77)
54
Nelson, 2009 N America II-3 Fair CuT380A Immediate Cesarean 6 wk 7 7 7 (100)
65
Puzey, 2005 Africa II-3 Poor LNG IUD Immediate Cesarean 6 mo 33 33 20 (61)
55
Ragab, 2015 E Mediterranean II-3 Fair CuT380A Immediate Cesarean 12 mo 40 40 40 (100)
Singal, 201454 SE Asia II-3 Fair CuT380A Immediate Cesarean 12 mo 300 300 300 (100)
57
Singh, 2016 SE Asia II-3 Fair CuT380A Mixed Vaginal 8 wk 80 80 80 (100)
43
Soon, 2018 N America I Poor LNG IUD Mixed Vaginal 6 mo 11 8 7 (88)
36
Stuart, 2012 N America II-3 Fair LNG IUD Early Vaginal 6 mo 40 29 27 (93)
35
Stuart, 2015 N America I Poor LNG IUD Mixed Vaginal 6 mo 35 31 Unknown (80g)
58
Sucak, 2015 E Mediterranean II-2 Fair CuT380A Immediate Mixed 12 mo 160 160 153 (96)
at Sam Ratulangi
44
Turok, 2017 N America I Poor LNG IUD Mixed Mixed 8 wk 285 228 214 (94)
60
Unal, 2018 E Mediterranean II-3 Fair CuT380A Immediate Cesarean 3 mo 70 70 68 (97)
2020 American
42
Whitaker, 2014 N America I Poor LNG IUD Mixed Cesarean 12 mo 42 37 Unknown (81g)
UniversityJournal
39
Systematic Reviews
Zerden, 2017 N America II-3 Fair LNG IUD Delayed Mixed 6 mo 50 50 43 (86)
Cu, copper; E, East; IUD, intrauterine device; LNG, levonorgestrel; N, North; S, South; SE, Southeast; W, West.
of Obstetrics by
a
Based on World Health Organization (WHO) Regions, 18 with Region of the Americas separated into North and South American regions; b Level of evidence: I, a randomized, controlled trial; II-2, a cohort or case-controlled study that includes a comparison group; II-3,
an uncontrolled descriptive study including case series; c Defined by US Preventive Services Task Force17; d Mixed refers to CuT380A and LNG IUD combined; e Immediate refers to 10 min of placental delivery; early, >10 min to <4 wk postpartum; Mixed,
immediate and early placements; or immediate or early placements and interval placements (4 wk postpartum); f Mixed refers to vaginal or cesarean delivery; g Number of women with IUDs placed with follow-up not reported; therefore percentage represents
number of women with IUD placements among all women randomized.
& Elsevier
Averbach. Intrauterine device expulsion after placement in the postpartum period. Am J Obstet Gynecol 2020.
Gynecology
on August
18322,
Downloaded
Systematic Reviews
184 American
TABLE 2
Pooled complete expulsion rates by study follow-up length
for Fakultas
All studies Study follow-up: >6 mo Study follow-up: 3L6 mo Study follow-up: <3 mo
Journal
No. of women expulsion rate No. of women expulsion rate No. of women expulsion rate Number of expulsion rate
of Obstetrics
Placement timing, with IUDs (% range with IUDs (% range with IUDs (% range women with (% range
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
delivery type, and No. of placed with among No. of placed with among No. of placed with among No. of IUDs placed among
studiesa follow-up studies)b studiesa studies)b studiesa studies)b studiesa studies)b
Universitas
c
Interval timing 13 502 1.8 (0.0e4.8) 2 122 4.1 (0.0e4.8) 9 262 0.8 (0.0e2.9) 2 118 1.7 (0.0e2.0)
Sam Ratulangi
c,d
Mixed timing 3 2290 4.4 (3.6e7.5) 0 N/A N/A 0 N/A N/A 3 2290 4.4 (3.6e7.5)
Early timingc 9 409 8.8 (0.0e46.7) 2 204 6.9 (3.5e24.2) 6 193 10.9 (0.0e46.7) 1 12 8.3
AUGUST
Inpatient 6 273 13.2 (3.5e46.7) 2 204 6.9 (3.5e24.2) 3 57 36.8 (26.7 1 12 8.3
([email protected])
e46.7)
2020
Copper IUD 3 216 6.9 (3.5e24.2) 2 204 6.9 (3.5e24.2) 0 N/A N/A 1 12 8.3
LNG IUD 3 57 36.8 (26.7 0 N/A N/A 3 57 36.8 (26,7 0 N/A N/A
e46.7) e46.7)
Outpatient 3 136 0.0 0 N/A N/A 3 136 0.0 0 N/A N/A
c
Immediate timing 39 4460 10.2 (0.0e26.7) 13 2213 9.1 (0.0e25.4) 17 1114 12.4 (0.0e26.7) 9 1133 10.1 (0.0e21.4)
Vaginal deliveries 18 1885 14.8 (4.8e43.1) 4 1026 13.0 (4.8e23.5) 8 479 20.3 (8.0e43.1) 6 380 12.6 (7.8e22.2)
Copper IUD 13 1586 12.4 (4.8e37.5) 4 1026 13.0 (4.8e23.5) 4 251 13.2 (8.0e37.5) 5 309 9.7 (7.8e22.2)
at Sam Ratulangi University from ClinicalKey.com by Elsevier on August 22,
LNG IUD 8 299 27.4 (18.8 0 N/A N/A 6 228 28.1 (19.4 2 71 25.4 (18.8
e45.2) e45.2) e27.3)
Cesarean 25 1733 3.8 (0.0e21.1) 9 1077 3.9 (0.0e21.1) 11 449 4.5 (0.0 e11.8) 5 207 1.5 (0.0e3.2)
deliveries
Copper IUD 17 1320 3.8 (0.0e15.0) 5 817 4.0 (2.0e15.0) 7 296 4.7 (0.0e11.8) 5 207 1.5 (0.0e3.2)
LNG IUD 7 261 2.3 (0.0e21.1) 3 161 2.5 (0.0e21.1) 4 100 2.0 (0.0e4.2) 0 N/A N/A
Copper or LNG 2 152 5.9 (5.1e7.6) 1 99 5.1 1 53 7.6 0 N/A N/A
Vaginal or 5 842 13.1 (9.0e25.4) 2 110 23.6 (20.9 1 186 11.3 2 546 11.5 (9.0e21.4)
cesareane e25.4)
IUD, intrauterine device; LNG, levonorgestrel; N/A, not applicable.
a
Some studies included and reported more than 1 category; b Among women with IUDs placed with any follow-up; c Immediate refers to 10 min of placental delivery; Early, >10 minutes to <4 wk postpartum; Mixed, immediate and early combined; Interval, 4
wk postpartum; d Two studies did not classify IUD placements between early and immediate timing; e Seven studies did not specify delivery types.
Averbach. Intrauterine device expulsion after placement in the postpartum period. Am J Obstet Gynecol 2020.
ajog.org
ajog.org Systematic Reviews
Downloaded for Fakultas Kedokteran Universitas Sam Ratulangi ([email protected]) AUGUST 2020 American
at Sam Ratulangi UniversityJournal & Elsevier
of Obstetrics by
from ClinicalKey.com Gynecology 18522,
on August
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
Systematic Reviews ajog.org
studies generally did not report expul- the postpartum period can help women www.medicaid.gov/federal-policy-guidance/
sions by delivery type. Although we to achieve their reproductive goals and to downloads/cib040816.pdf. Accessed
October 14, 2019.
defined the early outpatient time period prevent unintended pregnancy. In addi- 12. Curtis KM, Tepper NK, Jatlaoui TC, et al. US
as 72 hours to less than 4 weeks post- tion to interval placement 4 or more Medical Eligibility Criteria for Contraceptive Use,
partum, there were no studies evaluating weeks after delivery, IUDs can be placed 2016. MMWR Recomm Rep 2016;65:1–103.
the risk of IUD expulsion when IUDs immediately after delivery, in the inpa- 13. Caskey R, Stumbras K, Rankin K, Osta A,
were placed 72 hours to 12 days post- tient early postpartum period before a Haider S, Handler A. A novel approach to
postpartum contraception: a pilot project of
partum, so little is known about expul- woman leaves the birth facility, or in the pediatricians’ role during the well-baby visit.
sion risk when IUDs are placed within early outpatient time period if a woman Contracept Reprod Med 2016;1:7.
that period. Further investigation is returns for an early postpartum visit 14. McKinney J, Keyser L, Clinton S,
needed to assess for differences in risk of within 4 weeks of delivery. Understand- Pagliano C. ACOG Committee opinion no. 736:
IUD expulsion within the early outpa- ing the risk of IUD expulsion at each optimizing postpartum care. Obstet Gynecol
2018;132:784–5.
tient period. In addition, the definition time period will enable women to make 15. Blumenthal PD, Lerma K. Intrauterine device
and diagnosis of expulsion were not informed choices about when to initiate expulsion after postpartum placement: a sys-
standardized across studies, and there an IUD in the postpartum period based tematic review and meta-analysis. Obstet
was significant variation particularly in on their own goals and preferences. - Gynecol 2019;133:582.
the definition and diagnosis of partial 16. Moher D, Liberati A, Tetzlaff J, Altman DG,
Group P. Preferred reporting items for system-
IUD expulsion. Because we assumed REFERENCES atic reviews and meta-analyses: the PRISMA
expulsions were “complete” if not 1. Speroff L, Mishell DR. The postpartum visit: statement. BMJ 2009;339:b2535.
otherwise defined, it is possible we it’s time for a change in order to optimally initiate 17. Harris RP, Helfand M, Woolf SH, et al. Cur-
overestimated the rate of complete IUD contraception. Contraception 2008;78:90–8. rent methods of the US Preventive Services Task
expulsion for some studies. As with the 2. Connolly A, Thorp J, Pahel L. Effects of Force: a review of the process. Am J Prev Med
pregnancy and childbirth on postpartum sexual 2001;20(3 Suppl):21–35.
previous review, there were differential 18. World Health Organization. Definition of
function: a longitudinal prospective study. Int
lengths of follow-up, making compari- Urogynecol J Pelvic Floor Dysfunct 2005;16: regional groupings. Available at: https://www.
sons across studies challenging. Finally, 263–7. who.int/healthinfo/global_burden_disease/
as in the previous review, we were unable 3. Robson KM, Brant HA, Kumar R. Maternal definition_regions/en/. Accessed July 10,
to adjust for potential confounders that sexuality during first pregnancy and after child- 2019.
birth. Br J Obstet Gynaecol 1981;88:882–9. 19. Laes E, Lehtovirta P, Weintraub D,
were not reliably reported by studies,
4. Egbuonu I, Ezechukwu CC, Chukwuka JO, Pyörälä T, Luukkainen T. Early puerperal in-
including training and experience of Ikechebelu JI. Breast-feeding, return of menses, sertions of Copper-T-200. Contraception
providers, use of ultrasound, and inser- sexual activity and contraceptive practices 1975;11:289–95.
tion technique. among mothers in the first six months of lacta- 20. Lavin P, Waszak C, Bravo C. Preliminary
Given the large number of partici- tion in Onitsha, South Eastern Nigeria. J Obstet report on a postpartum CuT 200 study, San-
Gynaecol 2005;25:500–3. tiago, Chile. Int J Gynaecol Obstet 1983;21:
pants from studies conducted all over the
5. Gray RH, Campbell OM, Zacur HA, 71–5.
world, the external validity of these re- Labbok MH, MacRae SL. Postpartum return of 21. Newton J, Harper M, Chan KK. Immediate
sults is likely good; however, as we ovarian activity in nonbreastfeeding women post-placental insertion of intrauterine contra-
included only those studies on copper monitored by urinary assays. J Clin000000 ceptive devices. Lancet 1977;2:272–4.
and LNG IUDs currently available in the Endocrinol Metab 1987;64:645–50. 22. Shukla M, Qureshi S, Chandrawati. Post-
6. Committee opinion no. 670 summary: im- placental intrauterine device insertionea five
United States, these results are not year experience at a tertiary care centre in north
mediate postpartum long-acting reversible
generalizable to other IUD types. contraception. Obstet Gynecol 2016;128: India. Indian J Med Res 2012;136:432–5.
The ACOG recommends that women 422–3. 23. Bonilla Rosales F, Aguilar Zamudio ME,
be counseled about the increased 7. Holden EC, Lai E, Morelli SS, et al. Ongoing Cázares Montero ML, Hernández Ortiz ME,
expulsion risk with postpartum IUD barriers to immediate postpartum long-acting Luna Ruiz MA. [Factors for expulsion of intra-
reversible contraception: a physician survey. uterine device Tcu380A applied immediately
insertion10; however, the reported rates postpartum and after a delayed period]. Rev
Contracept Reprod Med 2018;3:23.
of IUD expulsion when IUDs are placed 8. Jatlaoui TC, Whiteman MK, Jeng G, et al. Med Inst Mex Seguro Soc 2005;43:5–10.
specifically within the early inpatient and Intrauterine device expulsion after postpartum 24. Blumenthal PD, Lerma K, Bhamrah R,
outpatient time periods, and the rates of placement: a systematic review and meta-anal- Singh S; Dedicated PPIUD Inserter Working
IUD insertion by IUD and delivery type, ysis. Obstet Gynecol 2018;132:895–905. Group. Comparative safety and efficacy of a
9. Whitaker AK, Chen BA. Society of Family dedicated postpartum IUD inserter versus for-
vary among studies, and these studies are ceps for immediate postpartum IUD insertion: a
Planning Guidelines: postplacental insertion of
limited by small sample size. The data intrauterine devices. Contraception 2018;97: randomized trial. Contraception 2018;98:
presented here can be used by providers 2–13. 215–9.
in counseling women about expulsion 10. American College of Obstetricians and Gy- 25. Cole M, Thomas S, Mercer BM, Arora KS.
risk for IUDs placed at different time necologists. Long-acting reversible contracep- Impact of training level on postplacental levo-
tion: implants and intrauterine devices. Practice norgestrel 52 mg intrauterine device expulsion.
periods postpartum. Contraception 2019;99:94–7.
bulletin no. 186. Obstet Gynecol 2017;130:
Providing women with access to e251–69. 26. Gurney EP, Sonalkar S, McAllister A,
long-acting reversible contraception, 11. Department of Health and Human Services. Sammel MD, Schreiber CA. Six-month expul-
including IUDs, at many times during CMCS informational bulletin. Available at: https:// sion of postplacental copper intrauterine devices
186 American
Downloaded Journal
for Fakultas of Obstetrics
Kedokteran & Gynecology
Universitas AUGUST
Sam Ratulangi 2020
([email protected]) at Sam Ratulangi University from ClinicalKey.com by Elsevier on August 22,
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
ajog.org Systematic Reviews
placed after vaginal delivery. Am J Obstet feasibility, patient acceptability and short-term at cesarean delivery: a prospective cohort study.
Gynecol 2018;219:183. outcomes. Contraception 2017;95:65–70. Contraception 2012;86:102–5.
27. Hinz EK, Murthy A, Wang B, Ryan N, 40. Braniff K, Gomez E, Muller R. A randomised 53. Mishra S. Evaluation of safety, efficacy, and
Ades V. A prospective cohort study comparing clinical trial to assess satisfaction with the levo- expulsion of post-placental and intra-cesarean
expulsion after postplacental insertion: the le- norgestrel- releasing intrauterine system inser- insertion of intrauterine contraceptive devices
vonorgestrel versus the copper intrauterine de- ted at caesarean section compared to (PPIUCD). J Obstet Gynaecol India 2014;64(5):
vice. Contraception 2019;100:101–5. postpartum placement. Aust N Z J Obstet 337–43.
28. Kumar S, Srivastava A, Sharma S, et al. Gynaecol 2015;55:279–83. 54. Nelson AL, Chen S, Eden R. Intraoperative
One-year continuation of postpartum intrauter- 41. Lester F, Kakaire O, Byamugisha J, et al. placement of the Copper T-380 intrauterine
ine contraceptive device: findings from a retro- Intracesarean insertion of the Copper T380A devices in women undergoing elective cesarean
spective cohort study in India. Contraception versus 6 weeks postcesarean: a randomized delivery: a pilot study. Contraception 2009;80:
2019;99:212–6. clinical trial. Contraception 2015;91:198–203. 81–3.
29. Çelen Ş, Sucak A, Yıldız Y, Danışman N. 42. Whitaker AK, Endres LK, Mistretta SQ, 55. Ragab A, Hamed HO, Alsammani MA, et al.
Immediate postplacental insertion of an intra- Gilliam ML. Postplacental insertion of the levo- Expulsion of Nova-T380, Multiload 375, and
uterine contraceptive device during cesarean norgestrel intrauterine device after cesarean Copper-T380A contraceptive devices inserted
section. Contraception 2011;84:240–3. delivery vs. delayed insertion: a randomized during cesarean delivery. Int J Gynaecol Obstet
30. Chen BA, Reeves MF, Hayes JL, controlled trial. Contraception 2014;89: 2015;130:174–8.
Hohmann HL, Perriera LK, Creinin MD. Post- 534–9. 56. Singal S, Bharti R, Dewan R, et al. Clinical
placental or delayed insertion of the levonor- 43. Soon R, McGuire K, Salcedo J, outcome of postplacental Copper T380A inser-
gestrel intrauterine device after vaginal delivery: a Kaneshiro B. Immediate versus delayed inser- tion in women delivering by caesarean section.
randomized controlled trial. Obstet Gynecol tion of the levonorgestrel intrauterine device in J Clin Diagn Res 2014;8:OC01–4.
2010;116:1079–87. postpartum adolescents: a randomized pilot 57. Singh S, Das V, Agarwal A, et al. A dedicated
31. Levi EE, Stuart GS, Zerden ML, Garrett JM, study. Hawaii J Med Public Health 2018;77: postpartum intrauterine device inserter: pilot
Bryant AG. Intrauterine device placement during 60–5. experience and proof of concept. Glob Health
cesarean delivery and continued use 6 months 44. Turok DK, Leeman L, Sanders JN, et al. Sci Pract 2016;4:132–40.
postpartum: a randomized controlled trial. Immediate postpartum levonorgestrel intrauter- 58. Sucak A, Ozcan S, Çelen Ş, Çag lar T,
Obstet Gynecol 2015;126:5–11. ine device insertion and breast-feeding out- Göksu G, Danışman N. Immediate postplacental
32. Bryant AG, Kamanga G, Stuart GS, comes: a noninferiority randomized controlled insertion of a copper intrauterine device: a pilot
Haddad LB, Meguid T, Mhango C. Immediate trial. Am J Obstet Gynecol 2017;217:665. study to evaluate expulsion rate by mode of
postpartum versus 6-week postpartum intra- 45. Agarwal K, Dewan R, Mittal P, Aggarwal A. delivery. BMC Pregnancy Childbirth 2015;15:
uterine device insertion: a feasibility study of a Visibility of strings after postplacental intra- 202.
randomized controlled trial. Afr J Reprod Health cesarean insertion of CuT380A and Cu375 in- 59. Xu J, Yang X, Gu X, et al. Comparison be-
2013;17:72–9. trauterine contraceptive device: a randomized tween two techniques used in immediate post-
33. Dahlke JD, Terpstra ER, Ramseyer AM, comparative study. J Obstet Gynaecol India placental insertion of TCu 380A intrauterine
Busch JM, Rieg T, Magann EF. Postpartum 2017;67:324–9. device: 36-month follow-up. Reprod Contracept
insertion of levonorgestrel-intrauterine system at 46. Colwill AC, Schreiber CA, Sammel MD, 1999;10:156–62.
three time periods: a prospective randomized Sonalkar S. Six-week retention after post- 60. Unal C, Eser A, Tozkir E, Wildemeersch D.
pilot study. Contraception 2011;84:244–8. placental copper intrauterine device placement. Comparison of expulsions following intra-
34. Erog lu K, Akkuzu G, Vural G, et al. Com- Contraception 2018;97:215–8. cesarean placement of an innovative frameless
parison of efficacy and complications of IUD 47. Dias T, Abeykoon S, Kumarasiri S, copper-releasing IUD (Gyn-CS) versus the
insertion in immediate postplacental/early post- Gunawardena C, Padeniya T, D’Antonio F. Use TCu380A: a randomized trial. Contraception
partum period with interval period: 1 year follow- of ultrasound in predicting success of intrauter- 2018 [Epub ahead of print].
up. Contraception 2006;74:376–81. ine contraceptive device insertion immediately 61. Gupta S, Malik S, Sinha R, Shyamsunder S,
35. Stuart GS, Lesko CR, Stuebe AM, after delivery. Ultrasound Obstet Gynecol Mittal MK. Association of the position of the
Bryant AG, Levi EE, Danvers AI. A randomized 2015;46:104–8. Copper T 380A as determined by the ultraso-
trial of levonorgestrel intrauterine system inser- 48. Gueye M, Gaye YF, Diouf AA, et al. [Tran- nography following its insertion in the immediate
tion 6 to 48 h compared to 6 weeks after vaginal cesarean intra-uterine device. Pilot study per- postpartum period with the subsequent com-
delivery; lessons learned. Contraception formed at Dakar teaching hospital]. J Gynecol plications: an observational study. J Obstet
2015;91:284–8. Obstet Biol Reprod (Paris) 2013;42:585–90. Gynaecol India 2014;64:349–53.
36. Stuart GS, Bryant AG, O’Neill E, Doherty IA. 49. Hooda R, Mann S, Nanda S, Gupta A, 62. Elsedeek MS. Puerperal and menstrual
Feasibility of postpartum placement of the le- More H, Bhutani J. Immediate postpartum in- bleeding patterns with different types of
vonorgestrel intrauterine system more than 6 h trauterine contraceptive device insertions in contraceptive device fitted during elective
after vaginal birth. Contraception 2012;85: caesarean and vaginal deliveries: a comparative cesarean delivery. Int J Gynaecol Obstet
359–62. study of follow-up outcomes. Int J Reprod Med 2012;116:31–4.
37. Baldwin MK, Edelman AB, Lim JY, 2016;2016:7695847. 63. Elsedeek MS. Five-year follow-up of two
Nichols MD, Bednarek PH, Jensen JT. Intra- 50. Kumar S, Sethi R, Balasubramaniam S, et al. types of contraceptive device fitted during
uterine device placement at 3 versus 6 weeks Women’s experience with postpartum intra- elective cesarean delivery. Int J Gynaecol Obstet
postpartum: a randomized trial. Contraception uterine contraceptive device use in India. 2015;130:179–82.
2016;93:356–63. Reprod Health 2014;11:32. 64. Hayes JL, Cwiak C, Goedken P, Zieman M.
38. Chen MJ, Hou MY, Hsia JK, Cansino CD, 51. Letti Müller AL, Lopes Ramos JG, Martins- A pilot clinical trial of ultrasound-guided post-
Melo J, Creinin MD. Long-acting reversible Costa SH, et al. Transvaginal ultrasonographic placental insertion of a levonorgestrel intrauter-
contraception initiation with a 2- to 3-week assessment of the expulsion rate of intrauterine ine device. Contraception 2007;76:292–6.
compared with a 6-week postpartum visit. devices inserted in the immediate postpartum 65. Puzey M. Mirena at caesarean section. Eur J
Obstet Gynecol 2017;130:788–94. period: a pilot study. Contraception 2005;72: Contracept Reprod Health Care 2005;10:164–7.
39. Zerden ML, Stuart GS, Charm S, Bryant A, 192–5. 66. Cohen R, Sheeder J, Arango N, Teal SB,
Garrett J, Morse J. Two-week postpartum in- 52. Levi E, Cantillo E, Ades V, Banks E, Tocce K. Twelve-month contraceptive continu-
trauterine contraception insertion: a study of Murthy A. Immediate postplacental IUD insertion ation and repeat pregnancy among young
Downloaded for Fakultas Kedokteran Universitas Sam Ratulangi ([email protected]) AUGUST 2020 American
at Sam Ratulangi UniversityJournal & Elsevier
of Obstetrics by
from ClinicalKey.com Gynecology 18722,
on August
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.
Systematic Reviews ajog.org
mothers choosing postdelivery contraceptive device expulsion by 12 weeks: a prospective 70. Jatlaoui TC, Marcus M, Jamieson DJ,
implants or postplacental intrauterine devices. cohort study. Am J Obstet Gynecol 2017;217: Goedken P, Cwiak C. Postplacental intrauterine
Contraception 2016;93:178–83. 674. device insertion at a teaching hospital. Contra-
67. Eggebroten JL, Sanders JN, Turok DK. 69. Heller R, Cameron S, Briggs R, Forson N, ception 2014;89:528–33.
Immediate postpartum intrauterine device and Glasier A. Postpartum contraception: a 71. Woo I, Seifert S, Hendricks D, Jamshidi RM,
implant program outcomes: a prospective missed opportunity to prevent unintended Burke AE, Fox MC. Six-month and 1-year
analysis. Am J Obstet Gynecol 2017;217:51. pregnancy and short inter-pregnancy intervals. continuation rates following postpartum inser-
68. Goldthwaite LM, Sheeder J, Hyer J, J Fam Plann Reprod Health Care 2016;42: tion of implants and intrauterine devices.
Tocce K, Teal SB. Postplacental intrauterine 93–8. Contraception 2015;92:532–5.
188 American
Downloaded Journal
for Fakultas of Obstetrics
Kedokteran & Gynecology
Universitas AUGUST
Sam Ratulangi 2020
([email protected]) at Sam Ratulangi University from ClinicalKey.com by Elsevier on August 22,
2020. For personal use only. No other uses without permission. Copyright ©2020. Elsevier Inc. All rights reserved.