Jurding Obgyn
Jurding Obgyn
Jurding Obgyn
RESEARCH
TRIALS
Open Access
Abstract
Background: From previous reviews, there still have been controversies over the effect of metformin (MET) on
reproductive function in PCOS patients. The reasons for the inconsistent findings especially lie in the transparency
and accuracy of randomized controlled trials (RCTs) reports. However, we could find no data about the quality of
RCTs reporting in MET for PCOS. Thus, a retrospective survey related to the quality of reporting in MET for PCOS
was conducted.
Methods: A retrospective survey was conducted by two investigators. Two investigators assessed the quality of
overall reporting and key methodological factors reporting using items from the CONSORT 2010 statement.
Results: A total of 39 RCTs were included in full text. The median overall quality score was 9, with a minimum of 2
and a maximum of 13. Good or general reporting existed in 11 items with positive rate of more than or equal to
50%. The median score of key methodological items was 4 with a minimum of 0 and a maximum of 5.
Randomization, allocation concealment, blinding, baseline characteristics and intention-to-treat (ITT) analysis were
reported in 26 (67%), 19 (49%), 20 (51%), 38 (97%) and 17 (44%) of the 39 RCTs, respectively. After adjustment, the
mean overall score increased by about 1.71 for manuscripts with funding source (95% CI, 0.18 to 3.24), while it
increased by about 3.51 for manuscripts published in one year increment (95% CI, 1.82 to 5.19). There was a
relatively close, significant correlation (r = 0.589, P < 0.001) between the score of overall reporting quality and year of
publication.
Conclusion: Although the overall reporting quality of RCTs in MET for PCOS has improved over time, reporting of
key methodological items remains poor. Reporting of RCTs on MET for PCOS should keep up with the standards of
the CONSORT statement.
Keywords: Metformin, Quality of reporting, Randomized controlled trials, Polycystic ovary syndrome, The CONSORT
Statement
Background
Polycystic ovary syndrome (PCOS) is characterized by
chronic anovulation (failure or absence of ovulation) and
hyperandrogenism (excessive production of male hormones
in women) with clinical manifestations of irregular menstrual cycles, infertility, hirsutism, and acne [1], which is a
common condition affecting women of reproductive age
in 5 to 10% [2].
* Correspondence: [email protected]
Department of Traditional Chinese Medicine, The First Peoples Hospital of
Shunde, Foshan, PR China
2014 Chen et al.; licensee BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative
Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and
reproduction in any medium, provided the original work is properly credited.
Methods
Search strategy
Page 2 of 8
Page 3 of 8
Table 1 Overall quality of reporting rating using items from the CONSORT statement (n = 39)
Item Criteria
Description
Number. of %
positive trials
95% CI
Cohens
coefficient
95% CI
Randomized
in the title
or abstract
36
92 84 to 100
Background
38
97 92 to 100
0.62
0.35 to 0.95
Trial design
34
87
0.74
0.52 to 0.98
Participants
36
92 84 to 100
0.92
0.83 to 1.00
Interventions
35
90 80 to 100
0.63
0.42 to 0.98
Outcomes
23
59
43 to 75
0.81
0.65 to 0.99
Sample size
19
49
32 to 65
0.78
0.54 to 0.97
12
Statistical
methods
29
74
60 to 89
0.68
0.43 to 0.96
13
Flow chart
21
54
37 to 70
0.93
0.85 to 1.00
14
Recruitment
20
51
35 to 68
0.54
0.36 to 0.92
17
Outcomes and
estimation
20
51
35 to 68
0.86
0.73 to 0.99
18
Ancillary
analyses
20
51
35 to 68
0.66
0.31 to 0.97
19
Harms
16
41
25 to 57
0.73
0.62 to 0.96
76 to 98
Results
The RCTs selection process is outlined in Figure 1. The
researchers applied the search method to find 225 reports
related to the topic, among which 35 reports of duplicates,
29 reports of non-MET therapy or PCOS, 23 reports of
animal experiments, reviews and comments are excluded.
Page 4 of 8
Cohens
coefficient
95% CI
67
51 to 82
0.83
0.72 to 0.98
19
49
31 to 64
0.71
0.55 to 0.94
20
51
27 to 55
0.72
0.48 to 0.95
38
97 92 to 100
0.65
0.49 to 0.97
17
44
0.92
0.80 to 0.99
Item
Criteria
Description
Randomization
26
11
Blinding
15
Baseline data
16
Number of %
positive trials
27 to 60
Page 5 of 8
Number of
%
studies (n = 39)
Year of publication
1996 to 2001
17.9
2002 to 2007
12
30.8
20
51.3
Before
17.9
After
32
82.1
North America
15.4
Europe
16
41.0
Others
17
43.6
Yes
19
48.7
No
20
51.3
20.5
No
31
79.5
Placebo
16
41.0
Sole intervention
11
28.2
7.7
23.1
23.1
17.9
Human Reproduction
15.4
7.7
14
35.9
0.00 to 2.99
10
25.6
3.00 to 5.99
24
61.5
6.00-
10.3
Randomization, allocation concealment and implementation, blinding, baseline characteristics and ITT analysis
were reported in 26 (67%), 19 (49%), 20 (51%), 38 (97%)
and 17 (44%) of the 39 RCTs, respectively (Table 2).
The median score of key methodological items was 4
with a minimum of 0 and a maximum of 5. Among the
39 studies, 1 (3%) did not report any of the five key
methodological items (Table 2).
Exploratory analysis: factors associated with better
reporting quality
SE
95% CI
Constant
5.52
0.81
6.80
< 0.001
3.87 to 7.17
Funding source
1.71
0.75
2.27
0.030
0.18 to 3.24
Year of publication
3.51
0.83
4.22
< 0.001
1.82 to 5.19
Discussion
This study demonstrated that the quality of reporting in
RCTs on MET for PCOS was suboptimal especially in key
methodological items. This indicated that RCTs on MET
for PCOS syndrome needed improvement to meet the
level of reporting quality required by the CONSORT
statement. It is important to follow the guidelines of the
CONSORT statement for RCTs on MET for PCOS for
two reasons. First, inconsistent findings of reviews [12,13]
or controversies [14-17] still existed in the effect of MET
on reproductive function in PCOS patients. Transparency
and accuracy of RCT reports will benefit the evidencebased information extracting, assessing the validity of the
results and medical decision making. Second, standardized
report format allowed the reader to obtain more information in a short time. Detailed and transparent reporting
made it easy to replicate the study and avoid the waste of
medical resources.
Page 6 of 8
We identified five areas where information was insufficient or inadequate in most studies. These areas are sample size, harms, allocation concealment, blinding and ITT
analysis. Most importantly, the reporting quality of key
methodological items was poor. Our results are in agreement with similar studies assessing the reporting quality
of RCTs published in other medical journals [27-29]. All
of them showed a suboptimal reporting quality, with key
methodologies being usually the most poorly reported
items. Allocation concealment, blinding, and ITT analysis
are critical in avoiding selection, performance/detection,
and attrition bias, respectively. An overestimation of
treatment effects has been demonstrated in trials with
inadequate key methodological design comparison with
trials that adequately reported these methodological
items [19].
Understanding the importance of transparency in reporting clinical trials, an international team, including
epidemiologists, statisticians and journal editors, developed the Consolidated Standards for Reporting Trials
(CONSORT) statement in 1996 [30]. The CONSORT
statement is an evidence-based set of recommendations
for reporting two-arm, parallel-group RCTs, including a
minimum set of items to be reported pertaining to the
rationale, design, analysis, and interpretation of the trial
(that is the CONSORT checklist) and a diagram describing
flow of participants through a trial (that is a flow diagram). It is intended to facilitate the complete and
Figure 2 Correlation between the score of overall reporting quality and year of publications.
Page 7 of 8
Conclusions
Our findings show that the reporting quality of RCTs in
MET for PCOS is suboptimal especially in key methodological items. Regarding the crucial methodological issues
of blinding, allocation concealment, and analysis by ITT,
our results stress the need for researchers involved in
RCTs of MET for PCOS to improve the methodological
quality of their research through a strengthened international collaboration. Reporting of RCTs on MET for
PCOS should meet and keep up with the standards of the
CONSORT statement.
Additional file
Additional file 1: Database of RCTs in MET for PCOS.
Abbreviations
CC: clomiphene citrate; CENTRAL: Cochrane Central Register of Controlled
Trials; CONSORT: Consolidated Standards of Reporting Trials; ITT: intention-totreat; MET: metformin; PCOS: polycystic ovary syndrome; RCTs: randomized
controlled trials.
Competing interests
The authors declare that they have no competing interests.
Authors contributions
BYC: conception and design, data collection and analysis, manuscript writing
and final approval of the manuscript. JL: data collection and analysis, critical
revision and final approval of the manuscript. CZ: revising the manuscript
critically for important intellectual content and final approval of the
manuscript. MYL: conception and design, manuscript writing, final approval
of manuscript. All authors read and approved the final manuscript.
Acknowledgments
The authors would like to express sincere thanks to our colleagues, staff of
the First Peoples Hospital of Shunde, Foshan for their support. There was no
external funding for this project.
Received: 20 June 2013 Accepted: 3 April 2014
Published: 17 April 2014
References
1. Kahn JA, Gordon CM: Polycystic ovary syndrome. Adolesc Med 1999,
10:321336.
2. Carmina E, Lobo RA: Polycystic ovary syndrome (PCOS): arguably the
most common endocrinopathy is associated with significant morbidity
in women. J Clin Endocrinol Metab 1999, 84:18971899.
3. Pritts EA: Treatment of the infertile patient with polycystic ovarian
syndrome. Obstet Gynecol Surv 2002, 57:587597.
4. Diamanti-Kandarakis E: Polycystic ovarian syndrome: pathophysiology,
molecular aspects and clinical implications. Expert Rev Mol Med 2008,
10:e3.
5. Siassakos D, Wardle P: Polycystic ovary syndrome and pregnancy
outcome: red herring or red flag? BJOG 2007, 114:922932.
6. Costello MF, Eden JA: A systematic review of the reproductive system
effects of metformin in patients with polycystic ovary syndrome.
Fertil Steril 2003, 79:113.
7. Lord JM, Flight IH, Norman RJ: Metformin in polycystic ovary syndrome:
systematic review and meta-analysis. BMJ 2003, 327:951953.
8. Kashyap S, Wells GA, Rosenwaks Z: Insulin-sensitizing agents as primary
therapy for patients with polycystic ovarian syndrome. Hum Reprod 2004,
19:24742483.
9.
10.
11.
12.
13.
14.
15.
16.
17.
18.
19.
20.
21.
22.
23.
24.
25.
26.
27.
28.
Siebert TI, Kruger TF, Steyn DW, Nosarka S: Is the addition of metformin
efficacious in the treatment of clomiphene citrate-resistant patients with
polycystic ovary syndrome? A structured literature review. Fertil Steril
2006, 86:14321437.
Moll E, van der Veen F, van Wely M: The role of metformin in polycystic
ovary syndrome: a systematic review. Hum Reprod Update 2007,
13:527537.
Creanga AA, Bradley HM, McCormick C, Witkop CT: Use of metformin in
polycystic ovary syndrome - A meta-analysis. Obstet Gynecol 2008,
111:959968.
Palomba S, Pasquali R, Orio F, Nestler JE: Clomiphene citrate, metformin or
both as first-step approach in treating anovulatory infertility in patients
with polycystic ovary syndrome (PCOS): a systematic review of head-tohead randomized controlled studies and meta-analysis. Clin Endocrinol
2009, 70:311321.
Sun X, Zhang D, Zhang W: Effect of metformin on ovulation and
reproductive outcomes in women with polycystic ovary syndrome: a
meta-analysis of randomized controlled trials. Arch Gynecol Obstet 2013,
288:423430.
Legro RS, Barnhart HX, Schlaff WD, Carr BR, Diamond MP, Carson SA,
Steinkampf MP, Coutifaris C, McGovern PG, Cataldo NA, Gosman GG, Nestler
JE, Giudice LC, Leppert PC, Myers ER: Clomiphene, metformin, or both for
infertility in the polycystic ovary syndrome. N Engl J Med 2007,
356:551566.
Zain MM, Jamaluddin R, Ibrahim A, Norman RJ: Comparison of clomiphene
citrate, metformin, or the combination of both for first-line ovulation
induction, achievement of pregnancy, and live birth in Asian women
with polycystic ovary syndrome: a randomized controlled trial. Fertil Steril
2009, 91:514521.
Dunaif A: Drug insight: insulin-sensitizing drugs in the treatment of
polycystic ovary syndrome - a reappraisal. Nat Clin Pract Endocrinol Metab
2008, 4:272283.
Tang T, Lord JM, Norman RJ, Yasmin E, Balen AH: Insulin-sensitising drugs
(metformin, rosiglitazone, pioglitazone, D-chiro-inositol) for women with
polycystic ovary syndrome, oligo amenorrhoea and subfertility. Cochrane
Database Syst Rev 2012, 5, CD003053.
Lu L, Zeng J, Chen Y: Quality of reporting in randomized controlled trials
conducted in China on the treatment of cancer pain. Expert Rev
Anticancer Ther 2011, 11:871877.
Moher D, Hopewell S, Schulz KF, Montori V, Gotzsche PC, Devereaux PJ,
Elbourne D, Egger M, Altman DG, Consort: CONSORT 2010 explanation
and elaboration: updated guidelines for reporting parallel group
randomised trials. Int J Surg 2012, 10:2855.
Toulmonde M, Bellera C, Mathoulin-Pelissier S, Debled M, Bui B, Italiano A:
Quality of randomized controlled trials reporting in the treatment of
sarcomas. J Clin Oncol 2011, 29:12041209.
Diallo S, Cour F, Josephson A, Vidart A, Botto H, Lebret T, Bonan B:
Evaluating single-incision slings in female stress urinary incontinence:
the usefulness of the CONSORT statement criteria. Urology 2012,
80:535541.
Rios LP, Odueyungbo A, Moitri MO, Rahman MO, Thabane L: Quality of
reporting of randomized controlled trials in general endocrinology
literature. J Clin Endocrinol Metab 2008, 93:38103816.
Lai R, Chu R, Fraumeni M, Thabane L: Quality of randomized controlled
trials reporting in the primary treatment of brain tumors. J Clin Oncol
2006, 24:11361144.
Hollis S, Campbell F: What is meant by intention to treat analysis? Survey
of published randomised controlled trials. Br Med J 1999, 319:670674.
Gluud LL, Thorlund K, Gluud C, Woods L, Harris R, Sterne JAC: Reported
methodologic quality and discrepancies between large and small
randomized trials in meta-analyses. Ann Intern Med 2008, 149:596596.
Montori VM, Bhandari M, Devereaux PJ, Manns BJ, Ghali WA, Guyatt GH: In
the dark - The reporting of blinding status in randomized controlled
trials. J Clin Epidemiol 2002, 55:787790.
Dias S, McNamee R, Vail A: Evidence of improving quality of reporting of
randomized controlled trials in subfertility. Hum Reprod 2006,
21:26172627.
Farrokhyar F, Chu R, Whitlock R, Thabane L: A systematic review of the
quality of publications reporting coronary artery bypass grafting trials.
Can J Surg 2007, 50:266277.
Page 8 of 8
29. Scales CD Jr, Norris RD, Keitz SA, Peterson BL, Preminger GM, Vieweg J,
Dahm P: A critical assessment of the quality of reporting of randomized,
controlled trials in the urology literature. J Urol 2007, 177:10901094.
30. Begg C, Cho M, Eastwood S, Horton R, Moher D, Olkin I, Pitkin R, Rennie D,
Schulz KF, Simel D, Stroup DF: Improving the quality of reporting of
randomized controlled trials. The CONSORT statement. JAMA 1996,
276:637639.
31. Prady SL, Richmond SJ, Morton VM, Macpherson H: A systematic
evaluation of the impact of STRICTA and CONSORT recommendations
on quality of reporting for acupuncture trials. PLoS One 2008, 3:e1577.
32. Cobo E, Cortes J, Ribera JM, Cardellach F, Selva-OCallaghan A, Kostov B,
Garcia L, Cirugeda L, Altman DG, Gonzalez JA, Sanchez JA, Miras F, Urrutia A,
Fonollosa V, Rey-Joly C, Vilardell M: Effect of using reporting guidelines
during peer review on quality of final manuscripts submitted to a
biomedical journal: masked randomised trial. Br Med J 2011, 22:343.
doi:10.1186/1745-6215-15-128
Cite this article as: Chen et al.: A retrospective survey of quality of
reporting on randomized controlled trials of metformin for polycystic
ovary syndrome. Trials 2014 15:128.