Original Paper
Received: December 13, 2018
Accepted: Feburary 14, 2019
Published online: January 7, 2020
Curr Urol 2019;13:200–208
DOI: 10.1159/000499271
‘Prostate Cancer’ Information on the Internet:
Fact or Fiction?
Yusuf Moollaa*
Ahmed Adamb*
Marlon Pererac
Nathan Lawrentschukd
Department of Oncology, Klerksdorp Hospital, Klerksdorp/Tshepong Hospital Complex, Klerksdorp, North West Province; bDepartment of
Urology, Helen Joseph Hospital & Department of Paediatric Urology, Rahima Moosa Mother & Child (Coronation) Hospital, Division of Urology, Department of Surgery, Faculty of Health Sciences, School of Clinical Medicine, University of the Witwatersrand, Johannesburg, South
Africa; cDepartment of Surgery, Austin Health, University of Melbourne, VIC and Department of Surgery, University of Queensland, Brisbane,
QLD; dDepartment of Surgery, Austin Health, University of Melbourne, and Olivia-Newton John Cancer Centre, University of Melbourne, and
Department of Surgical Oncology, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia
a
Key Words
Prostate cancer • DISCERN score • Health on the Net seal •
Internet information quality • JAMA Benchmarks
Abstract
Background/Aims: In today’s information era, patients often seek information regarding health using the internet.
We assessed reliability and validity of internet information
regarding ‘prostate cancer’. Methods: Search term ‘prostate
cancer’ used on Google website (June 2017). Critical analysis was performed on first 100 hits using JAMA benchmarks,
DISCERN score, Health on the Net. Results: 33 500 000 hits
returned. Top 100 hits were critically analyzed. Ten links [duplicate links (n = 7), book reviews (n = 1), dead sites (n = 2)]
were excluded, therefore 90 were analyzed. Subcategories
assessed included: commercial (53.33%), university/medical
center (24.44%), government (13.33%); non-governmental/
non-profit organizations (8.89%). Sub-type of information
content assessed included: factual (74.44%), clinical trials
(18.89%); stories (5.56%); question and answer (1.11%). Website rated as HONcode seal positive (14,44%) or seal negative
(85,56%). Website content based on JAMA benchmarks: 0
benchmarks (4.44%), 1 benchmark (16.67%), 2 benchmarks
(34.44%), 3 benchmarks (27.78%), 4 benchmarks (16.67%). DISCERN score rated: ‘low’ score (16–32) = 12 websites (13.33%),
‘moderate’ score (33–64 points) = 68 websites (75.56%),
© 2020 The Author(s)
Published by S. Karger AG, Basel
Fax +41 61 306 12 34
E-Mail
[email protected]
www.karger.com
This article is licensed under the Creative Commons AttributionNonCommercial-NoDerivatives 4.0 International License (CC BYNC-ND) (http://www.karger.com/Services/OpenAccessLicense).
Usage and distribution for commercial purposes as well as any distribution of modified material requires written permission.
‘high’ score (≥ 65 points) = 10 websites (11.11%). Conclusion: Critical assessment of ‘Prostate Cancer’ information on
the internet, showed that overall quality was observed to be
accurate, however majority of individual websites are unreliable as a source of information by itself for patients. Doctors
and patients need to be aware of this ‘quality vs quantity’
discrepancy when sourcing PCa information on the internet.
© 2020 The Author(s)
Published by S. Karger AG, Basel
Introduction
Prostate cancer (PCa) is the second most common
cancer in men worldwide [1]. In 2012, an estimated 14.1
million new cases of cancer were diagnosed worldwide,
of which just over 1.1 million were PCa cases, accounting for about 8% of all new cancer cases and about 15%
of cancers in men [2]. This makes PCa the 4th most prevalent cancer in both sexes combined, with almost 70% of
all cases being diagnosed in more developed regions of
the world [3].
Greater access to medical information provides patients with a valuable tool for self-education [4], and an
opportunity for better-informed decision making and
greater participation in overall care [5]. However, the
reliability, validity, completeness and relevance of the
Yusuf Moolla
Department of Oncology, Klerksdorp Hospital
Klerksdorp/Tshepong Hospital Complex
ZA–2570 Klerksdorp (South Africa)
E-Mail
[email protected]
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
*Y. Moolla and A, Adam shared co-first authorship.
information may be questionable, since sources of information on the internet are varied and are largely unregulated. The result is that the quality of information that
reaches the patient is inconsistent [6]. This is further supported by several studies of single medical conditions,
which suggested deficiencies in the quality of Web-based
health information [7].
Thus, we aimed to objectively assess the quality and
validity of ‘prostate cancer’ information currently available on the internet, more specifically on the Google
platform.
Materials and Methods
Categorization
The websites reviewed were categorized based on: affiliation
(commercial, university/medical center, non-profit organization,
government), content type (medical facts, clinical trials, human
interest stories, question and answer), and specialization of topic
and content (website exclusively related to PCa or only part of
website).
Quality Assessment Instruments
Several quality evaluation tools have been developed in order
to assess health information using various criteria. Amongst the
many tools available, we selected 3 different, validated evaluation
tools for this specific study. These included the Health on the Net
Foundation (HON) code [8, 9], the Journal of American Medical
Association (JAMA) benchmarks [10] and the DISCERN tool [11].
HON code
HON is a non-profit organization based in Switzerland and
founded in 1995. It is one of the first Uniform Resource Locator used as a guide to reliable sources of healthcare information
on the internet. It proposes a voluntary 8-point code of conduct
comprising 8 ethical principles: (authoritative; complementarity;
privacy; attribution; justifiability; transparency; financial disclosure; advertising policy). Any website which complies with this
code is granted permission to display the HON award-like badge
on its website upon request. The certificate is valid for 1 year after which the website needs to be re-evaluated before obtaining
re-certification. The HON code is the oldest quality evaluation
tool being used to date [8, 9].
‘Prostate Cancer’ and the Internet: Fact or
Fiction?
JAMA Benchmarks
The JAMA benchmarks are another widely used quality evaluation tool. In a JAMA article in 1997, Silberg et al. [10] proposed a
set of criteria designed to assess and evaluate the quality of health
information on the internet. These benchmarks are namely: authorship of medical content, attribution of source of information,
disclosure of ownership of webpage and any conflict of interest
and currency of posted content.
Each website was evaluated to determine if they met the JAMA
benchmark criteria [10]. The 4 criteria covered in this validation
process are: authorship, attribution, currency, and disclosure. Authorship requires that authors and contributors names, affiliations
and credentials are displayed on the website. Attribution refers
to effective referencing of all content of the website. Currency
requires that the website include dates of when the content was
first posted and when was the last update. Disclosure demands
that the website’s ownership and any potential conflict of interest
are stated as well as any sponsorship or advertising. These scores
were assessed by the authors and recorded accordingly.
DISCERN Criteria
DISCERN is a valid and reliable 16-point questionnaire to
aid health consumers and information providers in evaluating the
quality of health information on any website they wish to evaluate. It was launched in 1998 and created by the Division of Public
Health and Primary Care at Oxford University, London [11]. It
is comprised of 3 distinct set of questions: Section 1 (questions
1–8) assesses reliability; section 2 (questions 9–15) focuses on the
quality of information about treatment choices; section 3 (question 16) provides an overall quality rating of the publication independent of the previous 15 questions. Each question is then scored
on a range from 1 (definite NO) to 5 (definite YES). A score of
2–4 is a range given in cases which the criterion is partially met to
some extent. The maximum total score for all 16 questions is 80,
and the quality of each website is classified as high (≥ 65 points),
moderate (33–64 points), or low (16–32 points). As with the validation tools above, scoring and grading was performed on all sites
retrieved.
Results
The Google search returned 33,500,000 hits, the first
100 of which were critically analyzed (table 1). Ten websites were excluded due to being duplicate links (7 websites), dead links (2 websites) or book previews (1 webCurr Urol 2019;13:200–208
201
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
Search Strategy
The search term ‘prostate cancer’ was used (11th June 2017)
on the Google search engine (www.google.com). The search was
done using an updated browser of Internet Explorer Version 11
(most recent version with all available updates installed). The
website itself was to be evaluated as part of the critical assessment and not just the landing page of the Google search results.
Therefore, if further information was obtained elsewhere on the
website via subheadings, links, or leading pages, this information
retrieved was considered to be obtained as a result of being directed to it, either directly or indirectly, via the ‘original’ Google
search. The study search was limited to the English language only.
Using a 2-step verification process, the websites were then assessed for the HON Code of Conduct (HONcode) quality certification [8, 9]. Firstly, each site was manually checked for the HON
seal to determine certification status. If the website displayed the
HONcode badge (seal), its current validity was further counterchecked by clicking on the active and dynamic badge. This leads
to a page on the HON servers, containing the website’s actual certificate which displays the initial certification date as well as the
current validity status. Both these parameters were recorded for
study purposes.
HON
code seal
JAMA
DISCERN score
benchmark (16–80)
1
2
3
4
5
6
7
8
9
No
No
Yes
Yes
No
No
No
3
3
4
1
3
0
2
No
10
11
12
13
14
Categorization/
affiliation
Website exclusive to
PCa/partly exclusive
Sub-type/
content
51
60
60
40
59
51
53
commercial
commercial
commercial
commercial
university or medical center
non-profit organization
non-profit organization
exclusive
exclusive
exclusive
partly
exclusive
exclusive
exclusive
medical facts
medical facts
medical facts
medical facts
medical facts
medical facts
medical facts
0
28
commercial
exclusive
medical facts
No
3
51
government
exclusive
medical facts
No
No
Yes
2
4
4
56
67
61
non-profit organization
commercial
non-profit organization
exclusive
exclusive
exclusive
medical facts
medical facts
medical facts
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
No
No
Yes
No
No
No
Yes
Yes
No
No
Yes
No
No
No
No
No
No
2
2
2
1
2
3
4
3
3
1
3
3
2
4
1
3
2
62
63
51
59
35
67
72
60
43
23
58
61
38
76
61
35
65
government
university or medical center
commercial
university or medical center
commercial
commercial
commercial
commercial
government
commercial
government
government
government
non-profit organization
university or medical center
university or medical center
commercial
exclusive
exclusive
partly
exclusive
partly
exclusive
exclusive
exclusive
exclusive
partly
exclusive
exclusive
exclusive
exclusive
exclusive
partly
exclusive
32
33
34
No
No
No
2
1
2
34
50
28
non-profit organization
university or medical center
commercial
partly
exclusive
partly
35
36
37
38
2
1
2
3
55
29
29
73
university or medical center
commercial
commercial
non-profit organization
exclusive
partly
exclusive
exclusive
39
40
41
42
43
44
45
46
No
No
No
Yes
(Expired)
No
No
No
No
No
No
Yes
No
medical facts
medical facts
medical facts
medical facts
medical facts
medical facts
medical facts
medical facts
medical facts
clinical trials
medical facts
medical facts
medical facts
medical facts
medical facts
medical facts
question and
answer
medical facts
medical facts
human interest
stories
medical facts
clinical trials
clinical trials
medical facts
1
2
2
1
1
1
4
4
56
37
27
47
57
51
63
39
non-profit organization
commercial
commercial
non-profit organization
commercial
commercial
commercial
university or medical center
exclusive
exclusive
partly
exclusive
exclusive
exclusive
exclusive
exclusive
47
48
No
3
49
commercial
exclusive
49
No
0
28
commercial
partly
No
Website link
Excluded
from study
Curr Urol 2019;13:200–208
http://www.medicalnewstoday.com/articles/150086.php
https://en.wikipedia.org/wiki/Prostate_cancer
http://www.medicinenet.com/prostate_cancer/article.htm
http://www.webmd.com/prostate-cancer/default.htm
https://www.cancer.org/cancer/prostate-cancer.html
https://www.pcf.org/c/prostate-cancer-symptoms/
https://www.cancerresearchuk.org/about-cancer/prostate-cancer
http://about-cancer.cancerresearchuk.org/about-cancer/prostate-cancer/symptoms
Duplicate link
http://www.prostate.org.au/awareness/general-information/what-you-need-to-knowabout-prostate-cancer/
https://www.cancer.gov/types/prostate
https://seer.cancer.gov/statfacts/html/prost.html
Duplicate link
https://prostatecanceruk.org/prostate-information/about-prostate-cancer
http://emedicine.medscape.com/article/1967731-overview
http://www.mayoclinic.org/diseases-conditions/prostate-cancer/basics/definition/con20029597
http://www.nhs.uk/Conditions/Cancer-of-the-prostate/Pages/Introduction.aspx
http://www.cancer.net/cancer-types/prostate-cancer
http://www.health24.com/medical/prostate
http://www.urologyhealth.org/urologic-conditions/prostate-cancer
http://www.express.co.uk/life-style/health/778884/prostate-cancer-symptoms-seven-signs
http://www.prostatecancerfoundation.co.za/cake/index.php/
http://www.healthline.com/health/prostate-cancer
https://patient.info/health/prostate-cancer-leaflet
https://www.cdc.gov/cancer/prostate/index.htm
https://www.sciencedaily.com/news/health_medicine/prostate_cancer/
https://ghr.nlm.nih.gov/condition/prostate-cancer
https://nihseniorhealth.gov/prostatecancer/prostatecancerdefined/01.html
https://medlineplus.gov/prostatecancer.html
https://www.nccn.org/patients/guidelines/prostate/
http://www.cancercenter.com/prostate-cancer/
http://www.nature.com/pcan/index.html
http://www.prostatecancer.ca/
http://www.cansa.org.za/mens-health/
https://www.ucsfhealth.org/conditions/prostate_cancer/
http://www.rd.com/health/conditions/prevent-prostate-cancer/
Moolla/Adam/Perera/Lawrentschuk
https://my.clevelandclinic.org/health/articles/prostate-cancer-basics
http://www.onclive.com/specialty/prostate-cancer
http://www.renalandurologynews.com/prostate-cancer/section/618/
http://www.cancer.ca/en/cancer-information/cancer-type/prostate/prostate-cancer/?region=on
medical facts https://zerocancer.org/
http://www.bbc.com/news/health-40131381
clinical trials
http://www.cancertherapyadvisor.com/prostate-cancer/section/4402/
clinical trials
medical facts http://www.macmillan.org.uk/information-and-support/prostate-cancer
medical facts https://www.radiologyinfo.org/en/info.cfm?pg=pros_cancer
medical facts https://uk.movember.com/mens-health/prostate-cancer
medical facts https://labtestsonline.org/understanding/conditions/prostate/
http://www.auanet.org/guidelines/early-detection-of-prostate-cancer-(2013-reclinical trials
viewed-and-validity-confirmed-2015)
http://www.cancer.org.au/about-cancer/types-of-cancer/prostate-cancer.html
medical facts http://www.nydailynews.com/life-style/best-fight-prostate-cancer-understanding-article-1.3223985
human interest http://www.health.com/prostate-cancer
stories
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
202
Table 1. Critical analysis of the first 100 hits, using the search term: ‘prostate cancer’, using the Google search engine (performed June 2017)
Duplicate link
‘Prostate Cancer’ and the Internet: Fact or
Fiction?
Table 1. Critical analysis of the first 100 hits, using the search term: ‘prostate cancer’, using the Google search engine (performed June 2017)
No
HON
code seal
JAMA
DISCERN score
benchmark (16–80)
50
51
52
53
No
No
No
No
1
1
2
3
54
55
56
57
No
Curr Urol 2019;13:200–208
Categorization/
affiliation
Website exclusive to
PCa/partly exclusive
Sub-type/
content
35
54
34
46
university or medical center
university or medical center
university or medical center
commercial
exclusive
exclusive
exclusive
exclusive
3
33
non-profit organization
exclusive
No
No
4
2
70
33
university or medical center
commercial
exclusive
exclusive
58
59
60
61
62
63
64
No
2
62
university or medical center
exclusive
No
No
No
No
No
2
4
1
3
4
51
38
20
49
55
commercial
university or medical center
commercial
commercial
commercial
exclusive
exclusive
exclusive
exclusive
exclusive
65
No
4
54
university or medical center
exclusive
66
67
68
69
No
2
40
university or medical center
exclusive
No
No
0
2
30
57
university or medical center
government
exclusive
exclusive
70
71
72
No
4
56
commercial
exclusive
No
2
42
commercial
exclusive
73
74
No
No
4
2
45
31
non-profit organization
commercial
exclusive
exclusive
75
No
2
47
commercial
exclusive
76
No
3
36
commercial
exclusive
77
78
Yes
No
4
3
70
42
commercial
commercial
exclusive
exclusive
http://www.health.harvard.edu/topics/prostate-cancer
https://siteman.wustl.edu/treatment/cancer-types/prostate/our-approach/
http://www.ferring.co.za/therapeutic-areas/urology/prostate-cancer
https://www.theguardian.com/society/2017/jun/03/prostate-cancer-therapy-study-abiraterone
medical facts https://radiopaedia.org/articles/prostatic-carcinoma-1
https://radiopaedia.org/articles/prostate-cancer-staging-1
medical facts http://uroweb.org/guideline/prostate-cancer/
human interest http://www.wral.com/expert-opinion-on-prostate-cancer-screening-shifts-to-more-testing-/16753079/
stories
medical facts https://www.nice.org.uk/guidance/cg175
https://pathways.nice.org.uk/pathways/prostate-cancer
medical facts http://www.medbroadcast.com/condition/getcondition/prostate-cancer
https://www.omim.org/entry/176807
clinical trials
http://www.naturalnews.com/prostate_cancer.html
clinical trials
medical facts https://www.statnews.com/2017/05/04/prostate-cancer-research-psa/
https://www.uspreventiveservicestaskforce.org/Page/Document/RecommendationStateclinical trials
mentFinal/prostate-cancer-screening
medical facts https://academic.oup.com/jcem/article/86/8/3467/2848333/The-Endocrinology-of-Prostate-Cancer
medical facts https://clicks.co.za/health/conditions/article-view/prostate-cancer
http://bestpractice.bmj.com/best-practice/monograph/254.html?g=w_bmj_bp
medical facts http://www.odessaregionalmedicalcenter.com/services/prostate-cancer/
medical facts http://www.bccancer.bc.ca/health-professionals/professional-resources/cancer-management-guidelines/genitourinary/prostate
medical facts https://www.uptodate.com/contents/screening-for-prostate-cancer
http://hcamidwest.com/service/prostate-cancer
http://www.dailymail.co.uk/health/article-4495464/Prostate-cancer-vaccine-provide-cureclinical trials
study-finds.html
https://elifesciences.org/articles/09207
clinical trials
medical facts http://indianexpress.com/article/lifestyle/nanotech-based-test-can-predict-prostatecancer-risk-better-4698039/
human interest http://www.menshealth.com/health/winning-the-prostate-cancer-war
stories
https://news.utexas.edu/2017/06/06/starving-prostate-cancer-with-what-you-eat-for-dinclinical trials
ner
medical facts http://www.emedicinehealth.com/prostate_cancer/article_em.htm
medical facts http://www.9news.com/news/buddy-check9-prostate-cancer/447172764
79
No
2
46
commercial
exclusive
medical facts
80
No
3
36
commercial
exclusive
medical facts
81
82
No
No
4
2
62
68
commercial
commercial
exclusive
exclusive
medical facts
medical facts
83
No
2
25
commercial
partly
No
2
35
commercial
exclusive
human interest http://www.stuff.co.nz/national/health/93558013/waikato-community-raises-25kfor-nz-prostate-cancer-foundation
stories
Book Review
https://books.google.co.za/books?id=Bg6ZbqhhboUC&pg=PA1&lpg=PA1&dq=prostate+cancer&source=bl&ots=vjkirgXyZY&sig=zxPPXCEIJRU55bA9jqg08cLXYU8&hl=en&sa=X&ved=0ahUKEwjf6tud67XUAhXqAMAKHW9mCs44UBDoAQhLMAU#v=onepage&q=prostate%20cancer&f=false
medical facts https://www.tuko.co.ke/243133-revealed-why-black-men-die-prostate-cancer-comparedwhites-find-details.html
84
85
Website link
Excluded
from study
clinical trials
medical facts
medical facts
clinical trials
Duplicate link
Duplicate link
Dead Link
Dead Link
http://www.prevention.com/health/4-things-all-women-should-know-about-prostatecancer
http://edition.cnn.com/2017/04/11/opinions/prostate-screening-change-brawley/index.
html
https://www.tri-kobe.org/nccn/guideline/urological/english/prostate.pdf
http://www.onhealth.com/content/1/prostate_cancer
203
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
medical facts
medical facts
university or medical center
commercial
2
2
56
62
exclusive
exclusive
No
No
100
medical facts
commercial
No
96
97
98
99
3
55
exclusive
medical facts
university or medical center
No
95
1
57
exclusive
medical facts
university or medical center
No
94
3
69
exclusive
medical facts
medical facts
medical facts
medical facts
clinical trials
exclusive
exclusive
exclusive
exclusive
exclusive
university or medical center
government
non-profit organization
commercial
university or medical center
52
51
54
64
30
No
Yes
No
Yes
No
89
90
91
92
93
1
3
2
3
2
commercial
Yes
88
3
40
exclusive
medical facts
https://healthiertalk.com/starve-prostate-cancer-cells-with-this-snack/
https://medicalxpress.com/news/2017-06-abiraterone-metastatic-prostate-cancer-growth.
html
http://www.news-medical.net/news/20170609/New-diagnosticc2a0test-uses-machine-learning-to-accurately-detect-aggressive-prostate-cancer.aspx
https://www.mskcc.org/nomograms/prostate
https://www.andrologyaustralia.org/prostate-problems/prostate-cancer-diagnosis/
https://www.cancer.ie/cancer-information/prostate-cancer#sthash.r6ZD147N.dpbs
https://www.drugs.com/condition/prostate-cancer.html
http://www0.sun.ac.za/vivus/vivus-2-may-2016/excellence/large-study-targets-prostatecancer-in-african-men.html
http://healthcare.utah.edu/huntsmancancerinstitute/cancer-information/cancer-types-andtopics/prostate-cancer.php
http://www.hopkinsmedicine.org/brady-urology-institute/specialties/conditions-and-treatments/prostate-cancer/
http://www.innerbody.com/diseases-conditions/prostate-cancer
http://www.emedicinehealth.com/prostate_cancer/viewer-comments_em-101.htm
Duplicate link
http://www.prostatecancer-riskcalculator.com/assess-your-risk-of-prostate-cancer
http://www.merckmanuals.com/home/kidney-and-urinary-tract-disorders/cancers-of-the-kidney-and-genitourinary-tract/prostate-cancer
http://www.merckmanuals.com/home/kidney-and-urinary-tract-disorders/canDuplicate link
cers-of-the-kidney-and-genitourinary-tract/prostate-cancer
clinical trials
clinical trials
exclusive
exclusive
commercial
commercial
3
3
No
No
86
87
Excluded
from study
Website link
Sub-type/
content
Website exclusive to
PCa/partly exclusive
Categorization/
affiliation
JAMA
DISCERN score
benchmark (16–80)
HON
code seal
No
Table 1. Critical analysis of the first 100 hits, using the search term: ‘prostate cancer’, using the Google search engine (performed June 2017)
39
43
Curr Urol 2019;13:200–208
Discussion
Health information is one of the most sought after topics on the internet [12]. Access to internet worldwide has
rapidly evolved since the advent of this information platMoolla/Adam/Perera/Lawrentschuk
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
204
site), leaving a total of 90 websites for further evaluation
and critical appraisal. Majority (79/90) of the websites
were exclusive to PCa in terms of content displayed.
When assessing for the categories returned, more
than half (n = 48, 53.33%) were commercial websites.
A further 22 websites were affiliated to universities or
medical centers and accounted for almost another quarter (24.44%). Eight government websites made up 8.89%
of the websites, with the remaining 13.33% of websites
being affiliated to non-profit organizations (n = 12). By
far, the majority of websites (n = 67) contained medical
information of a factual nature (74.4%), with clinical trials (n = 17) accounting for 18.89%.
In terms of quality and validity of information, the
HONcode seal was displayed on only 14.44% of websites (n = 14), while the remaining 85.56% of websites
(n = 76) did not have any evidence of certification by the
HON (fig. 1). JAMA benchmarks were only fully met
by 16.67% of websites (n = 15). A further 25 websites
(27.78%) achieved 3 out of 4 benchmarks. Most websites (n = 31, 34.4%) met 2/4 JAMA benchmarks and 15
(16.67%) of websites only achieved 1 JAMA benchmark
and 4 (4.44%) did not achieve any benchmarks (fig. 2).
Application and scoring utilizing the DISCERN criteria revealed 10/90 websites (11.11%) that achieved a
‘high’ score (≥ 65 points), with the highest score by any
website being 76 (out of a potential maximum of 80). A
moderate score (33–64 points) was obtained by 75.56%
of websites (n = 68), and the remaining 12 websites
(13.33%) achieved a low score (16–32) (fig. 3).
The four overall best performing websites (Table 1.
Link numbers 21, 77, 28, 38), either meeting criteria or
coming close to having concurrent HON Positive; JAMA
4/4 &; DISCERN ≥ 65 points included two websites particularly (Link numbers 21 & 77), with HONcode seal
positive, JAMA benchmarks 4/4 and more specifically
have very high DISCERN scores (≥ 70 out of 80).”
Amongst the websites with the poorest validation
scores (table 1. Link numbers 9, 49, 68, 24, 62), 3 links
have no JAMA benchmarks, no HONcode seal, and relatively low DISCERN score (16–32), while 2 other links
have only 1 JAMA benchmark, no HONcode seal and a
very low DISCERN score.
Yes
No
Fig. 1. HONcode seal.
1 Benchmark
2 Benchmarks
3 Benchmarks
4 Benchmarks
Fig. 2. JAMA Benchmarks.
11.11% 13.33%
75.56%
16-32 (Low)
33-64 (Moderate)
≥ 65 (High)
Fig. 3. JAMA Benchmarks.
form. According to the International Telecommunication
Union Facts and Figures 2016 report, just under 3.5 billion (3.48 billion) individuals were estimated to be using
‘Prostate Cancer’ and the Internet: Fact or
Fiction?
Curr Urol 2019;13:200–208
205
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
0 Benchmarks
the internet worldwide. This figure has increased from
1.15 billion or 17.6% from the previous decade [13]. The
Internet world stats online website quotes an impressive
3.79 billion internet users as at 31 March 2017, which
at 49.7% just falls short of half of the global population.
This represents a growth of 936% since the turn of the
millennia in 2000 [14]. As a result of the rapid expansion
of the internet, both in terms of users and to the volumes
of information available online, it has become the single
largest source of information worldwide [6]. Health information has also seen an exponential increase in accessibility online and has become an increasingly important
source of health-related information for patients [7].
A recent study found that 75% of people who go online seek health information and also that 75% in a health
crisis use the internet to aid in decision-making [15].
Steinberg et al. [16] reported that approximately 56% of
PCa patients seek health information online. While, Valero-Aguilera et al. [17] found that only 11.2% of patients
in the study population reported using the internet as a
source of health information. This variation may be explained by discrepancies in terms of age, demographics,
and other socio-economic factors. These variations in the
findings of the select studies mentioned above, amongst
many others [18–21], support the view that generalization cannot be made with regard to internet use for health
information, as this is highly dependent on the particular
study population assessed.
Evaluation of YouTube videos found that YouTube is
an inadequate source of PCa information for patients, in
terms of information content and the presence of bias
[16]. In another study that focused on determining what
patients seek from an internet site, it was determined that
the information given was unsatisfactory, from a patient’s
perspective [22]. Patients would at times, be unable to
acquire the critical information easily without being
aided by their physician to the appropriate resources. The
degree of coverage is highly variable and there is a deficiency in balance of evidence found on many sites [23].
However, a more recent study found an acceptable
and ‘encouraging’ degree of quality and reliability of
PCa information on the web using various quality tools
(DISCERN; HONcode; JAMA benchmarks; the LIDA
instrument; Automated Readability Index; and the Flesch-Kincaid readability tests). Although the limitations
of this study was the isolated assessment of a select few
popular websites which were amongst the ‘top 10’ hits on
3 of the most popular search engines [24].
Besides the internet, another related information
source utilized by patients involve the use of Mobile Ap-
2017) of searches performed for urological malignancies on the Google platform (Y-axis
units: Numbers represent search interest relative to the highest point on the chart for the
given region and time. A value of 100 is the peak popularity for the term, and a value of
50 means that the term is half as popular).
plications (Apps). This platform, like the internet in general, also requires more stringent validation and review
to ascertain the reliability and quality of information sent
out to patients with PCa [25].
When assessing for the patterns of search amongst
all urological malignancies, PCa has been the commonest search term utilized (fig. 4) depicted by the Google
Trends data [26], which shows that PCa searches were
the most common since 2004 to present. In comparison
to the other genitourinary cancers, PCa is searched for
approximately 3 times more than bladder cancer, which
is currently the second most popular amongst the urological tumors. Interest in testicular cancer (which from
2004 until 2006 was by far the second-most searched for
on Google amongst the urological malignancies), has
steadily declined over time and is now searched for at
almost the same frequency as kidney cancer, which has
almost always being the 4th most popular amongst the 4
cancers represented.
After assessing the websites using the pre-defined
tools (table 1), we have found that the information available on the internet is not entirely reliable and complete
206
Curr Urol 2019;13:200–208
in itself as an independent source for health information on PCa. Overall 3 websites performed very poorly,
demonstrating no JAMA benchmarks, no HONcode seal,
and relatively ‘low’ DISCERN score. On the other hand,
2 websites were HONcode seal positive, JAMA benchmarks 4/4 and had ‘high’ DISCERN scores (≥ 65). Although most information presented is fairly accurate, it
often lacks critical detail on key aspects, which could
have negative impact on patient decisions regarding their
condition, outcome and their treatment choices. However, the information may serve as a guide to empower
patients to gain a better understanding into the condition.
In this internet-driven era, it is imperative that internet
users validate information obtained with reliable sources.
It also adds an extra dimension to the medical consultation in requiring doctors to assist patients in validating
information obtained via the internet and guiding them
towards the most reliable, reputable resources on the online domain.
Most of the studies evaluated in the literature had
found that patients who utilize the internet as a source
of health information, find it to be an effective tool to
Moolla/Adam/Perera/Lawrentschuk
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
Fig. 4. A screen shot (Google trend) of the trend over time (January 2004 to December
Conclusion
In the evaluation and critical assessment of PCa information on the internet, using three different quality
evaluation tools, the overall quality was observed to be
accurate, however majority of individual websites are
generally unreliable in itself as a source of information
for patients. Healthcare professionals and their patients
need to be acquainted with this ‘quality vs. quantity’ discrepancy when sourcing PCa information on the internet.
This discrepancy is becoming a more important variable
in the everyday counselling of the modern day patient
with PCa.
Acknowledgement
The authors are grateful to Mrs Anna Welman, Department
of Surgery, Helen Joseph Hospital, University of Witwatersrand,
Johannesburg, for her secretarial support in the drafting of this
manuscript.
References
1 World Cancer Research Fund International:
Prostate cancer statistics. http://www.wcrf.
org/int/cancer-facts-figures/data-specificcancers/prostate-cancer-statistics. Accessed 20
July 2017.
2 World Cancer Research Fund International:
Worldwide Data. http://www.wcrf.org/int/
cancer-facts-figures/worldwide-data.Accessed 20 July 2017.
3 Ferlay J, Soerjomataram I, Dikshit R, Eser S,
Mathers C, Rebelo M, Parkin DM, Forman
D, Bray F: Cancer incidence and mortality worldwide: sources, methods and major
patterns in GLOBOCAN 2012. Int J Cancer
2015;136:E359–386.
4 Ziebland S, Chapple A, Dumelow C, Evans
J, Prinjha S, Rozmovits L: How the internet
affects patients’ experience of cancer: a qualitative study. BMJ 2004;328:564.
5 Goldsmith J: How will the Internet change
our health system? Health Aff (Millwood)
2000;19:148–156.
6 Fahy E, Hardikar R, Fox A, Mackay S: Quality of patient health information on the Internet: reviewing a complex and evolving landscape. Australas Med J 2014;7:24–28.
‘Prostate Cancer’ and the Internet: Fact or
Fiction?
7 Berland GK, Elliott MN, Morales LS, Algazy
JI, Kravitz RL, Broder MS, Kanouse DE,
Muñoz JA, Puyol JA, Lara M, Watkins KE,
Yang H, McGlynn EA: Health information
on the Internet: accessibility, quality, and
readability in English and Spanish. JAMA
2001;285:2612–2621.
8 Health on the Net (HON): Health on the Net
Code of Conduct (HONcode). http://www.
hon.ch/HONcode/. Accessed 20 July 2017.
9 Health on the Net. https://www.healthonnet.
org/. Accessed 20 July 2017.
10 Silberg WM, Lundberg GD, Musacchio RA:
Assessing, controlling, and assuring the quality of medical information on the Internet:
Caveant lector et viewor – Let the reader and
viewer beware. JAMA 1997;277:1244–1245.
11 Charnock D, Shepperd S, Needham G, Gann
R: DISCERN: an instrument for judging the
quality of written consumer health information on treatment choices. J Epidemiol Commun Health 1999;53:105–111.
12 McMullan M: Patients using the internet to
obtain health information: how this affects
the patient-health professional relationship.
Patient Educ Couns 2006;63:24–28.
13 International Telecommunication Union: ICT
Facts and Figures 2017. http://www.itu.int/
en/ITU-D/Statistics/Pages/facts/default.aspx.
Accessed 20 July 2017.
14 Miniwatts Marketing Group: Internet World
Stats – usage and population statistics. http://
www.internetworldstats.com/stats.htm. Accessed 20 July 2017.
15 Dickerson SS, Reinhart A, Boemhke M,
Akhu-Zaheya L: Cancer as a problem to be
solved: internet use and provider communication by men with cancer. Comput Inform
Nurs 2011;29:388–395.
16 Steinberg PL, Wason S, Stern JM, Deters L,
Kowal B, Seigne J: YouTube as source of
prostate cancer information. Urology 2010;
75:619–622.
17 Valero-Aguilera B, Bermúdez-Tamayo C,
García-Gutiérrez JF, Jiménez-Pernett J, Vázquez-Alonso F, Suárez-Charneco A, Guerrero-Tejada R, Cózar-Olmo JM: Factors related to use of the Internet as a source of health
information by urological cancer patients.
Support Care Cancer 2012;20:3087–3094.
Curr Urol 2019;13:200–208
207
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
supplement knowledge but not as a primary source of information [27–29]. One of the benefits of using multiple
sources of health information is that patients are better
able to equip themselves with the understanding of the
nature of their illness and the various treatment modalities which may be available. By bringing this information to the consultation, it transforms the doctor-patient
relationship and promotes patients to play a more active
role in shared-decision making.
The study was limited to the English language only.
Secondly, the internet and search engines are dynamic processes that constantly change. Therefore, the websites assessed in this investigation may not necessarily reflect the
information available to patients at another point in time.
Another limitation of this review would be the exclusion of all other search engines utilized in today’s era,
however for the purpose of this study, only ‘Google’ was
utilized, since it is by far the commonest search engine
used, with well over 3 billion searches daily [30].
208
23 Black PC, Penson DF: Prostate cancer on the
Internet – information or misinformation? J
Urol 2006;175:1836–1842.
24 Borgmann H, Wölm JH, Vallo S, Mager
R, Huber J, Breyer J, Salem J, Loeb S, Haferkamp A, Tsaur I: Prostate cancer on the
Web – expedient tool for patients’ decisionmaking? J Cancer Educ 2017;32:135–140.
25 Adam A, Hellig JC, Perera M, Bolton D,
Lawrentschuk N: ‘Prostate Cancer Risk
Calculator’ mobile applications (Apps): a
systematic review and scoring using the validated user version of the Mobile Application
Rating Scale (uMARS). World J Urol 2018;
36:565–573.
26 Google Trends: https://trends.google.com/
trends/explore?date=all&q=Prostate%20
Cancer,Bladder%20Cancer,Kidney%20Cancer,Testicular%20Cancer. Accessed 20 December 2017.
Curr Urol 2019;13:200–208
27 Schrijvers J, Vanderhaegen J, Van Poppel H,
Haustermans K, Van Audenhove C: How do
patients between the age of 65 and 75 use a
web-based decision aid for treatment choice
in localized prostate cancer? J Evid Based
Med 2013;6:167–172.
28 Gilbert SM, Sanda MG, Dunn RL, Greenfield TK, Hembroff L, Klein E, Saigal CS,
Pisters L, Michalski J, Sandler HM, Litwin
MS, Wei JT: Satisfaction with information
used to choose prostate cancer treatment. J
Urol 2014;191:1265–1271.
29 Salonen A, Ryhänen AM, Leino-Kilpi H:
Educational benefits of Internet and computer-based programmes for prostate cancer
patients: a systematic review. Patient Educ
Couns 2014;94:10–19.
30 Internet Live Stats: Google Search Statistics.
http://www.internetlivestats.com/googlesearch-statistics/. Accessed 01 August 2018.
Moolla/Adam/Perera/Lawrentschuk
Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023
18 Wallington SF: The Internet as an emerging
patient education tool among African American men with prostate cancer: an exploratory
study. Am J Mens Health 2008;2:106–121.
19 van de Poll-Franse LV, van Eenbergen MC:
Internet use by cancer survivors: current
use and future wishes. Support Care Cancer
2008;16:1189–1195.
20 Buntrock S, Hopfgarten T, Adolfsson J,
Onelöv E, Steineck G: The Internet and prostate cancer patients searching for and finding
information. Scand J Urol Nephrol 2007;
41:367–374.
21 Pautler SE, Tan JK, Dugas GR, Pus N, Ferri
M, Hardie WR, Chin JL: Use of the internet
for self-education by patients with prostate
cancer. Urology 2001;57:230–233.
22 Rozmovits L, Ziebland S: What do patients
with prostate or breast cancer want from an Internet site? A qualitative study of information
needs. Patient Educ Couns 2004;53:57–64.