Academia.eduAcademia.edu

‘Prostate Cancer' Information on the Internet: Fact or Fiction?

2020, Current Urology

Usage and distribution for commercial purposes as well as any distribution of modified material requires written permission. Prostate cancer • DISCERN score • Health on the Net seal • Internet information quality • JAMA Benchmarks Background/Aims: In today's information era, patients often seek information regarding health using the internet. We assessed reliability and validity of internet information regarding 'prostate cancer'. Methods: Search term 'prostate cancer' used on Google website (June 2017). Critical analysis was performed on first 100 hits using JAMA benchmarks, DISCERN score, Health on the Net. Results: 33 500 000 hits returned. Top 100 hits were critically analyzed. Ten links [duplicate links (n = 7), book reviews (n = 1), dead sites (n = 2)] were excluded, therefore 90 were analyzed. Subcategories assessed included: commercial (53.33%), university/medical center (24.44%), government (13.33%); non-governmental/ non-profit organizations (8.89%). Sub-type of information content assessed included: factual (74.44%), clinical trials (18.89%); stories (5.56%); question and answer (1.11%). Website rated as HONcode seal positive (14,44%) or seal negative (85,56%). Website content based on JAMA benchmarks: 0 benchmarks (4.44%), 1 benchmark (16.67%), 2 benchmarks (34.44%), 3 benchmarks (27.78%), 4 benchmarks (16.67%). DISCERN score rated: 'low' score (16-32) = 12 websites (13.33%), 'moderate' score (33-64 points) = 68 websites (75.56%),

Original Paper Received: December 13, 2018 Accepted: Feburary 14, 2019 Published online: January 7, 2020 Curr Urol 2019;13:200–208 DOI: 10.1159/000499271 ‘Prostate Cancer’ Information on the Internet: Fact or Fiction? Yusuf Moollaa* Ahmed Adamb* Marlon Pererac Nathan Lawrentschukd Department of Oncology, Klerksdorp Hospital, Klerksdorp/Tshepong Hospital Complex, Klerksdorp, North West Province; bDepartment of Urology, Helen Joseph Hospital & Department of Paediatric Urology, Rahima Moosa Mother & Child (Coronation) Hospital, Division of Urology, Department of Surgery, Faculty of Health Sciences, School of Clinical Medicine, University of the Witwatersrand, Johannesburg, South Africa; cDepartment of Surgery, Austin Health, University of Melbourne, VIC and Department of Surgery, University of Queensland, Brisbane, QLD; dDepartment of Surgery, Austin Health, University of Melbourne, and Olivia-Newton John Cancer Centre, University of Melbourne, and Department of Surgical Oncology, Peter MacCallum Cancer Centre, Melbourne, VIC, Australia a Key Words Prostate cancer • DISCERN score • Health on the Net seal • Internet information quality • JAMA Benchmarks Abstract Background/Aims: In today’s information era, patients often seek information regarding health using the internet. We assessed reliability and validity of internet information regarding ‘prostate cancer’. Methods: Search term ‘prostate cancer’ used on Google website (June 2017). Critical analysis was performed on first 100 hits using JAMA benchmarks, DISCERN score, Health on the Net. Results: 33 500 000 hits returned. Top 100 hits were critically analyzed. Ten links [duplicate links (n = 7), book reviews (n = 1), dead sites (n = 2)] were excluded, therefore 90 were analyzed. Subcategories assessed included: commercial (53.33%), university/medical center (24.44%), government (13.33%); non-governmental/ non-profit organizations (8.89%). Sub-type of information content assessed included: factual (74.44%), clinical trials (18.89%); stories (5.56%); question and answer (1.11%). Website rated as HONcode seal positive (14,44%) or seal negative (85,56%). Website content based on JAMA benchmarks: 0 benchmarks (4.44%), 1 benchmark (16.67%), 2 benchmarks (34.44%), 3 benchmarks (27.78%), 4 benchmarks (16.67%). DISCERN score rated: ‘low’ score (16–32) = 12 websites (13.33%), ‘moderate’ score (33–64 points) = 68 websites (75.56%), © 2020 The Author(s) Published by S. Karger AG, Basel Fax +41 61 306 12 34 E-Mail [email protected] www.karger.com This article is licensed under the Creative Commons AttributionNonCommercial-NoDerivatives 4.0 International License (CC BYNC-ND) (http://www.karger.com/Services/OpenAccessLicense). Usage and distribution for commercial purposes as well as any distribution of modified material requires written permission. ‘high’ score (≥ 65 points) = 10 websites (11.11%). Conclusion: Critical assessment of ‘Prostate Cancer’ information on the internet, showed that overall quality was observed to be accurate, however majority of individual websites are unreliable as a source of information by itself for patients. Doctors and patients need to be aware of this ‘quality vs quantity’ discrepancy when sourcing PCa information on the internet. © 2020 The Author(s) Published by S. Karger AG, Basel Introduction Prostate cancer (PCa) is the second most common cancer in men worldwide [1]. In 2012, an estimated 14.1 million new cases of cancer were diagnosed worldwide, of which just over 1.1 million were PCa cases, accounting for about 8% of all new cancer cases and about 15% of cancers in men [2]. This makes PCa the 4th most prevalent cancer in both sexes combined, with almost 70% of all cases being diagnosed in more developed regions of the world [3]. Greater access to medical information provides patients with a valuable tool for self-education [4], and an opportunity for better-informed decision making and greater participation in overall care [5]. However, the reliability, validity, completeness and relevance of the Yusuf Moolla Department of Oncology, Klerksdorp Hospital Klerksdorp/Tshepong Hospital Complex ZA–2570 Klerksdorp (South Africa) E-Mail [email protected] Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 *Y. Moolla and A, Adam shared co-first authorship. information may be questionable, since sources of information on the internet are varied and are largely unregulated. The result is that the quality of information that reaches the patient is inconsistent [6]. This is further supported by several studies of single medical conditions, which suggested deficiencies in the quality of Web-based health information [7]. Thus, we aimed to objectively assess the quality and validity of ‘prostate cancer’ information currently available on the internet, more specifically on the Google platform. Materials and Methods Categorization The websites reviewed were categorized based on: affiliation (commercial, university/medical center, non-profit organization, government), content type (medical facts, clinical trials, human interest stories, question and answer), and specialization of topic and content (website exclusively related to PCa or only part of website). Quality Assessment Instruments Several quality evaluation tools have been developed in order to assess health information using various criteria. Amongst the many tools available, we selected 3 different, validated evaluation tools for this specific study. These included the Health on the Net Foundation (HON) code [8, 9], the Journal of American Medical Association (JAMA) benchmarks [10] and the DISCERN tool [11]. HON code HON is a non-profit organization based in Switzerland and founded in 1995. It is one of the first Uniform Resource Locator used as a guide to reliable sources of healthcare information on the internet. It proposes a voluntary 8-point code of conduct comprising 8 ethical principles: (authoritative; complementarity; privacy; attribution; justifiability; transparency; financial disclosure; advertising policy). Any website which complies with this code is granted permission to display the HON award-like badge on its website upon request. The certificate is valid for 1 year after which the website needs to be re-evaluated before obtaining re-certification. The HON code is the oldest quality evaluation tool being used to date [8, 9]. ‘Prostate Cancer’ and the Internet: Fact or Fiction? JAMA Benchmarks The JAMA benchmarks are another widely used quality evaluation tool. In a JAMA article in 1997, Silberg et al. [10] proposed a set of criteria designed to assess and evaluate the quality of health information on the internet. These benchmarks are namely: authorship of medical content, attribution of source of information, disclosure of ownership of webpage and any conflict of interest and currency of posted content. Each website was evaluated to determine if they met the JAMA benchmark criteria [10]. The 4 criteria covered in this validation process are: authorship, attribution, currency, and disclosure. Authorship requires that authors and contributors names, affiliations and credentials are displayed on the website. Attribution refers to effective referencing of all content of the website. Currency requires that the website include dates of when the content was first posted and when was the last update. Disclosure demands that the website’s ownership and any potential conflict of interest are stated as well as any sponsorship or advertising. These scores were assessed by the authors and recorded accordingly. DISCERN Criteria DISCERN is a valid and reliable 16-point questionnaire to aid health consumers and information providers in evaluating the quality of health information on any website they wish to evaluate. It was launched in 1998 and created by the Division of Public Health and Primary Care at Oxford University, London [11]. It is comprised of 3 distinct set of questions: Section 1 (questions 1–8) assesses reliability; section 2 (questions 9–15) focuses on the quality of information about treatment choices; section 3 (question 16) provides an overall quality rating of the publication independent of the previous 15 questions. Each question is then scored on a range from 1 (definite NO) to 5 (definite YES). A score of 2–4 is a range given in cases which the criterion is partially met to some extent. The maximum total score for all 16 questions is 80, and the quality of each website is classified as high (≥ 65 points), moderate (33–64 points), or low (16–32 points). As with the validation tools above, scoring and grading was performed on all sites retrieved. Results The Google search returned 33,500,000 hits, the first 100 of which were critically analyzed (table 1). Ten websites were excluded due to being duplicate links (7 websites), dead links (2 websites) or book previews (1 webCurr Urol 2019;13:200–208 201 Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 Search Strategy The search term ‘prostate cancer’ was used (11th June 2017) on the Google search engine (www.google.com). The search was done using an updated browser of Internet Explorer Version 11 (most recent version with all available updates installed). The website itself was to be evaluated as part of the critical assessment and not just the landing page of the Google search results. Therefore, if further information was obtained elsewhere on the website via subheadings, links, or leading pages, this information retrieved was considered to be obtained as a result of being directed to it, either directly or indirectly, via the ‘original’ Google search. The study search was limited to the English language only. Using a 2-step verification process, the websites were then assessed for the HON Code of Conduct (HONcode) quality certification [8, 9]. Firstly, each site was manually checked for the HON seal to determine certification status. If the website displayed the HONcode badge (seal), its current validity was further counterchecked by clicking on the active and dynamic badge. This leads to a page on the HON servers, containing the website’s actual certificate which displays the initial certification date as well as the current validity status. Both these parameters were recorded for study purposes. HON code seal JAMA DISCERN score benchmark (16–80) 1 2 3 4 5 6 7 8 9 No No Yes Yes No No No 3 3 4 1 3 0 2 No 10 11 12 13 14 Categorization/ affiliation Website exclusive to PCa/partly exclusive Sub-type/ content 51 60 60 40 59 51 53 commercial commercial commercial commercial university or medical center non-profit organization non-profit organization exclusive exclusive exclusive partly exclusive exclusive exclusive medical facts medical facts medical facts medical facts medical facts medical facts medical facts 0 28 commercial exclusive medical facts No 3 51 government exclusive medical facts No No Yes 2 4 4 56 67 61 non-profit organization commercial non-profit organization exclusive exclusive exclusive medical facts medical facts medical facts 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 No No Yes No No No Yes Yes No No Yes No No No No No No 2 2 2 1 2 3 4 3 3 1 3 3 2 4 1 3 2 62 63 51 59 35 67 72 60 43 23 58 61 38 76 61 35 65 government university or medical center commercial university or medical center commercial commercial commercial commercial government commercial government government government non-profit organization university or medical center university or medical center commercial exclusive exclusive partly exclusive partly exclusive exclusive exclusive exclusive partly exclusive exclusive exclusive exclusive exclusive partly exclusive 32 33 34 No No No 2 1 2 34 50 28 non-profit organization university or medical center commercial partly exclusive partly 35 36 37 38 2 1 2 3 55 29 29 73 university or medical center commercial commercial non-profit organization exclusive partly exclusive exclusive 39 40 41 42 43 44 45 46 No No No Yes (Expired) No No No No No No Yes No medical facts medical facts medical facts medical facts medical facts medical facts medical facts medical facts medical facts clinical trials medical facts medical facts medical facts medical facts medical facts medical facts question and answer medical facts medical facts human interest stories medical facts clinical trials clinical trials medical facts 1 2 2 1 1 1 4 4 56 37 27 47 57 51 63 39 non-profit organization commercial commercial non-profit organization commercial commercial commercial university or medical center exclusive exclusive partly exclusive exclusive exclusive exclusive exclusive 47 48 No 3 49 commercial exclusive 49 No 0 28 commercial partly No Website link Excluded from study Curr Urol 2019;13:200–208 http://www.medicalnewstoday.com/articles/150086.php https://en.wikipedia.org/wiki/Prostate_cancer http://www.medicinenet.com/prostate_cancer/article.htm http://www.webmd.com/prostate-cancer/default.htm https://www.cancer.org/cancer/prostate-cancer.html https://www.pcf.org/c/prostate-cancer-symptoms/ https://www.cancerresearchuk.org/about-cancer/prostate-cancer http://about-cancer.cancerresearchuk.org/about-cancer/prostate-cancer/symptoms Duplicate link http://www.prostate.org.au/awareness/general-information/what-you-need-to-knowabout-prostate-cancer/ https://www.cancer.gov/types/prostate https://seer.cancer.gov/statfacts/html/prost.html Duplicate link https://prostatecanceruk.org/prostate-information/about-prostate-cancer http://emedicine.medscape.com/article/1967731-overview http://www.mayoclinic.org/diseases-conditions/prostate-cancer/basics/definition/con20029597 http://www.nhs.uk/Conditions/Cancer-of-the-prostate/Pages/Introduction.aspx http://www.cancer.net/cancer-types/prostate-cancer http://www.health24.com/medical/prostate http://www.urologyhealth.org/urologic-conditions/prostate-cancer http://www.express.co.uk/life-style/health/778884/prostate-cancer-symptoms-seven-signs http://www.prostatecancerfoundation.co.za/cake/index.php/ http://www.healthline.com/health/prostate-cancer https://patient.info/health/prostate-cancer-leaflet https://www.cdc.gov/cancer/prostate/index.htm https://www.sciencedaily.com/news/health_medicine/prostate_cancer/ https://ghr.nlm.nih.gov/condition/prostate-cancer https://nihseniorhealth.gov/prostatecancer/prostatecancerdefined/01.html https://medlineplus.gov/prostatecancer.html https://www.nccn.org/patients/guidelines/prostate/ http://www.cancercenter.com/prostate-cancer/ http://www.nature.com/pcan/index.html http://www.prostatecancer.ca/ http://www.cansa.org.za/mens-health/ https://www.ucsfhealth.org/conditions/prostate_cancer/ http://www.rd.com/health/conditions/prevent-prostate-cancer/ Moolla/Adam/Perera/Lawrentschuk https://my.clevelandclinic.org/health/articles/prostate-cancer-basics http://www.onclive.com/specialty/prostate-cancer http://www.renalandurologynews.com/prostate-cancer/section/618/ http://www.cancer.ca/en/cancer-information/cancer-type/prostate/prostate-cancer/?region=on medical facts https://zerocancer.org/ http://www.bbc.com/news/health-40131381 clinical trials http://www.cancertherapyadvisor.com/prostate-cancer/section/4402/ clinical trials medical facts http://www.macmillan.org.uk/information-and-support/prostate-cancer medical facts https://www.radiologyinfo.org/en/info.cfm?pg=pros_cancer medical facts https://uk.movember.com/mens-health/prostate-cancer medical facts https://labtestsonline.org/understanding/conditions/prostate/ http://www.auanet.org/guidelines/early-detection-of-prostate-cancer-(2013-reclinical trials viewed-and-validity-confirmed-2015) http://www.cancer.org.au/about-cancer/types-of-cancer/prostate-cancer.html medical facts http://www.nydailynews.com/life-style/best-fight-prostate-cancer-understanding-article-1.3223985 human interest http://www.health.com/prostate-cancer stories Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 202 Table 1. Critical analysis of the first 100 hits, using the search term: ‘prostate cancer’, using the Google search engine (performed June 2017) Duplicate link ‘Prostate Cancer’ and the Internet: Fact or Fiction? Table 1. Critical analysis of the first 100 hits, using the search term: ‘prostate cancer’, using the Google search engine (performed June 2017) No HON code seal JAMA DISCERN score benchmark (16–80) 50 51 52 53 No No No No 1 1 2 3 54 55 56 57 No Curr Urol 2019;13:200–208 Categorization/ affiliation Website exclusive to PCa/partly exclusive Sub-type/ content 35 54 34 46 university or medical center university or medical center university or medical center commercial exclusive exclusive exclusive exclusive 3 33 non-profit organization exclusive No No 4 2 70 33 university or medical center commercial exclusive exclusive 58 59 60 61 62 63 64 No 2 62 university or medical center exclusive No No No No No 2 4 1 3 4 51 38 20 49 55 commercial university or medical center commercial commercial commercial exclusive exclusive exclusive exclusive exclusive 65 No 4 54 university or medical center exclusive 66 67 68 69 No 2 40 university or medical center exclusive No No 0 2 30 57 university or medical center government exclusive exclusive 70 71 72 No 4 56 commercial exclusive No 2 42 commercial exclusive 73 74 No No 4 2 45 31 non-profit organization commercial exclusive exclusive 75 No 2 47 commercial exclusive 76 No 3 36 commercial exclusive 77 78 Yes No 4 3 70 42 commercial commercial exclusive exclusive http://www.health.harvard.edu/topics/prostate-cancer https://siteman.wustl.edu/treatment/cancer-types/prostate/our-approach/ http://www.ferring.co.za/therapeutic-areas/urology/prostate-cancer https://www.theguardian.com/society/2017/jun/03/prostate-cancer-therapy-study-abiraterone medical facts https://radiopaedia.org/articles/prostatic-carcinoma-1 https://radiopaedia.org/articles/prostate-cancer-staging-1 medical facts http://uroweb.org/guideline/prostate-cancer/ human interest http://www.wral.com/expert-opinion-on-prostate-cancer-screening-shifts-to-more-testing-/16753079/ stories medical facts https://www.nice.org.uk/guidance/cg175 https://pathways.nice.org.uk/pathways/prostate-cancer medical facts http://www.medbroadcast.com/condition/getcondition/prostate-cancer https://www.omim.org/entry/176807 clinical trials http://www.naturalnews.com/prostate_cancer.html clinical trials medical facts https://www.statnews.com/2017/05/04/prostate-cancer-research-psa/ https://www.uspreventiveservicestaskforce.org/Page/Document/RecommendationStateclinical trials mentFinal/prostate-cancer-screening medical facts https://academic.oup.com/jcem/article/86/8/3467/2848333/The-Endocrinology-of-Prostate-Cancer medical facts https://clicks.co.za/health/conditions/article-view/prostate-cancer http://bestpractice.bmj.com/best-practice/monograph/254.html?g=w_bmj_bp medical facts http://www.odessaregionalmedicalcenter.com/services/prostate-cancer/ medical facts http://www.bccancer.bc.ca/health-professionals/professional-resources/cancer-management-guidelines/genitourinary/prostate medical facts https://www.uptodate.com/contents/screening-for-prostate-cancer http://hcamidwest.com/service/prostate-cancer http://www.dailymail.co.uk/health/article-4495464/Prostate-cancer-vaccine-provide-cureclinical trials study-finds.html https://elifesciences.org/articles/09207 clinical trials medical facts http://indianexpress.com/article/lifestyle/nanotech-based-test-can-predict-prostatecancer-risk-better-4698039/ human interest http://www.menshealth.com/health/winning-the-prostate-cancer-war stories https://news.utexas.edu/2017/06/06/starving-prostate-cancer-with-what-you-eat-for-dinclinical trials ner medical facts http://www.emedicinehealth.com/prostate_cancer/article_em.htm medical facts http://www.9news.com/news/buddy-check9-prostate-cancer/447172764 79 No 2 46 commercial exclusive medical facts 80 No 3 36 commercial exclusive medical facts 81 82 No No 4 2 62 68 commercial commercial exclusive exclusive medical facts medical facts 83 No 2 25 commercial partly No 2 35 commercial exclusive human interest http://www.stuff.co.nz/national/health/93558013/waikato-community-raises-25kfor-nz-prostate-cancer-foundation stories Book Review https://books.google.co.za/books?id=Bg6ZbqhhboUC&pg=PA1&lpg=PA1&dq=prostate+cancer&source=bl&ots=vjkirgXyZY&sig=zxPPXCEIJRU55bA9jqg08cLXYU8&hl=en&sa=X&ved=0ahUKEwjf6tud67XUAhXqAMAKHW9mCs44UBDoAQhLMAU#v=onepage&q=prostate%20cancer&f=false medical facts https://www.tuko.co.ke/243133-revealed-why-black-men-die-prostate-cancer-comparedwhites-find-details.html 84 85 Website link Excluded from study clinical trials medical facts medical facts clinical trials Duplicate link Duplicate link Dead Link Dead Link http://www.prevention.com/health/4-things-all-women-should-know-about-prostatecancer http://edition.cnn.com/2017/04/11/opinions/prostate-screening-change-brawley/index. html https://www.tri-kobe.org/nccn/guideline/urological/english/prostate.pdf http://www.onhealth.com/content/1/prostate_cancer 203 Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 medical facts medical facts university or medical center commercial 2 2 56 62 exclusive exclusive No No 100 medical facts commercial No 96 97 98 99 3 55 exclusive medical facts university or medical center No 95 1 57 exclusive medical facts university or medical center No 94 3 69 exclusive medical facts medical facts medical facts medical facts clinical trials exclusive exclusive exclusive exclusive exclusive university or medical center government non-profit organization commercial university or medical center 52 51 54 64 30 No Yes No Yes No 89 90 91 92 93 1 3 2 3 2 commercial Yes 88 3 40 exclusive medical facts https://healthiertalk.com/starve-prostate-cancer-cells-with-this-snack/ https://medicalxpress.com/news/2017-06-abiraterone-metastatic-prostate-cancer-growth. html http://www.news-medical.net/news/20170609/New-diagnosticc2a0test-uses-machine-learning-to-accurately-detect-aggressive-prostate-cancer.aspx https://www.mskcc.org/nomograms/prostate https://www.andrologyaustralia.org/prostate-problems/prostate-cancer-diagnosis/ https://www.cancer.ie/cancer-information/prostate-cancer#sthash.r6ZD147N.dpbs https://www.drugs.com/condition/prostate-cancer.html http://www0.sun.ac.za/vivus/vivus-2-may-2016/excellence/large-study-targets-prostatecancer-in-african-men.html http://healthcare.utah.edu/huntsmancancerinstitute/cancer-information/cancer-types-andtopics/prostate-cancer.php http://www.hopkinsmedicine.org/brady-urology-institute/specialties/conditions-and-treatments/prostate-cancer/ http://www.innerbody.com/diseases-conditions/prostate-cancer http://www.emedicinehealth.com/prostate_cancer/viewer-comments_em-101.htm Duplicate link http://www.prostatecancer-riskcalculator.com/assess-your-risk-of-prostate-cancer http://www.merckmanuals.com/home/kidney-and-urinary-tract-disorders/cancers-of-the-kidney-and-genitourinary-tract/prostate-cancer http://www.merckmanuals.com/home/kidney-and-urinary-tract-disorders/canDuplicate link cers-of-the-kidney-and-genitourinary-tract/prostate-cancer clinical trials clinical trials exclusive exclusive commercial commercial 3 3 No No 86 87 Excluded from study Website link Sub-type/ content Website exclusive to PCa/partly exclusive Categorization/ affiliation JAMA DISCERN score benchmark (16–80) HON code seal No Table 1. Critical analysis of the first 100 hits, using the search term: ‘prostate cancer’, using the Google search engine (performed June 2017) 39 43 Curr Urol 2019;13:200–208 Discussion Health information is one of the most sought after topics on the internet [12]. Access to internet worldwide has rapidly evolved since the advent of this information platMoolla/Adam/Perera/Lawrentschuk Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 204 site), leaving a total of 90 websites for further evaluation and critical appraisal. Majority (79/90) of the websites were exclusive to PCa in terms of content displayed. When assessing for the categories returned, more than half (n = 48, 53.33%) were commercial websites. A further 22 websites were affiliated to universities or medical centers and accounted for almost another quarter (24.44%). Eight government websites made up 8.89% of the websites, with the remaining 13.33% of websites being affiliated to non-profit organizations (n = 12). By far, the majority of websites (n = 67) contained medical information of a factual nature (74.4%), with clinical trials (n = 17) accounting for 18.89%. In terms of quality and validity of information, the HONcode seal was displayed on only 14.44% of websites (n = 14), while the remaining 85.56% of websites (n = 76) did not have any evidence of certification by the HON (fig. 1). JAMA benchmarks were only fully met by 16.67% of websites (n = 15). A further 25 websites (27.78%) achieved 3 out of 4 benchmarks. Most websites (n = 31, 34.4%) met 2/4 JAMA benchmarks and 15 (16.67%) of websites only achieved 1 JAMA benchmark and 4 (4.44%) did not achieve any benchmarks (fig. 2). Application and scoring utilizing the DISCERN criteria revealed 10/90 websites (11.11%) that achieved a ‘high’ score (≥ 65 points), with the highest score by any website being 76 (out of a potential maximum of 80). A moderate score (33–64 points) was obtained by 75.56% of websites (n = 68), and the remaining 12 websites (13.33%) achieved a low score (16–32) (fig. 3). The four overall best performing websites (Table 1. Link numbers 21, 77, 28, 38), either meeting criteria or coming close to having concurrent HON Positive; JAMA 4/4 &; DISCERN ≥ 65 points included two websites particularly (Link numbers 21 & 77), with HONcode seal positive, JAMA benchmarks 4/4 and more specifically have very high DISCERN scores (≥ 70 out of 80).” Amongst the websites with the poorest validation scores (table 1. Link numbers 9, 49, 68, 24, 62), 3 links have no JAMA benchmarks, no HONcode seal, and relatively low DISCERN score (16–32), while 2 other links have only 1 JAMA benchmark, no HONcode seal and a very low DISCERN score. Yes No Fig. 1. HONcode seal. 1 Benchmark 2 Benchmarks 3 Benchmarks 4 Benchmarks Fig. 2. JAMA Benchmarks. 11.11% 13.33% 75.56% 16-32 (Low) 33-64 (Moderate) ≥ 65 (High) Fig. 3. JAMA Benchmarks. form. According to the International Telecommunication Union Facts and Figures 2016 report, just under 3.5 billion (3.48 billion) individuals were estimated to be using ‘Prostate Cancer’ and the Internet: Fact or Fiction? Curr Urol 2019;13:200–208 205 Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 0 Benchmarks the internet worldwide. This figure has increased from 1.15 billion or 17.6% from the previous decade [13]. The Internet world stats online website quotes an impressive 3.79 billion internet users as at 31 March 2017, which at 49.7% just falls short of half of the global population. This represents a growth of 936% since the turn of the millennia in 2000 [14]. As a result of the rapid expansion of the internet, both in terms of users and to the volumes of information available online, it has become the single largest source of information worldwide [6]. Health information has also seen an exponential increase in accessibility online and has become an increasingly important source of health-related information for patients [7]. A recent study found that 75% of people who go online seek health information and also that 75% in a health crisis use the internet to aid in decision-making [15]. Steinberg et al. [16] reported that approximately 56% of PCa patients seek health information online. While, Valero-Aguilera et al. [17] found that only 11.2% of patients in the study population reported using the internet as a source of health information. This variation may be explained by discrepancies in terms of age, demographics, and other socio-economic factors. These variations in the findings of the select studies mentioned above, amongst many others [18–21], support the view that generalization cannot be made with regard to internet use for health information, as this is highly dependent on the particular study population assessed. Evaluation of YouTube videos found that YouTube is an inadequate source of PCa information for patients, in terms of information content and the presence of bias [16]. In another study that focused on determining what patients seek from an internet site, it was determined that the information given was unsatisfactory, from a patient’s perspective [22]. Patients would at times, be unable to acquire the critical information easily without being aided by their physician to the appropriate resources. The degree of coverage is highly variable and there is a deficiency in balance of evidence found on many sites [23]. However, a more recent study found an acceptable and ‘encouraging’ degree of quality and reliability of PCa information on the web using various quality tools (DISCERN; HONcode; JAMA benchmarks; the LIDA instrument; Automated Readability Index; and the Flesch-Kincaid readability tests). Although the limitations of this study was the isolated assessment of a select few popular websites which were amongst the ‘top 10’ hits on 3 of the most popular search engines [24]. Besides the internet, another related information source utilized by patients involve the use of Mobile Ap- 2017) of searches performed for urological malignancies on the Google platform (Y-axis units: Numbers represent search interest relative to the highest point on the chart for the given region and time. A value of 100 is the peak popularity for the term, and a value of 50 means that the term is half as popular). plications (Apps). This platform, like the internet in general, also requires more stringent validation and review to ascertain the reliability and quality of information sent out to patients with PCa [25]. When assessing for the patterns of search amongst all urological malignancies, PCa has been the commonest search term utilized (fig. 4) depicted by the Google Trends data [26], which shows that PCa searches were the most common since 2004 to present. In comparison to the other genitourinary cancers, PCa is searched for approximately 3 times more than bladder cancer, which is currently the second most popular amongst the urological tumors. Interest in testicular cancer (which from 2004 until 2006 was by far the second-most searched for on Google amongst the urological malignancies), has steadily declined over time and is now searched for at almost the same frequency as kidney cancer, which has almost always being the 4th most popular amongst the 4 cancers represented. After assessing the websites using the pre-defined tools (table 1), we have found that the information available on the internet is not entirely reliable and complete 206 Curr Urol 2019;13:200–208 in itself as an independent source for health information on PCa. Overall 3 websites performed very poorly, demonstrating no JAMA benchmarks, no HONcode seal, and relatively ‘low’ DISCERN score. On the other hand, 2 websites were HONcode seal positive, JAMA benchmarks 4/4 and had ‘high’ DISCERN scores (≥ 65). Although most information presented is fairly accurate, it often lacks critical detail on key aspects, which could have negative impact on patient decisions regarding their condition, outcome and their treatment choices. However, the information may serve as a guide to empower patients to gain a better understanding into the condition. In this internet-driven era, it is imperative that internet users validate information obtained with reliable sources. It also adds an extra dimension to the medical consultation in requiring doctors to assist patients in validating information obtained via the internet and guiding them towards the most reliable, reputable resources on the online domain. Most of the studies evaluated in the literature had found that patients who utilize the internet as a source of health information, find it to be an effective tool to Moolla/Adam/Perera/Lawrentschuk Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 Fig. 4. A screen shot (Google trend) of the trend over time (January 2004 to December Conclusion In the evaluation and critical assessment of PCa information on the internet, using three different quality evaluation tools, the overall quality was observed to be accurate, however majority of individual websites are generally unreliable in itself as a source of information for patients. Healthcare professionals and their patients need to be acquainted with this ‘quality vs. quantity’ discrepancy when sourcing PCa information on the internet. This discrepancy is becoming a more important variable in the everyday counselling of the modern day patient with PCa. Acknowledgement The authors are grateful to Mrs Anna Welman, Department of Surgery, Helen Joseph Hospital, University of Witwatersrand, Johannesburg, for her secretarial support in the drafting of this manuscript. References 1 World Cancer Research Fund International: Prostate cancer statistics. http://www.wcrf. org/int/cancer-facts-figures/data-specificcancers/prostate-cancer-statistics. Accessed 20 July 2017. 2 World Cancer Research Fund International: Worldwide Data. http://www.wcrf.org/int/ cancer-facts-figures/worldwide-data.Accessed 20 July 2017. 3 Ferlay J, Soerjomataram I, Dikshit R, Eser S, Mathers C, Rebelo M, Parkin DM, Forman D, Bray F: Cancer incidence and mortality worldwide: sources, methods and major patterns in GLOBOCAN 2012. Int J Cancer 2015;136:E359–386. 4 Ziebland S, Chapple A, Dumelow C, Evans J, Prinjha S, Rozmovits L: How the internet affects patients’ experience of cancer: a qualitative study. BMJ 2004;328:564. 5 Goldsmith J: How will the Internet change our health system? Health Aff (Millwood) 2000;19:148–156. 6 Fahy E, Hardikar R, Fox A, Mackay S: Quality of patient health information on the Internet: reviewing a complex and evolving landscape. Australas Med J 2014;7:24–28. ‘Prostate Cancer’ and the Internet: Fact or Fiction? 7 Berland GK, Elliott MN, Morales LS, Algazy JI, Kravitz RL, Broder MS, Kanouse DE, Muñoz JA, Puyol JA, Lara M, Watkins KE, Yang H, McGlynn EA: Health information on the Internet: accessibility, quality, and readability in English and Spanish. JAMA 2001;285:2612–2621. 8 Health on the Net (HON): Health on the Net Code of Conduct (HONcode). http://www. hon.ch/HONcode/. Accessed 20 July 2017. 9 Health on the Net. https://www.healthonnet. org/. Accessed 20 July 2017. 10 Silberg WM, Lundberg GD, Musacchio RA: Assessing, controlling, and assuring the quality of medical information on the Internet: Caveant lector et viewor – Let the reader and viewer beware. JAMA 1997;277:1244–1245. 11 Charnock D, Shepperd S, Needham G, Gann R: DISCERN: an instrument for judging the quality of written consumer health information on treatment choices. J Epidemiol Commun Health 1999;53:105–111. 12 McMullan M: Patients using the internet to obtain health information: how this affects the patient-health professional relationship. Patient Educ Couns 2006;63:24–28. 13 International Telecommunication Union: ICT Facts and Figures 2017. http://www.itu.int/ en/ITU-D/Statistics/Pages/facts/default.aspx. Accessed 20 July 2017. 14 Miniwatts Marketing Group: Internet World Stats – usage and population statistics. http:// www.internetworldstats.com/stats.htm. Accessed 20 July 2017. 15 Dickerson SS, Reinhart A, Boemhke M, Akhu-Zaheya L: Cancer as a problem to be solved: internet use and provider communication by men with cancer. Comput Inform Nurs 2011;29:388–395. 16 Steinberg PL, Wason S, Stern JM, Deters L, Kowal B, Seigne J: YouTube as source of prostate cancer information. Urology 2010; 75:619–622. 17 Valero-Aguilera B, Bermúdez-Tamayo C, García-Gutiérrez JF, Jiménez-Pernett J, Vázquez-Alonso F, Suárez-Charneco A, Guerrero-Tejada R, Cózar-Olmo JM: Factors related to use of the Internet as a source of health information by urological cancer patients. Support Care Cancer 2012;20:3087–3094. Curr Urol 2019;13:200–208 207 Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 supplement knowledge but not as a primary source of information [27–29]. One of the benefits of using multiple sources of health information is that patients are better able to equip themselves with the understanding of the nature of their illness and the various treatment modalities which may be available. By bringing this information to the consultation, it transforms the doctor-patient relationship and promotes patients to play a more active role in shared-decision making. The study was limited to the English language only. Secondly, the internet and search engines are dynamic processes that constantly change. Therefore, the websites assessed in this investigation may not necessarily reflect the information available to patients at another point in time. Another limitation of this review would be the exclusion of all other search engines utilized in today’s era, however for the purpose of this study, only ‘Google’ was utilized, since it is by far the commonest search engine used, with well over 3 billion searches daily [30]. 208 23 Black PC, Penson DF: Prostate cancer on the Internet – information or misinformation? J Urol 2006;175:1836–1842. 24 Borgmann H, Wölm JH, Vallo S, Mager R, Huber J, Breyer J, Salem J, Loeb S, Haferkamp A, Tsaur I: Prostate cancer on the Web – expedient tool for patients’ decisionmaking? J Cancer Educ 2017;32:135–140. 25 Adam A, Hellig JC, Perera M, Bolton D, Lawrentschuk N: ‘Prostate Cancer Risk Calculator’ mobile applications (Apps): a systematic review and scoring using the validated user version of the Mobile Application Rating Scale (uMARS). World J Urol 2018; 36:565–573. 26 Google Trends: https://trends.google.com/ trends/explore?date=all&q=Prostate%20 Cancer,Bladder%20Cancer,Kidney%20Cancer,Testicular%20Cancer. Accessed 20 December 2017. Curr Urol 2019;13:200–208 27 Schrijvers J, Vanderhaegen J, Van Poppel H, Haustermans K, Van Audenhove C: How do patients between the age of 65 and 75 use a web-based decision aid for treatment choice in localized prostate cancer? J Evid Based Med 2013;6:167–172. 28 Gilbert SM, Sanda MG, Dunn RL, Greenfield TK, Hembroff L, Klein E, Saigal CS, Pisters L, Michalski J, Sandler HM, Litwin MS, Wei JT: Satisfaction with information used to choose prostate cancer treatment. J Urol 2014;191:1265–1271. 29 Salonen A, Ryhänen AM, Leino-Kilpi H: Educational benefits of Internet and computer-based programmes for prostate cancer patients: a systematic review. Patient Educ Couns 2014;94:10–19. 30 Internet Live Stats: Google Search Statistics. http://www.internetlivestats.com/googlesearch-statistics/. Accessed 01 August 2018. Moolla/Adam/Perera/Lawrentschuk Downloaded from http://karger.com/cur/article-pdf/13/4/200/2544187/000499271.pdf by guest on 08 December 2023 18 Wallington SF: The Internet as an emerging patient education tool among African American men with prostate cancer: an exploratory study. Am J Mens Health 2008;2:106–121. 19 van de Poll-Franse LV, van Eenbergen MC: Internet use by cancer survivors: current use and future wishes. Support Care Cancer 2008;16:1189–1195. 20 Buntrock S, Hopfgarten T, Adolfsson J, Onelöv E, Steineck G: The Internet and prostate cancer patients searching for and finding information. Scand J Urol Nephrol 2007; 41:367–374. 21 Pautler SE, Tan JK, Dugas GR, Pus N, Ferri M, Hardie WR, Chin JL: Use of the internet for self-education by patients with prostate cancer. Urology 2001;57:230–233. 22 Rozmovits L, Ziebland S: What do patients with prostate or breast cancer want from an Internet site? A qualitative study of information needs. Patient Educ Couns 2004;53:57–64.