Structured Versus Narrative Reporting of Pelvic MRI in Perianal Fistulizing Disease: Impact On Clarity, Completeness, and Surgical Planning
Structured Versus Narrative Reporting of Pelvic MRI in Perianal Fistulizing Disease: Impact On Clarity, Completeness, and Surgical Planning
Structured Versus Narrative Reporting of Pelvic MRI in Perianal Fistulizing Disease: Impact On Clarity, Completeness, and Surgical Planning
https://doi.org/10.1007/s00261-018-1858-8 (0123456789().,-volV)(0123456789().,-volV)
PELVIS
Thomas E. Cataldo2 • Vitaliy Y. Poylin2 • Said Fettane Gómez1 • Atenea Morcillo Cabrera1 •
Tarek Hegazi1 • Kevin Beker1 • Koenraad J. Mortele1
Abstract
Objective To evaluate clarity, completeness, and impact on surgical planning of MRI reporting of perianal fistulizing
disease using a structured disease-specific template versus narrative reporting for planning of disease treatment by col-
orectal surgeons.
Materials and methods In this HIPAA-compliant, IRB-approved study with waiver of informed consent, a structured
reporting template for perianal fistulizing disease MRIs was developed based on collaboration between colorectal surgeons
and abdominal radiologists. The study population included 45 consecutive patients who underwent pelvic MRI for perianal
fistulizing disease prior to implementation of structured reporting, and 60 consecutive patients who underwent pelvic MRI
for perianal fistulizing disease after implementation of structured reporting. Objective evaluation of the reports for the
presence of 12 key features was performed, as also subjective evaluation regarding the clarity and completeness of reports,
and impact on surgical planning.
Results Significantly more key features were absent in narrative reports [mean: 6.3 ± 1.8 (range 3–11)] than in structured
reports [mean: 0.3 ± 0.9 (range 1–5)] (p B 0.001). The use of structured reporting also increased the percentage of
completeness (72.5–88.3% for surgeon 1, and 61.2–81.3% for surgeon 2; p = 0.05 and 0.03, respectively), helpfulness in
surgical planning (7.1 ± 1.5–7.6 ± 1.5 for surgeon 1, and 5.8 ± 1.4–7.1 ± 1.1 for surgeon 2; p = 0.05 and p \ 0.001,
respectively), and clarity (7.6 ± 1.3–8.3 ± 1.1 for surgeon 1, and 5.2 ± 1.4–7.1 ± 1.3 for surgeon 2; p = 0.006 and
p \ 0.001, respectively) of the reports.
Conclusion Structured MRI reports in patients with perianal fistulizing disease miss fewer key features than narrative
reports. Moreover, structured reports were described as more complete and clear, and more helpful for treatment planning.
Keywords Structured reporting Conventional reporting Perianal fistulizing disease Magnetic resonance imaging
Fistula treatment
2
Division of Colorectal Surgery/Department of Surgery, Beth
& Alejandro Garces-Descovich Israel Deaconess Medical Center, Harvard Medical School,
[email protected] 330 Brookline Avenue, Boston, MA 02115, USA
Ozum Tuncyurek
[email protected]
1
Division of Abdominal Imaging/Department of Radiology,
Beth Israel Deaconess Medical Center, Harvard Medical
School, 330 Brookline Avenue, Boston, MA 02115, USA
123
Abdominal Radiology
123
Abdominal Radiology
123
Abdominal Radiology
Statistical analysis and Dunn’s post hoc test were used to compare the three
reporting groups (NRBI, NRAI, and SRAI).
Student t test was used to compare the mean age and the Differences in responses of colorectal surgeons for NR
mean presence of key features in both cohorts (BI and AI). and SR groups were tested using Chi square for dichoto-
Analysis of presence of key features among the groups was mous answers and t test for Likert scale answers. Interob-
performed with Wilcoxon signed-rank test. Kruskal–Wallis server agreement was assessed using McNemar’s test for
123
Abdominal Radiology
Fig. 3 Key features of MRI MRI structured report key features and the rationale of including them in
structured report and the Figure 3.
perianal fistula evaluation template
rationale of including them in
perianal fistula evaluation Key feature Justification
Associated rectal and sigmoid colon To assess unresponsiveness to medical treatment for
inflammation inflammatory bowel disease (IBD)
Presence of setons, drainage catheters To assess rate of success of prior management
and features of prior surgeries
yes/no answers and paired samples t test for Likert scale Evaluation of structured reports [SR]
answers, and kappa values were calculated. A p value of versus narrative reports [NR]
less than 0.05 was considered statistically significant. All
statistical analyses were performed using SPSS version 25 Assessment of the number of fistulas/patient revealed that a
(IBM Corporation, US). single fistula was identified in 80% (n = 36) of the BI
group patients, and 75% (n = 45) in the AI group (p = 0.6).
In the BI group patients, multiple fistulas (2, 3 ,and 4) were
Results identified in 5 (11.1%), 3 (6.6%), and 1 (2.2%) of patients,
respectively. In the AI group, 2, 3, 4, and 5 fistulas were
Subjects noted in 5 (8.3%), 5 (8.3%), 4 (6.6%), and 1 (1.6%) of
cases, respectively (p [ 0.05) (Table 1).
The final study population consisted of 105 patients Regarding the presence or absence of the 12 key features
(Table 1). The BI group consisted of 45 patients: 31 males in both BI and AI groups, the following findings were
(68.8%) and 14 females (31.1%) with a median age of encountered (Table 2): (1) mentioning of the number of
43 years (IQ range 36–58.5 years). The AI group consisted fistulas was only present in 13 (28.8%) of the NRBI
of 60 patients: 29 males (48.3%) and 31 females (51.6%) reports, 0 (0%) of the NRAI reports and, 42 (98%) of SRAI
with a median age of 42.5 years (IQ range reports; (2) the internal opening location (quadrant and
30.2–54.8 years) (p value [ 0.05). A prior history of clock face) was present in 41 (91.1%) of the NRBI reports,
inflammatory bowel disease was found in 42.2% (n = 19) in 17 (100%) of the NRAI reports, and 42 (98%) of the
for the BI group, and 46.6% (n = 28) in the AI group SRAI reports; (3) reporting of the distance from the anal
(p value = 0.7). verge to the fistula opening was present in 25 (55.5%) of
the NRBI reports, in 9 (53%) of the NRAI reports and, 42
(98%) of the SRAI reports; (4) the relation of the fistula to
the internal sphincter was not mentioned in the NRBI
123
Abdominal Radiology
YES NO
YES NO
reports while in 1 (6%) NRAI report and 42 (98%) of the presence/absence of an abscess was mentioned in 35
SRAI reports, the opening was addressed; (5) the type of (77.7%) of the NRBI reports versus 16 (94%) of NRAI and
the fistula (intersphincteric, transphincteric, extrasphinc- 41 (95%) of SRAI reports; (11) absent/associated rectal or
teric, suprasphincteric, and superficial) was specified in 28 sigmoid wall inflammation was commented upon in 15
(62.2%) of the NRBI reports, while 13 (76.4%) of NRAI (33.3%) of NRBI reports versus 3 (18%) of NRAI reports
reports and 43 (100%) of the SRAI reports was specified; and, 37 (86%) of the SRAI; and finally, (12) absence/
(6) presence of secondary branches were mentioned in 16 presence of a seton, stitch, drain or sequela from prior
(35.5%) of the NRBI reports versus 3 (17.6%) of the NRAI surgery was mentioned in 13 (28.8%) of NRBI reports, 6
reports and, 43 (100%) of the SRAI reports; (7) the fistula (35.2%) of NRAI and, 42 (98%) of SRAI reports.
exit site (gluteal, scrotal, vaginal, labial, urethral or blind An average of 6.3 ± 1.8 (range 3–11) key features were
ending) was reported in 36 (80%) of the NRBI reports, in 6 absent in NRBI reports (n = 45) and only 0.3 ± 0.9 (range
(35.2%) of the NRAI reports and, in 43 (100%) of the 1–5) in the SRAI group reports (n = 43) (p B 0.001). For
SRAI; (8) hyperintensity of the tract on T2-weighted completeness, an average of 7.1 ± 1.0 (range 5–9) key
images was reported in 9 (20%) of the NRBI reports while features were absent in the NRAI group reports (n = 17)
in 2 (12%) of the NRAI reports and, 43 (100) of the SRAI (p B 0.001). Statistical comparison analysis of the three
was mentioned; (9) assessment of contrast enhancement of groups by the MRI template as well as the subjective
the tract was done in 19 (42.2%) of NRBI reports, 6 assessment (colorectal surgeons) is depicted in Table 3.
(35.2%), and, in 43 (100%) of the SRAI reports; (10) the
123
Abdominal Radiology
Table 1 Demographics, clinical presentation, imaging features and fistula number distribution among patients with perianal fistula
Variable All patients (N = 105) Before implementation (n = 45) After implementation (n = 60) p value
Subjectively, 105 reports were evaluated by two sur- More importantly, however, when comparing the NR
geons who were asked to rate them using a Likert scale and group (n = 62) with the SR group (n = 43), the SR group
yes/no questions for completeness, helpfulness, and clarity reports significantly increased the percentage of com-
(Table 3). Overall, the AI group reports increased the pleteness (72.5–88.3% for surgeon 1, and 61.2–81.3% for
percentage of completeness (73.3–83.3% for surgeon 1, surgeon 2; p = 0.05 and 0.03, respectively), helpfulness in
and 57.8–78.3% for surgeon 2; p = 0.2 and 0.02, respec- surgical planning (7.1 ± 1.5–7.6 ± 1.5 for surgeon 1, and
tively), helpfulness in surgical planning 5.8 ± 1.4–7.1 ± 1.1 for surgeon 2; p = 0.05 and
(7.2 ± 1.5–7.3 ± 1.5 for surgeon 1, and p \ 0.001, respectively), and clarity (7.6 ± 1.3–8.3 ± 1.1
5.8 ± 1.3–6.8 ± 1.4 for surgeon 2; p = 0.84 and for surgeon 1, and 5.2 ± 1.4–7.1 ± 1.3 for surgeon 2;
p \ 0.001, respectively), and clarity (7.7 ± 1.3–8.0 ± 1.3 p = 0.006 and p \ 0.001, respectively) of the reports. The
for surgeon 1, and 5.1 ± 1.2–6.7 ± 1.5 for surgeon 2; interobserver agreement (kappa) between two surgeons NR
p = 0.33 and p \ 0.001, respectively) of the reports. and SR groups are presented in Table 4.
123
Abdominal Radiology
SURGEON # 1
Completeness 0.146 – –
Need for re-review images 0.432 – –
Helpfulness 0.316 0.716 0.039
Clarity 0.295 0.175 0.007
SURGEON # 2
Completeness 0.057 – –
Need for re-review images 0.294 – –
Helpfulness 0.99 \ 0.001 0.005
Clarity 0.747 \ 0.001 0.004
NRBI narrative report before implementation, NRAI narrative report after implementation, NRBI narrative
report before implementation, SRAI structured report after implementation, Sx surgical
*Seton placement, drainage placement or prior surgery
123
Abdominal Radiology
S1 surgeon 1, S2 surgeon 2
a
Graded on a 0–1 scale (0 = no, 1 = yes)
b
Graded on a 0–1 scale (0 = no, 1 = yes)
c
Graded on a scale of 0–10 (0 = not helpful, 10 = very helpful)
d
Graded on a scale of 0–10 (0 = unclear, 10 = very clear)
of the radiologist. In this type of bias, at some point of the may not be transferable to the surgical community at large.
report, the radiologist concludes that all relevant informa- However, one would assume that less experience would
tion has been communicated and fails to mention additional even benefit more from structured reporting. Thirdly, since
abnormal findings [23]. In our study, there was a statisti- we did not mandate the use of the SR after implementation,
cally different discrepancy between the two groups for the the adherence to it was only 70%. It is possible that radi-
inclusion of 10 out of 12 key features defining perianal ologists were ‘‘educated’’ on relevant points but still chose
fistulizing disease. Only for 2/12 key features, the location not to use the SR and were mentioning ‘‘more relevant’’
of the internal fistula opening and the location of the exit key features in the AI group. This highlights the need for
site, the two groups performed equally, most likely as both education on top of the report standardization. One could
features are among the most imperative in the description hypothesize that a higher adherence rate would even
of a perianal fistula. improve the results further. Finally, no comparison was
In addition, colorectal surgeons, when assessing the made between the findings in the original MRI reports and
reports subjectively, found that SR reports to be more the accuracy of the reported findings. However, the point of
complete, more helpful, and clearer than NR reports. In our the study was solely to assess the report content and clarity,
study, both surgeon 1 (highly experienced) and surgeon 2 as well as the colorectal surgeons’ satisfaction with the
(moderately experienced) found SR more clear, more report, and its impact on clinical decision making—not the
helpful, and more complete than narrative reports in ability of radiologists to predict correct perianal fistulizing
determining the treatment plan. This finding differs from disease diagnosis.
the results of Franconeri et al. [20] who found that, when In conclusion, structured MRI reports in patients with
assessing fibroids mapping before surgery, the highly perianal fistulizing disease miss fewer key features than
experienced surgeons did not significantly benefit from SR. narrative reports. Moreover, structured reports were
In contrast, when assessing pancreatic cancer staging CT described as more complete and clear, and more helpful for
reports, less-experienced surgeons did not find SR benefi- treatment planning. This potentially contributes to better
cial [18]. Of note, no significant change was seen in both surgical planning and patient outcomes.
surgeons’ opinions regarding the need to review the images
after reading the report, for both groups.
Our study has several limitations. First, although the
reports were presented anonymously, the retrospective References
design may have included inherent recall bias for the sur-
1. Bink A, Benner J, Reinhardt J, et al. Structured reporting in
geons. Secondly, only two expert surgeons in a tertiary care neuroradiology: Intracranial tumors. Front Neurol 2018; 32:1–10
center were included in the study, and therefore the results
123
Abdominal Radiology
2. Ganeshan D, Duong PAT, Probyn L, et al. Structured reporting in 14. Sharma G, Khandige G, Mohan M. Magnetic resonance imaging
radiology. Acad Radiol 2018; 25:66–73 in perianal fistulas-a pictorial atlas. Indian J Gastroenterol 2016;
3. de Miguel Criado J, del Salto LG, Rivas PF, et al. MR imaging 35:337–342
evaluation of perianal fistulas: spectrum of imaging features. 15. Parks AG, Gordon PH, Hardcastle JD. A classification of fistula-
Radiographics 2012; 32:175–194 in-ano. Br J Surg 1976; 63:1–12
4. Abcarian H, Anal fistula principles and management, 1st ed. New 16. Van Assche G, Vanbeckevoort D, Bielen D, et al. Magnetic
York, NY: Springer, 2014:1–3 resonance imaging of the effects of infliximab on perianal fis-
5. Hamadani A, Haigh PI, Liu IA, Abbas MA. Who is at risk for tulizing Crohn’s disease. Am J Gastroenterol 2003: 98:332–339
developing chronic anal fistula or recurrent anal sepsis after ini- 17. Tutein Nolthenius CJ, Bipat S, Mearadji B, et al. MRI charac-
tial perianal abscess? Dis Colon Rectum 2009; 52:217–221 teristics of proctitis in Crohn’s disease on perianal MRI. Abdom
6. O’Malley RB, Al-Hawary MM, Kaza RK, Wasnik AP, Liu PS, Radiol 2016; 41:1918–1930
Hussain HK. Rectal imaging: part 2, perianal fistula evaluation on 18. Brook OR, Brook A, Vollmer CM, Kent TS, Sanchez N, Pedrosa
pelvic MRI - what the radiologist needs to know. AJR 2012; I. Structured reporting of multiphasic CT for pancreatic cancer:
199:43–53 potential effect on staging and surgical planning. Radiology
7. Gecse K, Khanna R, Stoker J, et al. Fistulizing crohn’s disease: 2015; 274:464–472
diagnosis and management. United Eur Gastroenterol J 2013; 19. Nörenberg D, Sommer WH, Thasler W, et al. Structured report-
1:206–213 ing of rectal magnetic resonance imaging in suspected primary
8. Beaugerie L, Carrat F, Nahon S, et al. High risk of anal and rectal rectal cancer: potential benefits for surgical planning and inter-
cancer in patients with anal and/or perianal Crohn’s disease. Clin disciplinary communication. Invest Radiol 2017; 52:232–239
Gastroenterol Hepatol 2018; 16:892–899 20. Franconeri A, Fang J, Carney B, et al. Structured vs narrative
9. Protyniak B, Shutt T, Farmer R. Squamous cell carcinoma orig- reporting of pelvic MRI for fibroids: clarity and impact on
inating from a Crohn’s enterocutaneous fistula. Case Rep Surg treatment planning. Eur Radiol 2017; 28:3009–3017
2017; 2017:1–4 21. Gassenmaier S, Armbruster M, Haasters F, et al. Structured
10. Ong EM, Ghazi LJ, Schwartz DA, Mortelé KJ. Guidelines for reporting of MRI of the shoulder – improvement of report qual-
imaging of Crohn’s perianal fistulizing disease. Inflamm Bowel ity? Eur Radiol 2017; 27:4110–4119
Dis 2015; 21:731–736 22. Zimmerman SL, Kim W, Boonn WW. Informatics in radiology:
11. Sahni VA, Ahmad R, Burling D. Which method is best for automated structured reporting o imaging findings using at AIM
imaging of perianal fistula? Abdom Imaging 2008; 33:26–30 standard and XML. Radiographics 2011; 31:881–887
12. Kim MJ. Transrectal ultrasonography of anorectal diseases: 23. Brady AP. Error and discrepancy in radiology: inevitable or
advantages and disadvantages. Ultrasonography 2015; 34:19-31 avoidable? Insights Imaging 2017; 8:171–182
13. Burdan F, Sudol-Szopinska I, Staroslawska E, et al. Magnetic
resonance imaging and endorectal ultrasound for diagnosis of
rectal lesions. Eur J Med Res 2015; 20:1–14
123