Mendoza Pulmonary
Mendoza Pulmonary
Mendoza Pulmonary
Universidad de Sevilla
Av. de los Descubrimientos s/n
41092 Sevilla, Spain
{csanchez1,bacha,cserrano}@us.es
1 Introduction
CT scans are frequently used for pulmonary disorder assessment [1]. Pathologies
that could affect sufficient lung function include tumors, pulmonary embolism,
atelectasis, pneumonia, emphysema, asthma, bronchiectasis, and many others.
Certain lung diseases can be diagnosed based on airway wall thickness mea-
surements, diameter, branching geometry and rate of tapering. CT is currently
the only readily accessible, relatively noninvasive technique that is capable of
providing airway tree quantitative structural data in vivo [2].
Traditionally, analysis of CT chest scans was performed manually by skilled
radiologist who recognized areas of abnormal airway properties in consecutive
slices of the examined scan. However, analyzing about 400 slices covering the
This work was supported by ”Fundación Reina Mercedes” from ”Hospital Univer-
sitario Virgen del Rocı́o” (Sevilla), and ”Consejerı́a de Salud de la Junta de An-
dalucı́a”. Carlos S. Mendoza was supported by a doctoral scholarship financed by
Universidad de Sevilla.
-286- EXACT'09
chest area is very tedious and too cumbersome for everyday clinical use. More-
over, manual analysis performed by the radiologist was only qualitative esti-
mation of airway abnormalities without accurate quantification of pathological
changes.
Even though airway tree abnormalities can be detected based on 2D slices,
the ability to extract a full 3D model of the airway tree from a 3D image has
several key advantages. For example, slice based measurements can be inaccurate
if the airway is not perpendicular to the slice. Also, information available from
the slices is deprived of useful context, making it harder for a radiologist to keep
track of the generation number of an airway, the structure of nearby airways or
the overall shape of a segment [3].
There has been a number of efforts to try to delineate the airway tree in chest
CT scans. Airway tree segmentation is a complex task, mainly due to inhomo-
geneous grey level of the voxels located inside the bronchial lumen, artefacts
caused by blood vessels adjacent to airway walls and changes of intensity levels
along airway walls.
Many airway segmentation methods use region-growing algorithms, which
attempt to separate air and soft tissue voxels using an HU (Hounsfield Unit)
threshold [4–8]. Region growing is fast and assumes no prior knowledge of the
shape or size of the airways. Choosing an appropriate global HU threshold is
difficult, however, as the lungs are filled with air and misclassifying a single wall
voxel can allow the segmentation to leak into the lung parenchyma.
Other methods make use of grey-level morphological operators [9–12], or
front wave propagation schemes [13–15], to impose structural properties derived
from a priori anatomical knowledge.
Region growing is the preferred method for initializing several of the afor-
mentioned algorithms, being a fast and intuitive technique [3,10,11]. Some recent
segmentation techniques perform region growing stages on images derived from
the intensity of the scan, like the morphological gradient [16], or the posterior
of a classification stage [17]. Thus, fully automatic region growing approaches
become mandatory, specially those that can provide as much information as
possible for the following algorithmic stage, with very low leakeage.
Few fully automatic region growing methods have proven successfull in these
tasks over a significant variety of imaging devices. One of the most common
techniques for threshold determination was proposed by Mori et al. [6]. Their
approach, widely known as explosion-controlled region growing, tries to deter-
mine optimal thresholds by detection of sudden volume increase in the segmented
region. The difficulty lies in defining how much volume increase is considered ex-
plosion, as compared to normal region growth. In our work, we also propose a
self-assessed region growing algorithm. Our assessment strategy is founded on a
previous normalization stage, and makes use of an iteratively computed contrast
measure. In our method there is no need to define any confidence margins, as
the segmented region is determined precisely by the evolution of the proposed
contrast measure.
EXACT'09 -287-
2 Method
2.1 Airway Lumen Intensity Model
Since our goal is providing a mechanism for airway segmentation with minimal
user intervention, we have established a model that takes into account their
intensity distribution in CT images.
We model then our object of interest as a connected region whose pixel in-
tensities are sampled from a Gaussian distribution with unknown mean and
standard deviation. We know that our region of interest is surrounded by other
tissues derived from other, sometimes adjacent, intensity distributions. Although
common in the literature, this assumption for the intensities is rarely met in
practice, in the sense that the intensity distributions of tissues are only ap-
proximately Gaussian, as can be inferred from direct observation of histograms.
Besides, partial overlap between adjacent distributions often occurs. For dealing
with these inconveniences we propose the use of an assessment function, that
-288- EXACT'09
Normalization and Denoising Since our method was conceived for images
from a wide range of scanners and acquisition protocols, we have developed a
normalizing stage that accounts for such variability. As we will introduce later
on, for the self-assessed region growing stage of the algorithm, we require the
input intensity dynamic range to be normalized with respect to some parameter
estimates of the objective intensity distribution.
In the following equations in which we describe the normalization process,
N is a cubic neighborhood of radius R around the seed, x is a voxel position,
f (x) is the intensity for voxel at x, f¯N is the mean intensity estimate in N and
|N | is the cardinality of N . Moreover, σfN is the estimated standard deviation
for intensities in N , K is a constant parameter, and f (x), f (x) are the input
and output intensities for the non-linear mapping described below.
1
f¯N = f (xk ) , (1)
|N |
xk ∈N
1 2
σfN = f (xk ) − f¯N , (2)
|N |
xk ∈N
⎛ ⎛ ⎞⎞−1
f (x) − ¯N
f
f (x) = ⎝1 + exp ⎝− Kσ ⎠⎠ . (3)
fN
3
4. Compute the assessment function Oi f¯ Ri , f¯ Pi using the intensity average
f¯ Ri in Ri and the intensity average f¯ Pi in the external perimeter Pi of Ri
according to (1) and the following eqs.:
Pi = {xci } ∩ Ri C , (5)
f¯ − f¯ Ri
Oi f¯ Ri , f¯ Pi = ¯ Pi (6)
f Pi + f¯ Ri
5. If Oi−1 was a local maximum, when compared to Oi−2 and Oi (only when
i ≥ 2), then the algorithm stops and the output is Ri−1 . Otherwise another
iteration takes place
Of all aforementioned parameters only k0 and Δk are critical for the performance
of the algorithm. k0 affects computational efficiency
requiring a greater number
of iterations before a local maximum of O f¯Ri , f¯Pi is actually found. There-
fore, its fine tuning for a specific scanner, could save some computational time.
From observation of the region growing sequence, we conclude that these first
iterations are typically very fast, so the improvement is frequently negligible.
In what concerns Δk, the choice must guarantee that the assessment function
is being sampled adequately in order to detect its local variations. Since the
estimates for the mean and standard deviation are continually updated as the
region grows, the estimates become increasingly close to the theoretical values.
We argue that setting Δk below one tenth of 3 (which is the theoretical value
multiplying the standard deviation of a Gaussian distribution for 99.7% of its
samples to be included in a range of that width around the mean) is enough for
the segmentation process to be able not to miss the available local maxima of
the assessment function. This claim is supported by our experimental results.
3 Results
We have implemented our algorithm using open source medical image processing
libraries, more precisely the Insight Toolkit [24] for algorithm development, and
-290- EXACT'09
the command line executable module infrastructure provided by 3DSlicer for fast
prototyping, calibration, evaluation, and manual segmentation on real images for
further validation [25]. The algorithm that we will validate, uses the following
parameter values: R = 2, K = 12, Γ = 1, k0 = 1 and Δk = 0.1. The values for
these parameters were determined from other non-thoracic CT images, and are
intended to suit any imaging conditions. No thoracic CT scans were use for the
tuning of these parameters, as the algorithm was initially conceived for general
purpose segmentation. The algorithm was implemented and executed in a 2 GHz
Intel Core 2 Duo Windows PC with 2 GB RAM, and the average running time
was 129 ± 27 s.
For generation of the presented airway segmentations, the initial region was
provided using three manually selected seeds along the upper trachea. The seg-
mentation process took between 1 and 2 minutes for each dataset, including the
reading/writing of the images.
The evaluation of this algorithm has taken place in comparison with other
14 algorithms using a set of 40 CT scans, with different acquisition parameters.
First 20 datasets were used for training (unnecessary in our approach), and
last 20 for testing. The produced segmentations were centrally evaluated by a
team of trained observers. The objective was to compare performance. For this
purpose, a ground truth was constructed from all available segmentations from
the different algorithms, and all results were subsequently evaluated with respect
to this ground truth.
Evaluation of each individual segmentation is performed in the following
steps:
1. Airway segments or branches were extracted from submitted airway tree
segmentations using a fast marching based algorithm [14].
2. Airway segments were evaluated visually on a set of extracted slices from
both a reoriented view and a reformatted view with straightened airway
centerlines.
3. Each segment was scored as ”correct” or ”wrong”, by at least two observers.
The criterion used is whether the extracted airway segment indeed belongs
to the airway tree; the exact airway shape and dimensions are not taken into
account.
The ground truth is then defined as the union of all valid airway segments from
all submitted segmentations.
The following measurements are computed and used for comparing the sub-
mitted results:
1. Branch count: The number of branches that were detected correctly. A
branch is considered detected as long as the length of the centerlines is
more than 1 mm.
2. Branch detected: The fraction of branches that were detected, with respect
to the branches present in the ground truth.
3. Tree length: The sum of the length of the centerlines of all correctly detected
branches.
EXACT'09 -291-
Table 1. Evaluation measures for the twenty cases in the test set.
4. Tree length detected: The fraction of tree length in the ground truth that
was detected correctly.
5. Leakage count: The number of unconnected groups of ”correct” regions that
were neighboring with a ”wrong” region. Indicates how easy/difficult it is to
manually separate leakages from the correctly detected branches.
6. Leakage volume: The volume of regions that were wrongly detected.
7. False positive rate: The fraction of the volume of regions that were detected
wrongly over the volume of all detected regions.
Trachea was excluded from the branch length and branch count related mea-
surements. For the leakage based measures, both trachea and main bronchi were
excluded. In Table 1 we provide all the computed experimental measures. We
also present 3D renderings for the 20 datasets used for validation, in Fig. 1. These
results prove that our algorithm is able to produce reasonably complete segmen-
-292- EXACT'09
tations, with very limited leakage. In most of the available test sets, the maximal
contrast condition has produced fully automatic segmentations which compare
fairly with those obtained using more sophisticated methods. The results were
obtained with the same parameters for all different acquisition varieties, in a
reduced time frame.
Our experimental results suggest that our modified region growing strategy,
when used as an initialization stage, might benefit many airway segmentation
algorithms currently available. Also, in those techniques which exploit region
growing approaches applied over images obtained through processing of the im-
age intensities, the use of our maximal-constrast stopping condition could be
useful for further automatization.
Our immediate future line of work will include further study of our novel
region-growing stopping criterion. We intend to develop an exhaustive compar-
ison between previously available explosion detection and our newer approach.
Further along the way, we would like to develop a hybrid method, using our
contrast-assessed region growing for initialization, and adding some refining
stages using morphological operations and surface interpolation. This will pro-
vide for further comparison between the different initialization strategies.
References
1. Sluimer, I., Schilham, A., Prokop, M., Ginneken, B.V.: Computer analysis of
computed tomography scans of the lung: A survey. IEEE Transactions on Medical
Imaging 25(4) (2006) 385–405
2. Coxson, H.O., Rogers, R.M.: Quantitative computed tomography of chronic ob-
structive pulmonary disease. Academic Radiology 12(11) (2005) 1457–1463
3. Szymczak, A., Vanderhyde, J.: Airway segmentation by topology-driven local
thresholding. In: Progress in Biomedical Optics and Imaging - Proceedings of
SPIE. Volume 6914. (2008)
4. Mori, K., Hasegawa, J.I., Suenaga, Y., Toriwaki, J.I.: Automated anatomical label-
ing of the bronchial branch and its application to the virtual bronchoscopy system.
IEEE Transactions on Medical Imaging 19(2) (2000) 103–114
5. Summers, R.M., Feng, D.H., Holland, S.M., Sneller, M.C., Shelhamer, J.H.: Virtual
bronchoscopy: Segmentation method for real-time display. Radiology 200(3) (1996)
857–862
6. Mori, K., Hasegawa, J., Toriwaki, J., Anno, H., Katada, K.: Recognition of
bronchus in three-dimensional X-ray CT images with application to virtualized
bronchoscopy system. Proceedings of the 13th International Conference on Pat-
tern Recognition 3 (1996) 528–532
7. Kiraly, A.P., Higgins, W.E., Hoffman, E.A., McLennan, G., Reinhardt, J.M.: 3D
human airway segmentation for virtual bronchoscopy. In: Proceedings of SPIE -
The International Society for Optical Engineering. Volume 4683. (2002) 16–29
-294- EXACT'09
8. Singh, H., Crawford, M., Curtin, J.P., Zwiggelaar, R.: Automated 3D segmentation
of the lung airway tree using gain-based region growing approach. MICCAI 2
(2004) 975–982
9. Fetita, C.I., Prteux, F., Beigelman-Aubry, C., Grenier, P.: Pulmonary airways: 3-D
reconstruction from multislice CT and clinical investigation. IEEE Transactions
on Medical Imaging 23(11) (2004) 1353–1364
10. Graham, M.W., Gibbs, J.D., Higgins, W.E.: Robust system for human airway-tree
segmentation. In: Progress in Biomedical Optics and Imaging - Proceedings of
SPIE. Volume 6914. (2008)
11. Sonka, M., Park, W., Huffman, E.A.: Rule-based detection of intrathoracic airway
trees. IEEE Transactions on Medical Imaging 15(3) (1996) 314–326
12. Aykac, D., Huffman, E.A., McLennan, G., Reinhardt, J.M.: Segmentation and
analysis of the human airway tree from three-dimensional X-ray CT images. IEEE
Transactions on Medical Imaging 22(8) (2003) 940–950
13. Tschirren, J., Huffman, E.A., McLennan, G., Sonka, M.: Intrathoracic airway trees:
Segmentation and airway morphology analysis from low-dose CT scans. IEEE
Transactions on Medical Imaging 24(12) (2005) 1529–1539
14. Schlathölter, T., Lorenz, C., Carlsen, I.C., Renisch, S., Deschamps, T.: Simultane-
ous segmentation and tree reconstruction of the airways for virtual bronchoscopy.
In: Proceedings of SPIE - The International Society for Optical Engineering. Vol-
ume 4684 I. (2002) 103–113
15. Ginneken, B.V., Baggerman, W., Rikxoort, E.M.V.: Robust segmentation and
anatomical labeling of the airway tree from thoracic CT scans. Lecture Notes in
Computer Science (including subseries Lecture Notes in Artificial Intelligence and
Lecture Notes in Bioinformatics) 5241 LNCS(PART 1) (2008) 219–226
16. Fabijanska, A.: Two-pass region growing algorithm for segmenting airway tree from
MDCT chest scans. Computerized Medical Imaging and Graphics (2009) Article
in Press.
17. Lo, P., Bruijne, M.D.: Voxel classification based airway tree segmentation. In:
Progress in Biomedical Optics and Imaging - Proceedings of SPIE. Volume 6914.
(2008)
18. Adams, R., Bischof, L.: Seeded region growing. IEEE Transactions on Pattern
Analysis and Machine Intelligence 16(6) (1994) 641–647
19. Hojjatoleslami, S.A., Kittler, J.: Region growing: A new approach. IEEE Trans-
actions on Image Processing 7(7) (1998) 1079–1084
20. Haralick, R.M., Shapiro, L.G.: Image segmentation techniques. Computer Vision,
Graphics, & Image Processing 29(1) (1985) 100–132
21. Revol-Muller, C., Peyrin, F., Carrillon, Y., Odet, C.: Automated 3D region growing
algorithm based on an assessment function. Pattern Recognition Letters 23(1-3)
(2002) 137–150
22. Hu, S., Hoffman, E.A., Reinhardt, J.M.: Automatic lung segmentation for accu-
rate quantitation of volumetric X-ray CT images. IEEE Transactions on Medical
Imaging 20(6) (2001) 490–498
23. Sluimer, I., Prokop, M., Ginneken, B.V.: Toward automated segmentation of the
pathological lung in CT. IEEE Transactions on Medical Imaging 24(8) (2005)
1025–1038
24. Yoo, T.S., Ackerman, M.J., Lorensen, W.E., Schroeder, W., Chalana, V., Aylward,
S., Metaxas, D., Whitaker, R.: Engineering and algorithm design for an image
processing API: a technical report on ITK–the Insight Toolkit. Studies in health
technology and informatics 85 (2002) 586–592
EXACT'09 -295-
25. Pieper, S., Lorensen, B., Schroeder, W., Kikinis, R.: The NA-MIC Kit: ITK, VTK,
pipelines, grids and 3D Slicer as an open platform for the medical image computing
community. In: 2006 3rd IEEE International Symposium on Biomedical Imaging:
From Nano to Macro - Proceedings. Volume 2006. (2006) 698–701