Designation: E 1695 – 95 (Reapproved 2001) An American National Standard

Standard Test Method for

Measurement of Computed Tomography (CT) System
Performance1
This standard is issued under the fixed designation E 1695; the number immediately following the designation indicates the year of
original adoption or, in the case of revision, the year of last revision. A number in parentheses indicates the year of last reapproval. A
superscript epsilon (e) indicates an editorial change since the last revision or reapproval.

1. Scope E 1570 Practice for Computed Tomographic (CT) Exami-

1.1 This test method provides instruction for determining nation3
the spatial resolution and contrast sensitivity in X-ray and
3. Terminology
g-ray computed tomography (CT) images. The determination
is based on examination of the CT image of a uniform disk of 3.1 Definitions—The definitions of terms relating to
material. The spatial resolution measurement is derived from Gamma- and X-Radiology, which appear in Terminology
an image analysis of the sharpness at the edge of the disk. The E 1316 and Guide E 1441, shall apply to the terms used in this
contrast sensitivity measurement is derived from an image test method.
analysis of the statistical noise at the center of the disk. 3.2 Definitions of Terms Specific to This Standard:
1.2 This test method is more quantitative and less suscep- 3.2.1 phantom—a part or item being used to quantify CT
tible to interpretation than alternative approaches because the system performance.
required disk is easy to fabricate and the analysis is immune to 3.2.2 examination object—a part or specimen being sub-
cupping artifacts. This test method may not yield meaningful jected to CT examination.
results if the disk image occupies less than a significant fraction 3.3 Acronyms:Acronyms:
of the field of view. 3.3.1 ERF—edge response function.
1.3 This test method may also be used to evaluate other 3.3.2 PSF—point spread function.
performance parameters. Among those characteristics of a CT 3.3.3 MTF—modulation transfer function.
system that are detectable with this test method are: the 3.3.4 CDF—contrast discrimination function.
mid-frequency enhancement of the reconstruction kernel, the 4. Significance and Use
presence (or absence) of detector crosstalk, the undersampling
of views, and the clipping of unphysical (that is, negative) CT 4.1 Two factors affecting the quality of a CT image are
numbers (see Air Force Technical Report WL-TR-94-40212). It geometrical unsharpness and random noise. Geometrical un-
is highly likely that other characteristics as well can be detected sharpness limits the spatial resolution of a CT system, that is,
with this test method. its ability to image fine structural detail in an object. Random
1.4 The values stated in SI units are to be regarded as the noise limits the contrast sensitivity of a CT system, that is, its
standard. Inch-pound units are provided for information only. ability to detect the presence or absence of features in an
1.5 This standard does not purport to address all of the object. Spatial resolution and contrast sensitivity may be
safety concerns, if any, associated with its use. It is the measured in various ways. ASTM specifies spatial resolution
responsibility of the user of this standard to establish appro- be quantified in terms of the modulation transfer function
priate safety and health practices and determine the applica- (MTF) and contrast sensitivity be quantified in terms of the
bility of regulatory limitations prior to use. contrast discrimination function (CDF) (see Guide E 1441 and
Practice E 1570). This test method allows the purchaser or the
2. Referenced Documents provider of CT systems or services, or both, to measure and
2.1 ASTM Standards: specify spatial resolution and contrast sensitivity.
E 1316 Terminology for Nondestructive Examinations3 5. Apparatus
E 1441 Guide for Computed Tomography (CT) Imaging3
5.1 Disk Phantom—The disk phantom shall be a right
1
cylinder of uniform material conforming to the design and
This test method is under the jurisdiction of ASTM Committee E07 on
material requirements in Table 1 and Fig. 1. Since spatial
Nondestructive Testing and is the direct responsibility of Subcommittee E07.01 on
Radiology (X and Gamma) Method. resolution and contrast sensitivity depend on the examination
Current edition approved March 15, 1995. Published May 1995. task (that is, the examination object and the specified CT
2
X-Ray Computed Tomography Standards (WL-TR-94-4021). Bossi, R. H. and parameters), the application requirements must be fixed before
Nelson, J. M. Air Force Contract No. F33615-88-C-5404.
3
Annual Book of ASTM Standards, Vol 03.03.
the phantom can be designed. In general, each examination

Copyright © ASTM, 100 Barr Harbor Drive, West Conshohocken, PA 19428-2959, United States.

1
COPYRIGHT American Society for Testing and Materials
Licensed by Information Handling Services
 E 1695
TABLE 1 Disk Phantom Design Requirements

Material The material, in conjunction with the diameter of the disk,

shall be such that the phantom approximates the
attenuation range of the examination object. The material
should preferably be the same as that of the examination
object.
Diameter The diameter shall be such that the reconstruction of the disk
occupies a significant fraction of the resulting image. In
conjunction with the material, the diameter shall be such
that the phantom approximates the attenuation range of the
examination object.
Thickness The thickness of the disk shall be greater than the slice
thickness used to inspect the examination object.
Shape The perpendicularity of the axis of revolution with respect to
the surface used to mount the phantom on the CT system
shall not compromise the measurement of geometrical
unsharpness.
Finish The surface texture roughness of the curved surface shall not
compromise the measurement of geometrical unsharpness.

If possible, the phantom should be of the same material as the

examination object, but the other requirements take precedence
and may dictate the selection of another material. The design of
the disk phantom is a matter of agreement between the
purchaser and the supplier.
6. Procedure
6.1 The phantom shall be mounted on the CT system with
the orientation of the axis of revolution of the disk normal to
the scan plane. The alignment shall not compromise the
measurement of geometrical unsharpness. Unless otherwise
agreed upon between purchaser and supplier, the phantom shall
be placed at the center of the field of view used for the
examination object.
6.2 Unless otherwise agreed upon between purchaser and
supplier, the data acquisition parameters shall be identical to
those used for examination object scans. The slice plane shall
intercept the phantom approximately midway between the flat
faces of the disk.
6.3 Unless otherwise agreed upon between purchaser and
supplier, the reconstruction parameters shall be identical to
those used for examination object reconstructions.
6.4 Unless otherwise agreed upon between purchaser and
FIG. 1 Disk Phantom supplier, the display parameters shall be identical to those used
for examination object display. It shall be verified by exami-
nation that the disk image occupies an image at least two-thirds
task will require a separate phantom. The diameter of the disk
of the image matrix. Recommended guidelines are given in
relative to the field of view shall be such that the reconstructed
Table 2.
image of the disk occupies a significant fraction of the image
matrix. Recommended sizes are given in Table 2. The diameter 7. Interpretation of Results
and opacity of the disk shall be such that the phantom 7.1 Spatial Resolution—From the CT image data, generate
approximates the attenuation range of the examination object. the composite profile of the edge of the disk to obtain the edge
response function (ERF). Calculate the derivative of the ERF
TABLE 2 Suggested Measurement Parameters to obtain the point spread function (PSF). Calculate the
amplitude of the Fourier Transform4 of the PSF and normalize
Image Matrix Disk Image Maximum Tile ERF Bin Number the results to unity at zero frequency to obtain the modulation
Size Diameter Size Size of Fit
(Pixels) (Pixels) (Pixels) (Pixels) Points transfer function (MTF).
7.1.1 Unless otherwise agreed upon between the purchaser
256 235 12 0.100 11
512 470 24 0.050 21
4
1024 940 48 0.025 41 The Fourier Transform and Its Applications, Ronald M. Bracewell, McGraw-
Hill, NY, ISBN 0-07-007013-X.

2
COPYRIGHT American Society for Testing and Materials
Licensed by Information Handling Services
 E 1695
and supplier, the ERF shall be generated as follows: maximum of the latter quantitatively indicated.
7.1.1.1 Calculate the center of mass of the disk. 7.2 Contrast Sensitivity—From the CT image data, generate
7.1.1.2 Select the inner and outer radii with respect to the a sequence of tile patterns which fit within the central region of
center of mass that comfortably bracket the edge. the disk. For each pattern, calculate the mean CT value within
7.1.1.3 Compute the distance to the center of mass for all each tile and store the result in a table specific to that pattern.
pixels between the inner and outer radii. For each table of results, calculate the standard deviation to
7.1.1.4 Generate a table of pixel values in order of their obtain the standard error in the mean and store the result in a
pixel distance from the center of mass. separate table in order of ascending tile size. Express each
7.1.1.5 Segregate the values into equal bins sized to a small standard error in the mean as a percent of its respective
fraction of one pixel. The bin size should be as small as ensemble average and multiply by a factor of 3 to obtain the
practical without causing some bins to be empty. Recom- contrast discrimination function (CDF).
mended sizes are given in Table 2. 7.2.1 Unless otherwise agreed upon between the purchaser
7.1.1.6 Average the members of each bin to obtain a table of and supplier, the sequence of tile patterns shall be generated as
values at constant increments from the inner to outer radius. follows:
7.1.1.7 Starting at one end of the table and iterating until the 7.2.1.1 Select a circular region of interest at the center of the
entire table has been processed, smooth the pixel values by disk. The diameter of the region should be large enough to
performing a piece-wise, least-squares cubic fit to an odd encompass a statistically significant number of tiles but not so
number of table values and replacing the center value with that large that the single-pixel noise or cupping, or both, (if present)
predicted by the fit. The number of values to include in the fit changes appreciably over the selected region. (The two influ-
should be large compared to the order of the polynomial and ences act in opposite directions: statistical noise decreases with
small compared to the fine ERF structure. Recommended increasing radius and will lower the standard error in the mean
guidelines for the number of values to use in the fit are given if too large a radius is chosen; whereas, cupping increases with
in Table 2. increasing radius and will increase the standard error in the
7.1.1.8 Determine how much of the table to include in the mean if too large a radius is chosen.) As a rule of thumb, these
analysis and delete the unwanted portions of the leading and conditions will be satisfied when the diameter of the central
trailing tails to obtain the ERF. region is about one-third that of the disk. For each new
7.1.2 Unless otherwise agreed upon between the purchaser application, it is recommended that the validity of these
and supplier, the PSF shall be generated as follows: requirements be verified empirically by monitoring the behav-
7.1.2.1 Starting at one end of the table and iterating until the ior of the CDF as the size of the region of interest is increased
entire table has been processed, perform a piece-wise, least- (see 7.2.3).
squares cubic fit to the ERF using for the fit the same number 7.2.1.2 For tiles ranging in size from a single pixel to n2
of values as were used to smooth the data (see 7.1.1). pixels, generate a sequence of patterns that tessellate the
7.1.2.2 For each fit, calculate the analytical derivative of the selected central region of the disk with a checkerboard of
resultant polynomial and determine its numerical value at the non-overlapping squares (see Fig. 2). (For the special case of
center of the piece-wise window. single-pixel tiles, the requirement for non-overlapping tiles is
7.1.2.3 Generate a table of derivative values as a function of satisfied trivially.) Terminate the sequence of patterns when the
distance from the center of the disk. size of the tiles becomes too large to obtain a statistically
7.1.2.4 Normalize the peak value of the resulting curve to significant number of tiles. It is recommended that the mini-
unity to obtain the PSF. mum number of tiles be on the order of 25. See Table 2 for
7.1.3 Unless otherwise agreed upon between the purchaser suggested maximum tile sizes.
and supplier, the MTF shall be generated as follows: 7.2.2 Unless otherwise agreed upon between the purchaser
7.1.3.1 Calculate the Fourier Transform4 of the PSF. The and supplier, the CDF shall be generated as follows:
maximum frequency of the resultant transform should be at 7.2.2.1 Starting with the finest pattern of tiles and iterating
least four times the cut-off frequency of the matrix, which by until the entire sequence of patterns has been exhausted,
definition is 0.5 line-pairs per pixel. The sampling frequency in calculate the mean value of the CT numbers within each tile
the Fourier domain should be small enough that the transform and store the results in a table unique to each pattern. (For the
is smooth within the frequency range of interest. A sampling special case of the single-pixel tiles, the calculation of means is
frequency of 0.01, or smaller, is recommended. trivial.)
7.1.3.2 Calculate the magnitude of the transform by taking 7.2.2.2 For each table of results, calculate the standard
the square root of the product of the transform and its deviation of the ensemble of measurements to obtain the
conjugate. standard error in the mean. (For the special case of the
7.1.3.3 Normalize the magnitude at zero frequency to unity single-pixel tiles, the standard error in the mean is equal to the
to obtain the MTF. standard deviation.)
7.1.4 Unless otherwise agreed upon between the purchaser 7.2.2.3 Generate a table of the standard error in the mean as
and supplier, the MTF shall be visually displayed or plotted, or a function of increasing tile size, where the size of a tile is
both, and the frequency at 10 % modulation quantitatively defined as the lineal dimension of its edge. Units of either
indicated. Although not mandatory, the ERF and the PSF pixels or length may be used, though pixels are usually easier
should also be graphically presented, with the full width at half to interpret and more convenient to apply.

3
COPYRIGHT American Society for Testing and Materials
Licensed by Information Handling Services
 E 1695

FIG. 2 Typical Tile Pattern

7.2.2.4 Express each standard error in the mean as a sensitivity determination should include all relevant data ac-
percentage of the average of its respective ensemble. Multiply quisition, reconstruction, and display parameters (see Practice
each result by 3 to obtain the CDF. (For a false-negative rate of E 1570). The specific parameters to be documented is a matter
50 % (that is, for the case of threshold detectability), this of agreement between the purchaser and the supplier. The
corresponds to a false-positive rate of 0.135 %. To select a report shall contain at a minimum graphical presentations of
different false-negative or false-positive rate, or both, refer to the modulation transfer function and the contrast discrimina-
Practice E 1570.) tion function.
7.2.3 For each new application, verify that the requirements
stipulated in 7.2.1.1 are satisfied by repeating the determination 9. Precision and Bias
of the CDF for other sized regions. For a tile size one-third
maximum, the CDF value will typically remain fairly constant 9.1 Conformance to the requirements specified herein will
over a range of radii from 10 % of the disk diameter to some produce results that are within the following tolerances:
critical radius on the order of 30 to 40 % of the disk diameter. 9.1.1 Precision—The measured spatial resolution and con-
As the radius is increased beyond this, the CDF will begin to trast sensitivity will be repeatable within 6 5 %.
change significantly. Unless otherwise agreed upon between 9.1.2 Bias—The measured spatial resolution and contrast
the purchaser and supplier, select the largest region for which sensitivity will be accurate within 6 5 %.
the CDF is constant to better than 5 %.
7.2.4 Unless otherwise agreed upon between the purchaser
10. Keywords
and supplier, the CDF shall be visually displayed or plotted, or
both, as a function of tile size. When plotting, the convention 10.1 computed tomography; contrast discrimination; con-
is to present the data on a log-log graph. trast sensitivity; CT; geometrical unsharpness; spatial resolu-
tion
8. Report
8.1 A report documenting the spatial resolution and contrast

The American Society for Testing and Materials takes no position respecting the validity of any patent rights asserted in connection
with any item mentioned in this standard. Users of this standard are expressly advised that determination of the validity of any such
patent rights, and the risk of infringement of such rights, are entirely their own responsibility.

This standard is subject to revision at any time by the responsible technical committee and must be reviewed every five years and
if not revised, either reapproved or withdrawn. Your comments are invited either for revision of this standard or for additional standards
and should be addressed to ASTM Headquarters. Your comments will receive careful consideration at a meeting of the responsible
technical committee, which you may attend. If you feel that your comments have not received a fair hearing you should make your
views known to the ASTM Committee on Standards, at the address shown below.

This standard is copyrighted by ASTM, 100 Barr Harbor Drive, PO Box C700, West Conshohocken, PA 19428-2959, United States.
Individual reprints (single or multiple copies) of this standard may be obtained by contacting ASTM at the above address or at
610-832-9585 (phone), 610-832-9555 (fax), or [email protected] (e-mail); or through the ASTM website (www.astm.org).

4
COPYRIGHT American Society for Testing and Materials
Licensed by Information Handling Services