Nistspecialpublication960 12e2
Nistspecialpublication960 12e2
Nistspecialpublication960 12e2
(2009 edition)
Jeff C Gust
Robert M. Graham
Michael A. Lombardi
Special
[T Publication
Ititut
ftitute of
ind Technology 960-12
m.t of Commerce
NIST Special Publication 960-12
Jeff C. Gust
Richard J. Bagan, Inc.
Robert M. Graham
Sandia National Laboratories
Michael A. Lombardi
National Institute of Standards and Technology
January 2009
Official contribution of the National Institute of Standards and Technology; not subject
to copyright in the United States.
iii
Acknowledgements
ACKNOWLEDGEMENTS
The authors thank the following individuals for their extremely useful suggestions
regarding this new revision of the guide: Georgia Harris and Val Miller of the NIST
Weights and Measures Division, Warren Lewis and Dick Pettit of Sandia National
Laboratories, and Dilip Shah, the chair of the American Society for Quality (ASQ)
Measurement Quality Division.
v
Table of Contents
Contents
2. A. Stopwatches 9
2.B. Timers 14
2. C. Commercial Timing Devices 15
Appendix B: References 67
6
1
List of Figures
List of Figures
Figure 14. Using the start-stop button of the stopwatch to start the
counter 42
Figure 15. Measured reaction times (four operators, 10 runs each) for
totalize method 44
Figure 16. Mean reaction times (four operators, 10 runs each) for the
totalize method 45
ix
:ch and Timer Calibrations
List of Figures, cont'd
Figure 20. Time base measurement system for stopwatches and timers. ..52
Figure 23. Factors that can change the quartz time base frequency 62
List of Tables
measurement uncertainty 32
(based on 25 readings) 53
XI
Intr lion
Section 1
Introduction to Stopwatch and Timer Calibrations
There are nine sections in this guide. Section 1 provides an overview, and serves
as a good introduction if you are new to the field of metrology or to time and
frequency measurements. Section 2 describes the types of timing devices that
require calibration. Section 3 discusses specifications and tolerances. Sections 4
through 7 discuss calibration methods and their associated uncertainties. Section
8 provides additional information to help determine if the selected calibration
method can meet the required level of uncertainty, and Section 9 discusses other
topics related to measurement uncertainty. A sample calibration report and
references are provided in the appendices.
defined as the elapsed time between two events. One common example of a time
interval is a person's age, which is simply the elapsed time since the person's
birth. Unlike a conventional clock that displays time-of-day as hours, minutes,
and seconds from an absolute epoch or starting point (such as the beginning of the
day or year), a stopwatch or timer simply measures and displays the time interval
from an arbitrary starting point that begins at the instant when the stopwatch is
started.
The standard unit oftime interval is the secon d (s) [1]. Seconds can be accumulated
toform longer time intervals, such as minutes, hours, and days; or they can be
sliced into fractions of a second such as milliseconds (10~ 3 s, abbreviated as
6
ms) or microseconds (10~ s, abbreviated as us). Table 1 lists these and other
i
Stopwatch and Timer Calibrations
prefixes that can be used with seconds, as well as the multiples/submultiples and
symbols used to represent them. The second is one of the seven base units in the
International System of Units (SI). Other units (most notably the meter and the
volt) have definitions that depend upon the definition of the second.
0.001 = io-
3
milli m
0.000 001 = io-
6
micro u
0.000 000 001 = io-
9
nano n
0.000 000 000 001 = IO 12
pico P
The SI defines the second based on a property of the cesium atom, and for this
reason cesium oscillators are regarded as primary standards for both time interval
and frequency. A second is defined as the time interval required for 9 192 63 1 770
transitions between two energy states of the cesium atom to take place. The atomic
definition of the second, together with current technology, allows it to be measured
with much smaller uncertainties than any other SI unit. In fact, the National
Institute of Standards and Technology (NIST) can currently measure a second
15 9
with an uncertainty of less than 1 part in 10 , or more than 1 billion (10 ) times
smaller than the uncertainties required for the calibrations described in this guide!
of a second, or 0.2 s.
today's devices, the time base oscillator is nearly always a quartz crystal oscillator.
However, older devices used either a mechanical oscillator, the alternating
current (AC) line frequency (60 Hz in the United States), or an oscillator based
on a tuned electronic circuit as their frequency source. The time base oscillator
serves as the reference for all of the time and frequency functions performed by
the device. The most common frequency used by quartz time base oscillators is
15
32 768 (= 2 ) Hz. In this case, when the stopwatch or timer has counted 32 768
oscillations from its time base oscillator, it then records that 1 s has elapsed. If
you want to think of this time base as a clock, it "ticks" 32 768 times per second,
or once every 30.518 us.
Throughout this guide, time interval is always presented in units of seconds (or
fractions of a second), and frequency is presented in units of hertz (or multiples
of a hertz). However, measurement uncertainties are presented as dimensionless
values that represent a fractional percentage error. Since these dimensionless
values are usually very small percentages, they are often expressed in scientific
notation. For example, if a stopwatch has a measurement uncertainly" of 1 s over a
time interval of 10 000 s. the uncertainty is expressed as either a percentage (0.01
%) or as a dimensionless value ( 1 x 10"). Table 2 provides more examples.
3
Stopwatch and Timer Calibrations
Table 2 - Unit values, dimensionless values, and percentages.
x lO" 2
1 s 100 s 1 part per hundred 1 1
x lO 3
1 s 1000 s 1 part per thousand 1 0.1
x lO 5
1 s 100 000 s 1 part per 100 thousand 1 0.001
used, it is compared to the DUT's time base oscillator. Both types of calibrations
are described in detail later in this guide.
Common sense dictates that the measurement reference for any calibration
(either the laboratory reference or the field standard) must always
outperform the devices it needs to test. A parking meter, for example,
might have an acceptable uncertainty of 1 % when timing a 5 minute
interval (±3 s). A field standard stopwatch used to test a parking meter
should be certified to an uncertainty small enough so that it contributes no
significant uncertainty to the parking meter calibration. In other words, we
need to be able to trust our reference so that we can trust our measurement
of the DUT.
The definition of metrological traceability implies that unless the measured value
is accompanied by a stated measurement uncertainty, the traceability chain is
The International Bureau of Weights and Measures (BIPM) located near Paris,
France, is responsible for ensuring the worldwide uniformity of measurements
Introduction
and their traceability to the SI. The BIPM collects and averages time interval and
frequency data from more than 60 laboratories around the world and creates a
time scale called Coordinated Universal Time (UTC) that realizes the SI second
as closely as possible. Thus, UTC serves as the international standard for both
time interval and frequency. However, the BIPM does not produce a physical
representation of the second; it simply calculates a weighted average that is
published weeks after the actual measurements were made. This document, known
as the BIPM shows the time offset of each contributing laboratory
Circular T,
with associated uncertainties, and can be downloaded from the BIPM web site
(www.bipm.org). The laboratories that provide data to the BIPM maintain the
oscillators and clocks that produce the actual signals that are used as measurement
references. Most of these laboratories are national metrology institutes (NMIs)
that serve as the caretakers of the national measurement references for their
respective countries. Thus, to establish traceability to the SI for time interval and
frequency calibrations, the traceability chain for a measurement must link back
to signals that originate from an NMI or a national timekeeping laboratory. The
NMI that is chosen as a reference must contribute to the derivation of UTC by
sending its measurement data (with associated uncertainties) to the BIPM.
NIST is the ultimate reference point for most measurements made in the United
States, and as such, submits time and frequency data to the BIPM. NIST provides
it own real-time representation of UTC, designated UTC(NIST), that is distributed
to the public using a variety of radio, telephone, and Internet signals. These
signals are described in more detail in Section 5, and can serve as references for
measurements that are traceable back to the SI.
|
uncertainties become larger and larger. For example, if the calibration laboratory
uses an audio signal from NIST radio station WWV (Section 5) to calibrate its
standard, the uncertainty of the received tones might be 1 ms. This uncertainty
7
Stopwatch and Timer Calibrations
is still small enough for the WWV tones to be used as a stopwatch calibration
reference, because the uncertainty introduced by an operator starting and stopping
the watch (human reaction time) is much larger, typically tens or even hundreds
of milliseconds. In summary, as long as each link of the chain and its uncertainty
are known, traceability to the SI can be established.
Stopwatch and timer calibrations are among the least demanding of all time
and frequency measurements. Relatively speaking, the instruments requiring
calibration are low cost, and the acceptable measurement uncertainties can be
quite large. Even so, for legal, technical, and practical reasons it is very important
to establish traceability to the SI for these calibrations. If a valid traceability
chain to the SI is established, it ensures that the working device was properly
calibrated, and, if correctly used, will produce valid results.
8
Description of Tin
Section 2
Description of Timing Devices that Require Calibration
2.A. Stopwatches
Stopwatches can be classified into two categories, Type I and Type II [5]. Type
I stopwatches have a digital design employing quartz oscillators and electronic
circuitry to measure time intervals (Figure 2). Type II stopwatches have an
analog design and use mechanical mechanisms to measure time intervals (Figure
3). The key elements of Type I and Type II stopwatches are summarized in
Table 3.
• Protects display
• Protects dial/hands
• Allows for proper
• Allows for proper
viewing
Crystal viewing
• May be tinted
• Must be clear and
• May employ
untinted
magnification
• 48 hours without
• 3 hours without
Minimum time interval replacement of
rewinding
battery
9
Stopwatch and Timer Calibrations
Table 3 - Continued
• Must indicate
whether display
Split time (if equipped)
mode is regular or
split time.
• Provide delimiting
character for
Digital display hours, minutes,
seconds (usually
colon)
10
Description ofTiming Devices
pulse per second signal using a simple 15 stage divide-by-two circuit. It also
has the benefit of consuming less battery power than higher frequency crystals.
Figure 4 shows the inside of a typical digital device, with the printed circuit
board, quartz crystal oscillator, and battery visible. The counter circuit consists
of digital dividers that count the time base oscillations for the period that is
initiated by the start/stop buttons [6, 7]. The display typically has seven or eight
digits.
11
Stopwatch and Timer Calibrations
12
Description ofTiming Devices
13
Stopwatch and Timer Calibrations
Another form of the Type II stopwatch uses a timer driven by a synchronous
motor that also drives the hands or numbered wheels. For this device, the power
source is the 60 Hz AC line voltage. The power source drives an electric motor
within the timing device. The time base is derived from the controlled regulation
of the 60 Hz frequency of AC electric power as supplied by the power utility
2.B. Timers
Timers, unlike stopwatches, count down from a preset time period instead of
counting up from zero. They can be small, battery-operated devices that are used
to signal when a certain time period has elapsed, or they can be larger devices
that plug into a wall outlet and control other items (Figure 6). A parking meter
is an example of a countdown timer. Inserting a coin starts the internal timer
counting down from an initial preset point. When the preset time has elapsed,
the EXPIRED flag is raised.
14
=
Description of Tir . ; : is
One type of timer used extensively in industry is the process control timer. As
their name implies, process control timers measure or control the duration of a
specific process. For example, when a product is made, it may need to be heat
treated for a specific length of time. In an automated manufacturing system, the
process control timer determines the length of time that the item is heated. In
some applications, such as integrated circuit manufacturing, the timing process
can be critical for proper operation.
Process control timers are also used in many different types of laboratory
environments. Calibration laboratories use timers to calibrate devices such as
radiation detectors, by regulating the amount of time that the device is exposed to
the radiation source. The uncertainty in the time of exposure directly influences
the overall measurement uncertainty assigned to the detector calibration.
Timers are also used in the medical field. For example, medical laboratories use
process control timers when specimen cultures are grown. Hospitals use timers to
regulate the amount of medication given to patients intravenously.
The calibration requirements and allowable tolerances for these devices are
usually determined on a state-by-state basis by state law, or locally by city or
municipality ordinances. The allowable uncertainties are often 1 % or larger.
Generic guidance is provided in Section 3.
15
Specifications an ices
Section 3
Specifications and Tolerances
2 In this section, the term "accuracy" is used in order to allow the reader to correlate the concepts
of this chapter directly with published manufacturer specifications. In terms of the ISO Guide
to theExpression of Uncertainty in Measurement [2], the quantities associated with accuracy are
understood to be uncertainties.
17
Stopwatch and Timer Calibrations
Accurate to ± 5 s/day
Built-in memory recalls up to ten
laps.
If the stopwatch in Figure 7 were used to measure a time interval longer than one
day, we could determine a new absolute accuracy figure by simply multiplying
the original specification by the longer time interval. For example 5 s per day
becomes 10 s per two days, 35 s per week, and so on.
18
Specifications and Tolerances
be used when dividing the absolute accuracy specification for shorter time
intervals than the period listed in the specifications. This is because for shorter
measurements periods, a new source of uncertainty, the resolution uncertainty of
the instrument, becomes an important consideration. For example, the absolute
accuracy of the example stopwatch (Figure 7) during a time interval of 30 s is
determined as
day
s
x 30 s = — x—
day
^-day = 0.0017s
2880
We can see from the specifications in Figure 7 that the stopwatch has a resolution
of 1/100 of a second, or 0.01 s. In this case, computing the absolute accuracy
specification for a 30 s interval results in a number (0.00 1 7 s) that is about six times
smaller than the smallest value the stopwatch can display. Most manufacturers of
timing devices do not consider the resolution of the product in their specifications,
but we will include resolution uncertainty in our examples.
„ . .
A Absolute Accuracy
Relative Accuracy
Measured Time Interval
Using the previous example from Figure 7, the stopwatch has an absolute accuracy
specification of 5 s per day, so the relative accuracy is:
Relative Accuracy =
lday
= ——— = 0.000 058 = 0.0058 % = 5.8 x 10" 5
.
86 400 s
Note that because the absolute accuracy specification and the measured time
interval are both expressed in seconds, the unit cancels out; leaving a dimensionless
number that can be expressed either as a percentage or in scientific notation.
Relative accuracy specifications can also be converted back to absolute time units
if necessary. For example, Figure 8 shows the manufacturer's specifications for
19
Stopwatch and Timer Calibrations
simultaneously.
20
Specifications and Tolerances <
in Boulder, Colorado, allowed visitors to measure the time base accuracy of their
quartz wristwatches. Over 300 wristwatches were tested. Nearly all quartz
wristwatches contain a 32 768 Hz time base oscillator, the same technology
employed by a Type I digital stopwatch. The results of these measurements,
showing the loss or gain in seconds per day for the watches, are summarized in
Figure 9, and give some idea of the typical performance of a quartz stopwatch
or timer. Roughly 70 % of the watches were able to keep time to within 1 s per
day or better, a relative accuracy of approximately 0.001 % (1 x 10~ 5 ). About 12
% had a relative accuracy larger than 5 s per day, or larger than 0.005 %. It is
interesting to note that nearly all of the watches in this study gained time, rather
than lost time; and were presumably designed that way to help prevent people
from being late. This characteristic will not necessarily apply to stopwatches and
timers.
40
35
3D
25-
O 20-"'
15
0* 10
d> 5
EL
^ L
«5 -1 *0,5 03 1 2 5 More
21
Stopwatch and Timer Calibrations
3.B. Tolerances Required for Legal Metrology
General specifications for field standard stopwatches and commercial timing
devices are provided in Section 5 5 5 of NIST Handbook 44
.
[9] , and are summarized
in Table 4. NIST Handbook 44 is recognized by nearly all 50 states as the legal
hour
3 s per hour,
Time clocks 3 s per hour, not to exceed
and time not to exceed 1
0.07 % 1 minute per
0.07 % to
recorders minute per day
to 0.08 % day
0.08 %
9 s per minute
on the initial
5 s for any
Other timing 6 s per minute
interval of 1 NA 10%
devices
minute or more
22
Specifications an< .
trances <
The terms overregistration and underregistration are used when specifying the
accuracy of commercial timing devices. The terms are used to describe conditions
where the measurement device does not display the actual quantity. In timing
devices, underregistration is the greatest concern, because an underregistration
error occurs when the timing device indicates that the selected time interval has
elapsed before itactually has. An example of underregistration would be paying
for 10 minutes on a parking meter, and then having the meter indicate that time
had expired when only 9 minutes and 45 s had actually elapsed.
NIST Handbook 44 [9] specifies that instruments that are required to calibrate
timing devices must be accurate to within 15s per 24 h period (approximately
0.017 %). If stopwatches are used as the calibration standard, this becomes
theminimum allowable tolerance for the stopwatch. Another reference, NIST
Handbook 105-5 [5] states that the tolerance for instruments used to calibrate
timing devices must be three times smaller than the smallest tolerance of the device
being calibrated. Handbook 105-5 also provides a nearly identical specification
for stopwatches, stating that the tolerance for stopwatches is ±0.02 % of the time
interval tested (approximately 2 s in 3 hours), rounded to the nearest 0.1 s.
(mechanical) devices, but Type I devices are normally capable of much lower
uncertainties. As a result, organizations and jurisdictions that rely exclusively
on digital stopwatches (Type 1) might require that devices be calibrated to a
tolerance of 0.01 %, or even 0.005 %. For example, the State of Pennsylvania
code [11] uses the same specifications as NIST Handbook 44 for mechanical
stopwatches (15 s per 24 hours), but states that a quartz stopwatch shall comply
with the following more rigorous standards:
23
atch and Timer Calibrations
24
Met
Section 4
Introduction to Calibration Methods
There are three generally accepted methods for calibrating a stopwatch or timer:
the direct comparison method, the totalize method, and the time base method.
The first two methods consist of time interval measurements that compare the
time interval display of the DUT to a traceable time interval reference. In the
case of the direct comparison method, the time interval reference is normally a
signal broadcast by an NMI, usually in the form of audio tones. In the case of the
totalize method, the time interval reference is generated in the laboratory using
a synthesized signal generator, a universal counter, and a traceable frequency
standard. The third method, the time base method, is a frequency measurement. It
compares the frequency of the DUT's time base oscillator to a traceable frequency
standard [12]. The properties of the three methods are briefly summarized in
Table 5, and the following three sections are devoted to the three methods. Each
section explains how to perform a calibration using each method, and how to
estimate the measurement uncertainties.
^^^^ ^ftlethod
— Direct comparison
Time base
Properties — Totalize
measurement
Equipment Requirements Best Better Better
Speed Good Better Best
Uncertainty Good Good Best
Applicability Good Best Better
This guide does not attempt to summarize the GUM, but does strive to produce
estimates of uncertainty that are consistent with the GUM. The resulting expanded
uncertainty of measurement is presented with a coverage factor that represents an
approximate 95 % level of confidence.
25
The Direct Comparison Method
Section 5
The Direct Comparison Method
The direct comparison method is the most common method used to calibrate
stopwatches and timers. It requires a minimal amount of equipment, but has
larger measurement uncertainties than the other methods. This section describes
the references used for this type of calibration and the calibration procedure.
National Radio
Metrology T A. Telephone call Broadcast
t j • . , Location ,
Institute (NMI) numbers letters frequencies
National Institute _ _ 1t .
*-cu
of
a^
and
a
u
a
Standards
Technology 1
Fort Collins,
Colorado,
'
m^ /lftft7111
(303)499-7111
,
* WWV
_ in
2.5,5,10,
1C OAAyrTT
15, 20 MHz
TT . A ,
United States
(NIST)
National Institute
j^ aua j
of Standards
JrT, Hawaii,
.'.
/oao^k /nn*
(808) 335-4363 *
um VU
WWVH r 2.5,5,10,
c \l TT
and Technology
, ,
TT . , '
v 7 *
15 MHz
United States
(NIST)
United , .
Naval
States
^r^T*
Umted <202 ) 762 " 1401 *
*
Observatory (202) 762- 1 069
MatCS
(USNO)
27
Stopwatch and Timer Calibrations
United Colorado
States Naval Springs, *
(719)567-6742
Observatory Colorado.
(USNO) United States
• (613) 745-1576
National Ottawa,
(English language) 3.33.7.850.
Research Council Ontario,
(613) 745-9426(§, 14.67 MHz
(NRC) Canada
(French language)
(442) 215-39-02 *
(442)211-05-06 !
(442) 21 1-05-07 #
(442) 21 1-05-08 ##
Time
announcements
Centro Nacional XEQK
Queretaro. are in Spanish, a
de Metrologia (Mexico 1.35 MHz
Mexico country code must
(CENAM) City)
be dialed to access
these numbers
from the United
States, see www.
cenam.mx for more
information.
Taedok,
Korea Research
Science
Institute of
Town, HLA 5 MHz
Standards and
Republic of
Science (KRISS)
Korea
28
The Direct Com 3 3 son
Please note that local "time and temperature" telephone services are not traceable
references and should not be used. For traceable calibrations, use only sources
that originate from a national metrology institute, such as those listed in Table
6. The following sections briefly describe the various radio and telephone time
signals, and provide information about the types of clock displays that can and
cannot be used.
Most of the stations listed in Table 6 are in the high-frequency (HF) radio
band (3 MHz to 30 MHz), and therefore require a shortwave radio receiver. A
typical general-purpose shortwave receiver provides continuous coverage of the
spectrum from about 150 kHz, which is below the commercial AM broadcast
band, to 30 MHz. These receivers allow the reception of the HF time stations
on all available frequencies. The best shortwave receivers are designed to work
with large outdoor antennas, with quarter-wavelength or half-wavelength dipole
antennas often providing the best results. However, in the United States, adequate
reception of at least one station can usually be obtained with a portable receiver
with a whip antenna, such as the one shown in Figure 10. This type of receiver
typically costs a few hundred dollars or less.
Figure 10. Portable shortwave radio receiver for reception of audio time
signals.
s intervals, and CENAM offers separate phone numbers for UTC and the local
30
The Direct Comp< i ' n M
uncertainty is generally not known. In contrast, each "tick" of an audio broadcast
from WWV originates from NIST and is synchronized to UTC. Therefore, WWV
audio always keeps the traceability chain intact.
There are a few instances where a time display can be used to establish traceability.
One example would be a display updated each second by pulses from a Global
Positioning System (GPS) satellite receiver. In this case, if the traceable input
signal were not available, the display would stop updating. Therefore, if the
display is updating, then it is clear that each "tick" is originating from a traceable
source. However, nearly all GPS receivers have the capability to "coast" and
keep updating their display even when no satellite signals are being received. In
order for a GPS
display to be used as a reference, there must be an indicator on
the unit that shows whether the display is currently locked to the GPS signal, or
is in "coast" mode. If the receiver is in "coast" mode, it should not be used as a
calibration reference.
Another example of a traceable time display would be a digital time signal obtained
from a telephone line, such as signals from the NIST Automated Computer Time
Service (ACTS), which is available by dialing (303) 494-4774 [13]. With an
analog modem and simple terminal software (configured for 9600 baud, 8 data
bits, 1 stop bit, and no parity), you can view time codes on a computer screen,
and use these codes as a reference in the same way that you would use the audio
time announcements from WWV.
However, the length of a single telephone call
is limited to 48 s. In theory, Internet time codes could be used in the same way,
but the transmission delays through the network can vary by many milliseconds
from second to second. For this reason, the currently available Internet signals
31
Stopwatch and Timer Calibrations
5.B.I. Advantages of the Direct Comparison Method
This method is relatively easy to perform and, if a telephone is used, does not
require any test equipment or standards. It can be used to calibrate all types of
stopwatches and many types of timers, both electronic and mechanical.
10 3
1 60 0.5
10 600 0.05
30 1800 0.01666
1 60 3600 0.00833
As Table 7 illustrates, the longer the time interval measured, the less impact the
operator's start/stop uncertainty has on the total uncertainty of the measurement.
Therefore, it is better to measure for as long as practical to reduce the uncertainty
introduced by the operator, and to meet the overall measurement requirement.
32
The Direct Comparison Method 4
the uncertainty contributed by human reaction time to 0.02 %. However, we
if
However, if an ordinary land line is not used, the uncertainties associated with
telephone time signals must be assumed to be larger. For example, wireless
phone networks or voice over Internet protocol (VOIP) networks sometimes
introduce larger delays that are subject to more variation from phone call to
phone call than ordinary land lines. If wireless or VOIP networks are used,
33
Stopwatch arid Timer Calibrations
however, it is reasonable to assume that the transmission delay does not exceed
150 ms, since the International Telecommunication Union (ITU) recommends
that delays be kept below this level to avoid the distortion of voice transmissions
[14]. Calls made from outside the continental United States might occasionally
be routed through a communications satellite, introducing delays of about 250
ms. Although the use of satellites is now rare, if the first call went through a
satellite, and the second call didn't (or vice versa), a significant uncertainty would
be introduced. Therefore, common sense tells us that a laboratory in Illinois (for
example) shouldn't start a calibration by calling the NIST service in Colorado,
and then stop the calibration by calling the NIST service in Hawaii. Based on
this discussion, it is recommended that an uncertainty of 150 ms be assigned
if wireless or VOIP networks are used, or 250 ms if calls are routed through a
satellite.
During a single phone call, the uncertainty of the time interval reference is
essentially equal to the stability of a telephone line (the variations in the delay)
during the call. Phone lines are surprisingly stable. The ITU recommendations
for timing stability within the telephone system call for stabilities of much less
than 0. 1 ms for the North American Tl system [15]. A NIST study involving the
Automated Computer Time Service (ACTS), a service that sends a digital time
code over telephone lines, showed phone line stability at an averaging time of 1
s to be better than 0.1 ms over both a local phone network and a long distance
is not possible to guarantee this stability during all phone calls, it is reasonable to
assume that the stability should be much less than 1 ms during typical calls, which
are limited to about 3 minutes in length. Thus, the uncertainties contributed by
phone line instabilities are so small that they can be ignored for our purposes.
If the radio signals listed in Table 6 are used as a reference instead of a telephone
signal, the arrival time of the signal will vary slightly from second to second as the
length of the radio signal path changes, but not enough to influence the results of a
stopwatch or timer calibration. Shortwave signals that travel over a long distance
relyon skywave propagation, which means that they bounce off the ionosphere
and back to Earth. A trip from Earth to the ionosphere is often called a hop, and
a hop might add a few tenths of a millisecond, or in an extreme case, even a full
millisecond to the path delay. Normally, propagation conditions will remain the
same during the course of a calibration, and the variation in the radio signal will
be negligible, often less than 0.01 ms. Even if an extra hop is added into the radio
path during the calibration; for example if a one hop path becomes a two hop
34
The Direct Comparison Method
path, the received uncertainty of the radio signal will still not exceed 1 ms [13].
it can generally be assumed that the uncertainty of the display is less than 1
display. The time base of the stopwatch was measured before and after each test
(using the Time Base Method), and its offset from nominal was found to be small
enough that it would not influence the test. Therefore, differences in readings
between the stopwatch being tested and the standard would be due only to the
operator's reaction time. Each operator was asked to repeat the measurement
process 10 times, and the resulting 10 differences between the standard and the
stopwatch were recorded and plotted (Figure 11).
35
Stopwatch and Timer Calibrations
60
50
40
30
vT 0-20
C 10
o
5g 00
« *
TO
> -0.10
i » t
Q -0.20
-0.30
-0 40
-0.50
»0.60
-0 70
-0.80
Run Number
Figure 11. Reaction time measurements (four operators, 10 runs each) for the
direct comparison method.
>
<
f
Figure 12.
12
Averaging measurement
Operator Number
3 4
36
The Di »arison Method
37
Stopwatch and Timer Calibrations
5.C.4.C. Combination of Uncertainties
In the following examples, the uncertainty budgets were developed for a
calibration using traceable land lines (Table 8 and Table 9), and for a calibration
using a cellular phone or satellite signal (Table 1 0) based upon the data previously
provided. The human
reaction time was based on the worst case data presented
in Section 5.C.2. The uncertainties are rounded to the nearest millisecond. The
uncertainty components are considered to be uncorrected, so they are combined
using the root sum of squares method.
Rectangular
X
A DUT resolution TypeB
38
i he Direct Comparison I e t 3d
Telephone delay
150 TypeB Rectangular 87
deviation
Source of Magnitude,
& Method of .
A. Standard
Distribution A .
A
uncertainty ms evaluation uncertainty, ms
Human reaction
120 TypeB Rectangular 69
time bias
Human reaction
Normal
time standard 230 TypeB 230
(*=i)
deviation
Telephone delay
30 TypeB Rectangular 17
deviation
39
Section 6
The Totalize Method
The totalize method partially eliminates the measurement uncertainty from human
reaction time, but requires two test instruments: a calibrated signal generator,
and a universal counter.
Laboratory Frequency
Reference Standard
© Connect to
Synthesizer
and Counter
Frequency Synthesizer External
Time Base
Inputs
0—1
Universal Counter
41
Stopwatch and Timer Calibrations
To begin the measurement, start the stopwatch and manually open the gate of
the counter at the same time. One way to do this is by rapidly pressing the start-
stop button of the stopwatch against the start button on the counter (Figure 14).
Another method is to press the start/stop button of the stopwatch with one hand
and simultaneously pressing the start/stop button of the counter. After a suitable
period of time (determined by the calibration requirements of the stopwatch or
timer being calibrated), use the same method to simultaneously stop the stopwatch
and close the gate of the counter.
Figure 14. Using the start-stop button of the stopwatch to start the counter.
Once the counter and stopwatch are stopped, compare the two readings. Use the
equation At/T to get the results, where At is the difference between the counter
and stopwatch displays, and T is the length of the measurement run. For example,
if At = 100 ms and T = 1 hour, the time uncertainty is 0.1 s / 3600 s or roughly
5
2.8 x 10- (0.0028 %).
The Totalize Method >
6.A.I. Advantages of the Totalize Method
When using the stopwatch's start/stop button to open and close the counter's
method partially eliminates human reaction time, and therefore has a
gate, this
lower measurement uncertainty than the direct comparison method.
Each operator was asked to repeat the measurement process 10 times, and the
resulting difference between the standard and the stopwatch were recorded.
43
Stopwatch and Timer Calibrations
0.10
0.08
0.06
0.04
0.02
0.00
-0.02
-0.04
-0.06
-0.08
-0.10
4 6 10
Run Number
Figure 15. Measured reaction times (four operators, 10 runs each) for totalize
method.
As shown in Figure 15, the average reaction time was usually less than 40 ms.
The was about 90 ms. The mean and standard deviations for
largest deviation
each operator were computed and graphed in Figure 16. The data demonstrates
that the worst case mean reaction time was 27 ms, and the worst case standard
deviation was 10 ms, which is a significant improvement over the direct
comparison method. Subsequent measurements of human reaction time were
made by placing the start/stop button of the stopwatch directly against the start/
stop button of the frequency counter (as shown in Figure 12) so that both buttons
were pushed at the same time. The experimental data showed that this method
provided no significant advantage over using one hand to start the stopwatch and
the other hand to start the frequency counter.
44
The Totalize Method
2 3
Operator Number
Figure 16. Mean reaction times (four operators, 10 runs each) for the totalize
method.
45
Stopwatch and Timer Calibrations
distribution. A rectangular distribution is also used for analog timers, since these
devices move in discrete steps from one fraction of a second to the next.
The uncertainty example in Table 1 1 assumes that the synthesized signal generator
can produce a 1 kHz signal with an uncertainty of 1 x 10" 8 or less. The stopwatch
is compared to the counter for 3 hours (10 800 s). The stopwatch is started and
stopped with one hand, and the counter is started and stopped with the other. The
stopwatch is digital and the resolution is 0.01 s. As in the previous uncertainty
example, all sources of uncertainty are combined by root sum of squares, and
uncertainties are rounded to the nearly millisecond.
Human reaction
Normal
time standard 10 TypeB 10
(k=l)
deviation
Synthesizer
TypeB Rectangular
accuracy
Totalize counter
1 TypeB Rectangular 1
resolution
A DUT
X
5 TypeB Rectangular 3
resolution
Combined uncertainty 19
46
I he Totalize Method
the difference in elapsed time for the counter to determine the measured offset
of the stopwatch.
Figure 17 shows that the initial counter reading is 53.980 s and the stopwatch
is at 57.52 s. Figure 18 shows that the counter reading is 82.049 s and the
stopwatch is at 1 minute 26.18 s (86.18 s). The elapsed time on the counter is
82.049 - 53.980 = 28.069 s, and likewise the elapsed time on the stopwatch is
86.18 - 57.52 = 28.66 s. This would indicate that over the 28 s interval, the
47
Stopwatch and Timer Calibrations
HEWLETT
«U*ABO MPM „„,...„-
COUNTER
8? 049
QQ CZ
WARNING NOTE - In order for this method to provide accurate results, the
photo system must be set up in a manner that captures the stopwatch and counter
display correctly. If the shutter speed is too slow, the images will not produce
discernable information, as Figure 1 9 shows for the stopwatch. We could interpret
this stopwatch reading with the 1/10 s digit as 9, 7, 3, or 4, and the 1/100 s digit
as 3, 5, or 6.
Additionally, often when the photo yields a very clear display as in Figures 17
and 18, the resultingmeasurement is not valid. This stopwatch was previously
calibrated using other methods described in this book and was found to have an
offset of less than 1 second per day, which is significantly different from the photo
totalize method results indicated above. For this example and photo equipment
setup, themethod produced false results. Anyone using the photo totalize
method must validate the measurement results of their measurement process
by comparing results obtained for a particular instrument to other measurement
methods discussed in this book.
48
Figure 19. Ambiguous photo totalize reading.
49
Th€ : Base Method <«
Section 7
The Time Base Method
The time base measurement method is method for stopwatch and
the preferred
timer calibrations, since it introduces the least amount of measurement uncertainty.
Because the DUT's time base is measured directly, the calibrating technician's
response time is not a factor.
The exact method of measuring the stopwatch's time base depends upon the type
of stopwatch or timer being calibrated. If the unit has a quartz crystal time base,
an inductive or acoustic pickup is used to monitor the stopwatch's 32 768 Hz
time base frequency on a calibrated frequency counter (the pickup is fed into an
amplifier to boost the signal strength). If the unit is an older LED-type stopwatch,
the frequency is usually 4.19 MHz. An inductive pickup can even be used to
sense the stepping motor frequency of analog mechanical stopwatches, or the
"blink rate" of a digital stopwatch display. Or, an acoustic pickup can be used to
measure the "tick" of a mechanical stopwatch.
51
Stopwatch arid Timer Calibrations
Figure 20. Time base measurement system for stopwatches and timers.
The example unit uses a 4.32 MHz quartz time base oscillator as a measurement
reference. In a 2 measurement period (the shortest period used by the instrument),
s
the oscillator produces 8 640 000 cycles, a number equal to the number of 0.01
s intervals in one day. Therefore, the instrument resolution is 0.01 s per day.
Cycles from the DUT time base are counted by a sensor that is connected to the
measurement system. The sensor uses the cycle count from the DUT to start
and stop the cycle count from the reference time base. For a 2 s measurement
interval, a 32 768 Hz DUT would stop the cycle count from the reference time
base after counting to 65 536 (32 768 x 2). If the reference time base counted to
8 639 900 during this same interval, then the system would estimate that the DUT
would gain about 1 s per day (100 x 0.01 s).
The time base measurement system shown in Figure 20 allows the measurement
interval to be set from 2 s to 960 s. Selecting an interval longer than 2 s is
52
The Time Base Method
effectively the same thing on a frequency counter. It
as increasing the gate time
is important to measure for a long enough period to get an accurate and stable
To support 0.01 s resolution, the instrument's 4.32 MHz time base oscillator
7
must be calibrated to within 1.16 x 10~ . If the instrument is calibrated to within
specifications, the display uncertainty is ±0.05 s per day (maximum time base
frequency offset of about 6 x 10~ 7 ). In all cases, the uncertainty of the time base
oscillator relative to UTC must be known in order to establish traceability. The
system can be calibrated by applying either a traceable 1 pulse per second (pps)
signal to a pin connector on the back of the unit or a traceable 32 768 Hz reference
signal to the sensor, or by extracting and measuring the 4.32 MHz signal directly
with a traceable frequency measurement system.
capacitive sensor is used to detect the 4.19 MHz frequency of quartz time base
oscillators, an acoustic or inductive pickup is used to sense the stepping motor
frequency of analog mechanical stopwatches, and an inductive pickup is used to
sense the "blink rate" of digital stopwatches.
Front panel switches allow the operator to select the type of device being tested,
53
Stopwatch and Timer Calibrations
the measurement interval, and whether the time offset should be displayed as
seconds per day or seconds per month. Once these parameters have been chosen,
the device is measured by simply positioning it on top of the sensor until a usable
signal is obtained, waiting for the measurement interval to be completed, and
then recording the number from the display. It is always a good idea to allow
the stopwatch calibrator to complete at least two complete measurement cycles
before recording a reading.
Figure 21 shows a more elaborate time base measurement system with some
additional features. This device has a small LCD display with graphics capability,
built-in temperature measurement capability, an RS-232 interface that allows
measurement results to be transferred to a computer, and an optional Global
Positioning System (GPS) satellite receiver that corrects and calibrates the quartz
time base oscillator. Like the system shown in Figure 20, this system can measure
the 32 768 Hz quartz crystal frequency of Type 1 stopwatches, the stepping motor
frequency of analog stopwatches, and the "blink rate" of digital stopwatches. As
an additional benefit, this system can measure the quartz crystal frequency and
the stepping motor frequency at the same time. This can be useful if the device
under test compensates for the frequency offset of the quartz crystal by applying
corrections to the stepping motor, thus making the analog display more accurate
than the time base (a common practice in analog quartz wristwatches).
Figure 21. A time base measurement system for stopwatches and timers with
an integrated graphics display.
54
TheTis r i
;
is ;
f - f
/(offset) = measured nominal
^nominal
If Jf
nominal
,
is 32 768 Hz and Jfmeasured ^ is 32 767.5 Hz, then the frequency
~ J offset is
-0.5 / 32 768 or -1.5 x 10~ 5 or -0.0015 %. To get time offset in seconds per day,
multiply the number of seconds per day (86400) and the frequency offset:
86 400 x (-1.5 x 10 5
)
= -1.3 s per day ,
which means the stopwatch can be expected to lose 1.3 s per day. You might find
it easier to note that a 1 Hz error in a 32 768 Hz device equates to a time offset of
about 2.64 s, since 86 400 / 32 768 = 2.64. Therefore, a 2 Hz offset is about 5.3
s / day, a 3 Hz offset is about 7.9 s / day, and so on. If the acceptable tolerance is
10 s/ day, then you'll know that 3 Hz is well within tolerance.
These results show that even a low cost eight-digit frequency counter will
provide more measurement resolution than necessary when measuring 32 768
Hz devices. The last digit on an eight-digit counter represents 0.001 Hz (1 mHz),
and a 1 mHz frequency offset represents a time offset of just 2.6 ms per day. Very
few stopwatches or timers can perform at this level.
55
Stopwatch and Timer Calibrations
day (50 ms/day). There is no uncertainty contributed by human reaction time, and
the resolution uncertainty of the stopwatch calibrator is insignificant compared to
its accuracy specification. Resolution uncertainty does not need to be considered,
since data are not observed from the DUT's display. Since there is only one
uncertainty component, we did not include an uncertainty analysis table.
56
Required Uncertainty
Section 8
How to Determine the Calibration Method Meets the
if
Required Uncertainty
minutes, the accuracy of the stopwatch over the 5 minute interval would be about
17 ms. The first problem arises in that the resolution of the stopwatch is 0.01
s, and cannot display 0.017 making the specification impossible to verify for
s,
this time period. Furthermore, the measurement uncertainly for the calibration
process is 480 ms, approximately 28 times larger than the accuracy that we are
trying to verify! Clearly a 5 minute calibration period for this stopwatch and
calibration method is not adequate. Even a 1 hour calibration is inadequate,
because the quantity required to be measured, now about 208 ms, is still less than
adequate. Examples of such rules are the N: 1 decision rule (where the tolerance
of the instrument to be tested is N times larger than the calibration uncertainty
and is mostly commonly stated as 4:1 or 3:1), or some form of guardbanding
(where the calibration uncertainty or some fraction of it is subtracted from the
DUT accuracy specification and the calibration results are acceptable only if
the measured was within the guardband limit). Whatever the case, it is
offset
important to compare the calibration measurement uncertainty to the tolerance of
the DUT, in order to ensure that the calibration process is valid.
57
Stopwatch and Timer Calibrations
To illustrate this, assume that a laboratory employs a 4:1 rule for acceptable
uncertainty. This means that the expanded measurement uncertainty of the
calibration must be four times smaller than the acceptable tolerance of the DUT
in order to declare the unit in or out of tolerance. The laboratory is calibrating a
stopwatch to a tolerance of 0.02 %, using the direct comparison calibration
digital
method via a telephone landline (Table 8). The estimated expanded measurement
uncertainty for this method was 482 ms. In order for 482 ms to be one quarter
of the tolerance of the DUT, the tolerance must be 1928 ms. The amount of time
required to elapse on the stopwatch during the calibration would be at least:
1,928 S
=Xs = 9640 s = 2 h 41 minutes
0.02 %
For the same scenario, if we were trying to verify the stopwatchshown in Figure
8 to the manufacturer's specification of 0.0003 %, the stopwatch would have to
run for more than 1 week (178 hours, 31 minutes, and 7 s). This is impractical,
and the laboratory that is testing to 0.0003 % would clearly want to consider the
58
OtherTopics Related to Measurement Uncertainty
Section 9
Other Topics Related to Measurement Uncertainty
This section discusses other important topics related to measurement uncertainty.
The first involves estimating the uncertainty of a field calibration, where a
reference standard stopwatch is brought into the field and used to calibrate another
device. Next, the stability and aging of 32 768 Hz quartz crystal oscillators used
in stopwatches and timers is by discussions of how the
discussed, followed
performance of a stopwatch can change when a new battery is installed, and how
extreme temperature conditions can affect stopwatch performance.
s). Using these values and the analysis provided in Table 13, the uncertainty of
the industrial timer when measuring a 1 hour interval is 789 ms, or 0.02 %. All
values in Table 1 3 are rounded to the nearest millisecond.
59
Stopwatch and Timer Calibrations
Table 13 - Uncertainty analysis of using a calibrated stopwatch to calibrate
another device.
Standard
Source of Magnitude, Method of
Distribution uncertainty,
uncertainty ms evaluation
ms
Unit under test
Human
reaction time 120 TypeB Rectangular 69
bias
Human
reaction time Normal
230 TypeB 230
standard (k=\)
deviation
Stopwatch
208 TypeB Rectangular 120
accuracy
Stopwatch
resolution TypeB Rectangular
A digit
l
Stopwatch
Normal
calibration TypeB
{k=2)
uncertainty
60
OtherTopics Related to Measurement Uncertainty
„4 L
' -
ft 1
I
«A
jj r
* 8.0E-08 /—
C
« q
/
f
7.0E-08
t i i
\ >t i i i
£ 6.0E-08
> i i
\
r t j
i
tn V j
> \
j Stopwatch A
5.0E-08
jjj
0) \ s Stopwatch B
3 V j
CT
i
I! 4.0E-08
i I r
! ! !
Days
not use the average frequency as a point of reference. Instead, it compares the
frequency offset of the DUT during each measurement period with its frequency
offset during the previous measurement period. By doing so, it reveals how the
frequency of an oscillator changes over time due to effects such as aging.
Stopwatch A had an average frequency offset (accuracy) during the test of about
6
8 x 10" . As indicated in Figure 22, the stability (ADEV) was slightly better than
1 x 10" 7 after one week, or about 80 times better than the accuracy. Stopwatch
B had an average frequency offset (accuracy) during the test of about 5 x 10~
7
.
61
Stopwatch arid Timer Calibrations
Its stability as estimated with ADEV was near 7 x 10~ 8 after one week, or about
Because of their slow aging rate, stopwatches tend to produce very repeatable
results over long periods of time. When compared to the requirements for
stopwatch calibrations discussed in Section 3, the small changes in frequency
due to aging are usually insignificant. This makes it possible for a laboratory to
allow long intervals (perhaps exceeding one year) between calibrations.
Oscillator
Turn Off
Vibration Shock &
Figure 23. Factors that can change the quartz time base frequency.
62
Other Topics Related tc >yrament Uncertainty
Temperature is perhaps the most important factor that affects quartz crystal time
base performance. The quartz crystals used in wrist watch time bases are cut in
such a way as to make them most stable near body temperature. The time base
acts as a thermally stable oscillator while it is on a person's wrist. Stopwatches,
on the other hand, use quartz crystals that have been cut to be stable at or near
room temperature. If they are used in very hot or very cold environments, the
6
time base can vary by over 20 parts in 1 . Figure 24 shows the accuracy of a
typical stopwatch over a temperature range of 0° C to 50° C (32° F to 122° F).
As can be seen for the figure, the flat portion of the performance curve is near
room temperature (23° C or 73° F), and drops off as the temperature increases
or decreases.
<
-5
-10
\
\
-15 -V—
-20
10 20 30 40 50
Temperature (° C)
63
Appendix A
Appendix A
Calibration Certificates
CtfJMUTlON
Fsk: 4782!
TIMER-CLOCK
This unit was unled using the I ahoratnn V Sli<fmatch Tinier C»ltbni<i»<« Sun ton. MMS f
^4i#»
#LAB 991 2 The calibration data imbcaies a devialum from ifw reftusnee
utilizing procedure
seconds per da> (• -). tolerance oflhe Device t "ntler Test, and Fvpsnded ? 'memttty
Kiandiird in
of Measurement tK 2, tef resenting apprimmiikfv 95»« confidence).
( ttUbntti<m n».tu
65
Stopwatch and Timer Calibrations
lile: -17X21
Dale: \ov ember IS 2009
CgggCgl If atvabilHv Ma untrue V jiucs and I be associated uncertainties supplied b> the* XXX
Calihraaoti I jlMii,iiti> me iiiivcahlc to one 01 m«»c Offfcc loU-ncma
1, Tine val*iv» of the units ((j Ihcr lv*sc <>t ckn\«.dt i*n.nnt J-ncd and divw-rntnatvd b> the N.itMirul
lif WlCt <»t nikd SUiv» <4 Aidokj) »n. m spcvial easts jnd
ManiLiidv and icthnologY (I vsheiv
appti-pN.iic. In the National Standards I ablators ,>| amrthcT n.ifi-m
2 The accented valucis) of fimdamcnlal physical phenomena (infringe nandar*):
3. K3!KK*i<<roih^no»>-maint3incd*undard»crtaNishcdb> cither a Kll-t»Uhrauoo »nd <t a direct
ealilnalion UchnKiuv:
i. Standards inainlaiacd and disseminated by the \.V\ Calibration laboratory in special cases and
where wan anted,
5 V alues and uncertainties wising from participation in a National Measurement Svttcnt
Because «»l inherent eomptvAilx in 11k <.aiinralit>n prtn.es* and the isKefUmrx wowtributM* b> rath
aundaidi and calibrabng instruments, traccabilay always toquues ev aluation or a "ira-jcabilii) bee *
V
*fmc£ah(litv tree" *nah su can he assembled lor a specific calibration and \alid (or a particular and
IgMSlfifi poinl m bine, The "iravcabtlily tree" isill include copies o( relevant ecruticates and reports,
vvcvrplcd an .ippn>|*t.»li. Im brevity. However, the >.-•*{ nt preparation nl tin "baccabilits ttce" vsill bj
.iui v.il to the requester.
?Solf. 1 This certificate or report shall not be reproduced except in lull without the advance written
approval ol the \\\ Calibration I aKrraton
Not^.2
. : Ibe as rcsci*. cd <.t-ndiUnn of the standard, set Of standards, or measurement equipment described
herein was a* expected, unless olbenvtsc noted in the tuvdy ot the ccttificaic or report
Appendix B
References
[I] B. N. Taylor and A. Thompson, (Eds.), "The International System of Units (SI),"
Natl. Inst. Stand. Technol. Special Publication 330, 2008 Edition, March 2008.
[5] R. J. Anderson and G. L. Harris, "Specifications and Tolerances for Field Standard
Stopwatches," Natl. Inst. Stand. Technol. Handbook 105-5, October 1997.
[6] Robbins, Michael, "Electronic Clocks and Watches," Howard W. Sams Co.,
Indianapolis, IN, 1975.
[8] North American Electric Reliability Council (NERC), "Time Error Correction,"
Standard BAL-004-0, April 2005.
[10] M. A. Lombardi, "Legal and Technical Measurement Requirements for Time and
Frequency," Measure: The Journal of Measurement Science, 1(3): 60-69, September
2006.
[12] R. M. Graham, "Calibration Techniques for Stopwatches and Timers," Proc. 2003
National Conference of Standards Laboratories (NCSLI), 6 p., August 2003.
67
Stopwatch and Timer Calibrations
[13] M. A. Lombardi, "NIST Time and Frequency Services," Natl. Inst. Stand.
Technol. Special Publication 432, 71 p., January 2002.
[18] J. R. Vig and T. R. Meeker, "The Aging of Bulk Acoustic Wave Resonators,
Filters, and Oscillators," Proc. 1991 IEEE Freq. Cont. Symp., pp. 77-101, May 1991.
68