WreckWatch Automatic Traffic Accident Detection An
WreckWatch Automatic Traffic Accident Detection An
WreckWatch Automatic Traffic Accident Detection An
net/publication/220133799
CITATIONS READS
315 13,922
5 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Hamilton Allen Turner on 02 June 2014.
Abstract Traffic accidents are one of the leading causes of fatalities in the US.
An important indicator of survival rates after an accident is the time between
the accident and when emergency medical personnel are dispatched to the scene.
Eliminating the time between when an accident occurs and when first responders
are dispatched to the scene decreases mortality rates by 6%. One approach to
eliminating the delay between accident occurrence and first responder dispatch
is to use in-vehicle automatic accident detection and notification systems, which
sense when traffic accidents occur and immediately notify emergency personnel.
These in-vehicle systems, however, are not available in all cars and are expensive
to retrofit for older vehicles.
This paper describes how smartphones, such as the iPhone and Google An-
droid platforms, can automatically detect traffic accidents using accelerometers
and accoustic data, immediately notify a central emergency dispatch server after
an accident, and provide situational awareness through photographs, GPS coor-
dinates, VOIP communication channels, and accident data recording. This paper
provides the following contributions to the study of detecting traffic accidents
via smartphones: (1) we present a formal model for accident detection that com-
bines sensors and context data, (2) we show how smartphone sensors, network
connections, and web services can be used to provide situational awarenss to first
responders, and (3) we provide empirical results demonstrating the efficacy of dif-
ferent approaches employed by smartphone accident detection systems to prevent
false positives.
1 Introduction
Emerging trends and challenges. Car accidents are one of the leading causes
of death [2] in the US, causing over 100 fatalities daily. In 2007 alone more than
43,100 deaths resulted from 10.6 million traffic accidents. For every 100 licensed
teenagers between the ages of 16 and 19, there will be 21 traffic accidents, making
car accidents the leading cause of death for that age group in the U.S. [25].
A number of technological and sociological improvements have helped reduce
traffic fatalities during the past decade, e.g., each 1% increase in seatbelt usage is
estimated to save 136 lives [9]. Advanced life saving measures, such as electronic
stability control, also show significant promise for reducing injuries, e.g., crash
analysis studies have shown that approximately 34% of fatal traffic accidents could
have been prevented with the use of electronic stability control [21]. Moreover, each
minute that an injured crash victim does not receive emergency medical care can
make a large difference in their survival rate, e.g., analysis shows that reducing
accident response time by one minute correlates to a six percent difference in the
number of lives saved [12].
An effective approach for reducing traffic fatalities, therefore, is to reduce the
time between when an accident occurs and when first responders, such as medical
personnel, are dispatched to the scene of the accident. Automatic collision notifi-
cation systems use sensors embedded in a car to determine when an accident has
occurred [26, 7]. These systems immediately dispatch emergency medical personnel
to serious accidents. Eliminating the time between accident occurrence and first
responder dispatch reduces fatalities by 6% [26].
Conventional vehicular sensor systems for accident detection, such as BMW’s
Automatic Crash Notification System or GM’s OnStar, notify emergency respon-
ders immediately by utilizing built-in cellular radios and detect car accidents with
in-vehicle sensors, such as accelerometers and airbag deployment monitors. Fig-
ure 1 shows how traditional accident detection systems operate. Sensors attached
to the vehicle use a built-in cellular radio to communicate with a monitoring cen-
ter that is responsible for dispatching emergency responders in the event of an
emergency.
Unfortunately, most cars in the US do not have automatic accident detection
and notification systems. Only in 2007 did automatic notification systems become
standard options in GM vehicles and most other non-luxury manufacturers do not
include these systems as a standard option. Based on 2007 traffic accident data,
automatic traffic accident detection and notification systems could have saved
2,460 lives (i.e., 6% of 41,000 fatalities) had they been in universal use. A key
impediment to using these systems is that they are infeasible or prohibitively ex-
pensive to install in existing vehicles and add to the initial cost of new vehicles.
Moreover, these systems can be rendered obsolete, as evidenced by GM removing
500,000 subscribers from the OnStar service because they were equipped with ana-
log (rather than digital) communications systems, and were therefore incompatible
with their newer communication infrastructure.
Solution approach ⇒ Traffic accident detection and notification with
smartphones. To address the lack of accident detection and notification systems
in many vehicles, smartphones can be used to detect and report traffic accidents
when accident detection and notification systems are unavailable. Smartphones,
such as the iPhone and Google Android, have become common and their usage
is rapidly increasing. In the 2nd quarter of 2010 alone, 325.6 million smartphones
were sold [27]. This large and growing base of smartphone users presents a sig-
nificant opportunity to extend the reach of automatic accident reporting systems.
Moreover, smartphones are widely used by the teenage demographic, which is his-
torically the most accident prone driver age group. The number of teenagers using
mobile phones has been increasing steadily, from 45% of teens in 2004 to 63% in
2006 and then 71% in 2008 [20].
The low cost of smartphones compared to other traffic analysis and accident
prediction systems makes them an appealing alternative to in-vehicle accident
detection and reporting systems [23]. Moreover, smartphones travel with their
owners, providing accident detection regardless of whether or not the vehicle is
equipped with an accident detection and notification system. Furthermore, because
each smartphone is associated with its owner, automatic notification systems built
on smartphones can aid in the identification of victims and determining what
electronic medical records to obtain before victims arrive at the hospital.
The ability to detect traffic accidents using smartphones has only recently
become possible because of the advances in the processing power and sensors
deployed on smartphones. For example, the iPhone 4 includes a GPS system for
determining the geographic position of the phone, an accelerometer for measuring
the forces applied to the phone, two separate microphones, and a 3-axis gyroscope
for detecting phone orientation. Moreover, smartphones now possess significant
sensor data processing power that can support the real-time execution of sensor
data noise filtering and analysis algorithms. For example, the HTC Nexus One
Android smartphone has a 1Ghz processor and 512MB of RAM.
Another key smartphone attribute for accident notification is that they pro-
vide a variety of network interfaces for relaying information back to centralized
emergency response centers, such as 911 call centers. The iPhone 4 contains a cel-
lular interface for sending and receiving data over GSM networks. Wifi can also be
used by the iPhone 4 to send data to a nearby wireless access point. Smartphones
4 J. White et al.
2. 3G Data
1. Accident Connection
Detection with Transmits
Phone Accident Info
Sensors
Car
Ca
r
3. Server
processes
accident info
and contacts
first
responders
also include Bluetooth wireless interfaces that can communicate directly with the
onboard computers in many newer cars.
Smartphone-based accident detection applications have both advantages and
disadvantages relative to conventional in-vehicle accident detection systems, e.g.,
they are vehicle-independent, increasingly pervasive, and provide rich data for
accident analysis, including pictures and videos. Building a smartphone-based ac-
cident detection system is hard, however, because phones can be dropped (and
generate false positives) and the phone is not directly connected to the vehicle.
In contrast, conventional in-vehicle accident detection systems rarely incur false
positives because they rely on sensors, such as accelerometers and airbag sensors,
that directly detect damage to the vehicle.
This paper shows how the sensors and processing capabilities of smartphones
can be used to overcome the challenges of detecting traffic accidents without direct
interaction with a vehicle’s onboard sensors. We describe an approach for using
smartphones to measure the forces experienced by a vehicle and its occupants
to provide a portable “black box” data recorder, accident detection system, and
automatic emergency notification mechanism. The approach detailed in this paper
uses the sensors on a smartphone to record the G-forces (acceleration) experienced
by the vehicle and occupant, the GPS location and speed of the vehicle, and
the acoustic signatures, such as air bag deployments or impact noise, during an
accident. Figure 2 shows how sensors built into modern smartphones can detect
a major acceleration event indicative of an accident and then utilize the built-in
3G data connection to transmit that information to a central server to alert first
responders. That server then processes the information and notifies the authorities
as well as any emergency contacts.
Smartphone Traffic Accident Detection 5
This paper significantly extends our prior work [8] on traffic accident detec-
tion and notification using smartphones [8] in three ways. First, we present a
formal model and algorithm for detecting accidents using smartphones. Second,
we describe how acoustic data can be analyzed to lower false positives. Third, we
include the results of experiments that quantify how acoustic data can help detect
accidents and reduce false positives.
Paper organization. The remainder of this paper is organized as follows: Sec-
tion 2 describes the challenges associated with using smartphones to detect traffic
accidents; Section 3 describes techniques we developed to overcome these chal-
lenges; Section 4 empirically evaluates how to prevent false positives and accident
reconstruction capabilities; Section 5 compares our work on smartphone-based ac-
cident detection systems with related work; and Section 6 presents concluding
remarks.
This section explores the challenges associated with detecting car accidents using
a smartphone’s sensor data. A task of critical importance in accident detection is
ensuring that false positives are not reported to emergency services, such as 911.
According to the US Department of Justice, 25 to 70 percent of calls to 911 in some
areas were “phantom calls” where the caller immediately hangs up [29]. California
receives approximately 6 million 911 calls from cell phones and between 1.6 and
3.6 million of these calls are phantoms [29]. Clearly, smartphone traffic accident
algorithms must be careful not to increase the volume of phantom emergencies.
It is hard to strike a balance between no accident false positives and fully
reporting all traffic accidents that occur. Vehicular accident detection systems,
such as OnStar, have a significant advantage since they are integrated with the
vehicle and its onboard air bag deployment and crash sensors. Sensor data received
by these systems directly correlates to the forces experienced by the vehicle.
In contrast, smartphone accident detection systems must indirectly predict
when an accident has occurred based on sensor inputs to the phone. Since phones
are mobile objects, they may experience forces and sounds (indicative of a traffic
accident) that originate from other sources, such as a user dropping the hand-
set. Accident detection algorithms for smartphones must use sensor data filtering
schemes that are resistant to noise, yet provide high enough fidelity to not filter
out valid accidents.
2.1 Challenge 1: Detecting Accident Forces Without Electronic Control Unit In-
teraction
system must provide sufficiently rich information to first responders to predict the
future state of the driver and passengers, which is hard when the phone cannot
directly measure their health or the car’s condition. Section 3.5 describes how we
use a combination of VOIP telephony, text messaging, mapping, and bystander
reporting to provide situational awareness to first responders.
3 Solution Approach
Accident Detection
Accident Maps
Situational Awareness Data Data Aggregation
Emergency Contact Registration Emergency Dispatch
VOIP Communication/Provisioning
Map Updates
Situational Awareness Data Storage
Clients
Server
JSON
HTTP
The WreckWatch Android client is written in Java based on Android 1.5 with
Google APIs. It consists of several Android application Activities1 for mapping,
testing, and image upload. Background services detect accidents by polling smart-
phone system sensors, such as the GPS receiver and accelerometers. The polling
rate is configurable at compile-time to meet user needs and to provide the appro-
priate power consumption characteristics. The WreckWatch client can gather data
from phone databases (such as an address book) to designate emergency contacts.
Communication to the server from the Android client uses standard HTTP post
operations.
The WreckWatch server was developed using Java/MySQL with Jetty and the
Spring Framework. It provides data aggregation and a communication conduit to
emergency responders, family, and friends. It also allows clients to submit acci-
dent characteristics (such as acceleration, route, and speed) and presents several
interfaces, such as a Google Map and XML/JSON web services, for accessing this
information.
As accident information becomes available, the WreckWatch server posts loca-
tion, route and severity information to a Google Map to aid emergency responders,
as well as other drivers attempting to navigate the roads near the accident. This
map is available over HTTP through a standard web browser and is built with
AJAX and HTML, as shown in Figure 4. The remainder of this section presents
the formal accident detection model used by WreckWatch and its approach to re-
ducing false positives and then discusses features of the WreckWatch client/server
application that supports first responder situational awareness.
1 Activities are basic building block components for Android applications and can be thought
of as a “screen” or “view” that provide a single, focused thing a user can do.
Smartphone Traffic Accident Detection 9
where:
– Sφ is the span of time after an acceleration event sets a value for the variable
φ before the variable is reset.
– φ is an acceleration variable that indicates the maximum acceleration experi-
enced in any direction by the phone. The maximum acceleration value is reset
after Sφ milliseconds have elapsed.
– Sρ is the span of time after a sound event with a sound pressure level greater
than Mρ dBs that the sound event variable, ρ, will remain set to 1.
– ρ is a binary sound event variable that indicates if a sound event greater than
Mρ dBs has occurred. The variable has value 1 if a sound event of Mρ dBs or
more was experienced by the phone and 0 otherwise. From experimentation
and a literature review on air bag deployment [30], we have found that 140dBs
is a good value for Mρ .
10 J. White et al.
– Sβ is the span of time after the phone is no longer traveling at least Mβ mph
that the speed threshold variable, β , will remain set to 1.
– β is a speed threshold variable with value 1 if the phone has been traveling at
greater than Mβ mph.
– ǫ is the distance traveled since the last time the variable β switched from value
1 to 0.
– Mφ is the minimum acceleration in Gs required for an acceleration event alone
to trigger accident detection.
– Mρ is the minimum decibels required for an acoustic event to trigger the sound
event variable.
– Mβ is the minimum speed in miles per hour that the device must be traveling
in order to activate the accident detection system when it is inactive.
– Mǫ is the max distance in feet that the device is permitted to move at a speed
lower than the speed threshold, Mβ , before the accident detection system is
deactivated.
if ( Mφφ + αρ ≥ MT r ) (β == 1)
V
1
( a)
Ev (γ ) = 1 if (ǫ < Mǫ ) ( Mφφ + αρ ≥ MT r ) (3)
V
( b)
0 otherwise
where:
– α is a adjustable weighting factor applied to the sound event that denotes its
importance in the accident detection model. Higher values for α allow collisions
at low speed or where the safety systems significantly dampen the impact,
which can be detected through a combination of sound and acceleration.
– MT r is the threshold for accident detection.
The first accident detection scenario is triggered when the smartphone is trav-
eling above a threshold speed associated with being inside a car. In this situation,
an accident is detected if the smartphone experiences a violent acceleration event,
indicating a probable collision, followed by a high-decibel acoustic event, such
as air bag deployment, a horn, or an impact noise. It is also possible to detect
an accident solely from an acceleration event, without a sound event, where the
acceleration value alone is so large that it exceeds the accident detection threshold
φ
≥ MT r
Mφ
.
Smartphone Traffic Accident Detection 11
The second scenario for accident detection occurs when the smartphone is
traveling inside of a vehicle that stops at an intersection, traffic light, or other
location. In this scenario, the algorithm attempts to detect if the user has exited
the car or is merely waiting for a light or traffic condition to change. The accident
detection algorithm uses the Mǫ distance threshold to keep the detection process
active below the threshold speed. As long as the smartphone does not travel more
than Mǫ feet from the last location the speed threshold was exceeded, the detection
algorithm assumes that the user is still inside the car. This extra condition allows
the algorithm to detect accidents that occur when the user’s car is struck by
another vehicle while stopped.
Accelerometers
record forces r
experienced in
Ca
collision
r
Ca
Car
Ca
r
The value for φ is set to the greatest acceleration event experienced in any direction
over the time span Sφ . If the current acceleration value is greater than φ, then φ
is updated to the most recent acceleration value.
12 J. White et al.
Our prior work [8] on accident detection was based solely on acceleration. It was
thus potentially susceptible to false positives at low speeds and thus required higher
settings for Mφ (higher values for Mφ , reduce the probability that low speed colli-
sions will be reported). In our accident detection model described in Section 3.2,
we added acoustic data analysis to improve lower speed collision detection and
reduce the probability of a false positive by listening for high decibel acoustic
events, such as impact noise, car horns, and air bag deployment. For example, air
bag deployment is accompanied by high-amplitude, short-duration noise that can
exceed 170dB at peak amplitude [30].
The WreckWatch formal model for accident detection uses built-in microphones
on a smartphone to detect high-decibel acoustic events indicative of an accident.
Using a secondary sensor in conjunction with acceleration attempts to lower the
probability of false positives. As discussed in Section 4.2, clipping of the audio
above 150 decibels and other potential noises (such as shouting) make it hard to
use sound alone to detect accidents. It is possible that this limitation could be
overcome, but we chose to make acoustic events a secondary filter for accident
detection that aids in reducing false positives.
The accident detection model γ relies on sampling the microphone to detect
accident noise. Given a stream of sound event decibel values denoted Ks, where
each value Ksi is recorded at TKsi , Ksnow is the most current value, and Tnow is
the current instant in time:
1 if Ksnow ≥ Mρ
ρ = 1 if ∃Ksi ∈ Ks, (Ksi ≥ Mρ ) (Tnow − TKsi ≤ Sρ ) (5)
V
0 otherwise
During any time span of Sρ milliseconds, if a decibel value exceeds the Mρ thresh-
old, then ρ is set to 1. Once ρ is set to 1, it will remain set as long as sound events
of greater than Mρ decibels are experienced every Sρ milliseconds.
Our future work will investigate dynamically adjusing the weight, α, applied
to the sound event during accident detection. For example, if the car radio is set
to a high volume level, ρ may remain continually set to 1. In this scenario, high
decibel sound is much less indicative of an accident and thus α should be set to a
low value.
Challenge 3 from Section 2.3 described the importance of replicating the situa-
tional awareness capabilities of in-vehicle accident detection and reporting systems.
WreckWatch uses a combination of imagery, voice communications, GPS localiza-
tion, and javascript object notation (JSON) web services to relay situational data
to first responders, as described below.
Citizen scientist imagery. In an emergency, WreckWatch allows bystanders
and uninjured victims to serve as “citizen scientists” [10] and report critical situ-
ational data to first responders. In particular, it allows bystanders and uninjured
Smartphone Traffic Accident Detection 13
Bystanders take
photos of first responder
r
Ca
accident
Snap! Ca
r
Car
Ca
Snap! r
Snap!
Photos are
aggregate on server
and streamed to
first responders
victims to take pictures using their smartphones and share them with first re-
sponders, as shown in Figure 6. Figures 7a and 7b show the client interface for
uploading pictures of victim injuries or the accident scene to the WreckWatch
server.
Emergency responders can access the uploaded images via mobile devices en
route or a standard web browser at an emergency response center. The Wreck-
Watch client provides mapping functionality through Google Maps on the device
to ensure that emergency responders can continuously receive information about
an accident to prepare them for whatever they encounter at the accident site. This
map also allows other motorists to route themselves around an accident, thereby
reducing congestion.
VOIP communication channels. The WreckWatch server uses digital portable
branch exchange (PBX) functionality to make/receive phone calls and provision
phone lines dynamically. It can therefore interact with emergency responders via
traditional circuit-switched networks and create accident information hotlines in
response to serious accidents via an Asterisk-based digital PBX running Linux. The
server can also be configured with emergency contacts to notify via text and/or
audio messages in the event of an accident. This data is configured at some time
prior to a collision event so the server need not interact with the client to notify
family or friends.
The PBX is built on Asterisk and connects to the server through a Java API.
The Android client and web client pull information from the server and can be
configured based on user needs. Due to the loose coupling and use of open stan-
dards between clients and server, additional clients for other platforms (such as
other smartphones or desktop applications) can be implemented without the need
14 J. White et al.
(a) Bystanders Can Upload Acci- (b) Client Application can View or
dent Images Upload Accident Images
to update the server. The WreckWatch server architecture also supports a hetero-
geneous group of clients, while providing appropriate qualities of service to each
device.
JSON emergency web services. The WreckWatch server is a web-based ser-
vice based entirely on freely-available APIs and open-source software. It is written
in Java and built using Jetty atop the Spring Framework. It utilizes a MySQL
database to store accident information and image meta-information. The server
communicates with the clients via a RESTful architecture over HTTP using cus-
tom XML (for the Android application) and JSON (for the web-based application).
All communication between the clients and the server is initiated by clients.
The server’s operations (such as accident information upload) are performed by
individual handlers that can be configured at runtime and are specified by parame-
ters in an HTTP request. This architecture enables the addition of new operations
and functionality without any software modifications or the need to recompile. All
configuration is handled by an XML file parsed during server startup.
Geolocation and mapping of accidents. When an accident occurs, the Wreck-
Watch client immediately reports certain accident characteristics to the server, in-
cluding the GPS location of the wreck. Each accident is geo-tagged on the server
with its location and entered into a searchable database of accidents. The acci-
dent locations are made available to first responders and other motorists through
a Google Maps interface.
To further enhance first responders’ understanding of the conditions leading
up to the accident the route driven by the vehicle in the 30 seconds leading up to
the crash is overlayed on top of the map. This route overlay allows first responders
to determine the direction of travel and possible cause of the collision. This infor-
Smartphone Traffic Accident Detection 15
mation allows the system to serve as a ”black box” and possibly help to indicate
areas where road improvement is needed.
turnover of hardware offers the potential to lower the average age of the hardware
in use for accident detection.
4. Smartphone situational awareness systems can be augmented through
cloud-based services. While onboard sensors are excellent for rapid accident
detection, they are typically limited in terms of processing and notification ca-
pabilities. Since Smartphones are connected to a data network they can access
cloud services to elastically extend their computational and/or storage capabil-
ities. Moreover, new data analysis services can be plugged into servers without
requiring complex upgrades of clients.
the acceleration on the phone below the Mφ G-force threshold needed for accident
detection. Although low-speed crashes are less life-threatening, they still create a
hazard to other motorists and should be reported. In future work, we are investi-
gating other approaches to improve low-speed accident detection.
Destruction of the smartphone may prevent accident notification deliv-
ery. To maximize the probability that an accident is reported, it is critical to prior-
itize data transmission. WreckWatch uses a two-stage process to report accidents.
First, the initial accident report is sent to the server using a small message that
can be delivered over UDP or HTTP. Any additional information, such as forces
of acceleration during the crash, is then transmitted immediately following the
transmission of critical data. WreckWatch uses this two-stage protocol to increase
the probability that the accident and crash diagnostic data is reported success-
fully. This two-stage protocol does not completely guarantee that a smartphone
will be able to transmit crash data if it is destroyed. We are actively researching
future approaches to improving notification success probabilities through the use
of ruggedized external cradles for smartphones.
Smartphone OS development companies control the software capabilities
of the sensor. For the forseeable future, a smartphone-based accident detection
system would run as an application deployed on top of a smartphone operating
system (OS). This approach implies that the software must operate within the
architectural limitations of the platform. One example is the lack of multi-tasking
on initial versions of the iPhone and on the new Windows Phone 7. A smartphone
user would likely not be willing to run an accident detection application every time
they enter their vehicle. Not only is this an issue for the initial development of such
a system, but once the system is developed major changes in the OS application
programming interface (API) would have the potential to cripple the entire system.
This problem also follows from the current trend of rapid updates to smartphone
OS APIs, i.e., if a developed accident detection system was not updated with
changes in the smartphone OS API it could become obsolete rapidly.
Production quality testing is hard. A key concern of a smartphone accident
detection system is the need to avoid false positives. When this need is combined
with the large degrees of freedom (e.g., speed, noise conditions, location of device,
etc.) in an accident it is hard to validate a developed smartphone based accident
detection system empirically. For this work to reach production quality reliability,
methods to test the operational effectiveness of accident detection systems must
be created.
4 Empirical Results
As described in Section 2.3, avoiding false positives is a key challenge when de-
tecting car accidents with smartphones. Although WreckWatch only activates the
accident detection system at speed, it is still possible that a driver or passenger
could drop their smartphone while the vehicle is in motion. The first experiment
was designed to determine if the acceleration component of WreckWatch’s acci-
dent detection system would be triggered by the phone falling inside the vehicle
or by emergency braking that did not result in a crash.
Hypothesis ⇒. Accidental falls or non-emergency braking would pro-
duce insufficient acceleration to trigger accident detection. We hypothesized
that the acceleration experienced by a smartphone when dropped would be sub-
stantially less than a car accident. We believed it would be hard to produce 4Gs
of force without dropping the phone from a substantial height (such as from a
multi-story building) or from a moving vehicle (such as a car on the highway).
We considered both situations to occur rarely enough that they did not warrant
experimentation.
Experiment setup. Since WreckWatch’s speed filtering only activates the ac-
cident detection system when the phone is in motion, our experiments were con-
ducted inside a vehicle. To analyze the potential for false positives from accel-
eration changes, we conducted two experiments designed to simulate events that
generate accelerations whose values could potentially be interpreted as car acci-
dents.
All experiments were performed on a Google ION device running the vendor
image of Android 1.5 on a 525 Mhz processor with 288 MB of RAM. The de-
vice was factory reset before loading WreckWatch and no additional third-party
applications were installed. WreckWatch recorded acceleration on three axes at
the highest possible rate and wrote these values to a CSV file on the SD card in
the device. This data was then downloaded to a Windows desktop computer for
analysis in Excel.
In all graphs, positive z-axis values indicate positive acceleration in the di-
rection from the battery cover toward the screen. Likewise, positive y-axis values
indicate positive acceleration in the direction from the USB connector toward the
smartphone speaker. Finally, positive x-axis values indicate positive acceleration
from left to right when looking at the device with the USB connector closest the
observer.
Empirical results. For the first test, the Android device was dropped from ear
height in the driver’s seat of a car. The device bounced off the seat and wedged
between the seat and center console. Figure 8a shows the acceleration on each axis
during the collision with the floor.
Using 9.8 m/s as an approximate value for Earth’s gravity, the device experi-
enced approximately 2G’s in each direction with nearly 3G’s on the x-axis before
coming to rest. The required acceleration to trigger airbag deployment is 60G’s [13,
1]. In addition to being ∼30 times smaller than required to deploy an airbag, this
value is well below the 4G’s used as a filter. It is therefore unlikely a smartphone
could be dropped in a manner that would exceed 4G’s. This data supports the use
of a filter (presented in Section 3.2) to prevent false positives.
A sudden stop is Another potential scenario that could potentially generate a
false positive. This test was performed in a vehicle by reaching a speed of approx-
Smartphone Traffic Accident Detection 19
imately 25 mph and engaging in a sudden stop. The test results are approximate
as the exact speed was unknown and braking pressure was not exact. Figure 8b
shows the acceleration experienced on each axis during the stop. As described in
Section 3.6, because the smartphone remained stationary relative to the vehicle,
it experienced the same forces as the vehicle. In this instance, the acceleration
experienced by the smartphone was actually less than that experienced during the
fall.
This result is attributed to the fact that although the stop was sudden and
forceful, the car (and consequently the smartphone) came to a rest over a period
of time that was longer than during the drop test. In other words, the change
in velocity was greater but the actual acceleration was less because the change
occurred over a longer period of time. Based on this data, it is unlikely for the
smartphone to experience 4G’s of acceleration simply due to a sudden stop.
false positives. The decibel measurements for each sound were recorded directly
by the phone rather than an external measurement device to directly measure the
accoustic inputs that would be received by the accident detection algorithm. The
road noises that we analyzed included:
1. Highway noise
2. The phone falling from ear height in a vehicle
3. Loud laughter
4. Shouting in an argument
5. Playing the radio at full volume and
6. Playing the radio at full volume with all windows down
Empirical results. The results of the experiment are shown in Figure 9, Figure
10 and Figure 11. The baseline readings were taken driving a 2006 four door Honda
Accord at speeds of 55-70 mph on an interstate highway with the radio playing at
1/3 of maximum volume. As shown in Figure 9 the maximum decibel level reached
for the baseline was 81 db.
Noise during transportation can dramatically increase, however, due to several
incidents, such as phone drops, laughing, shouting, playing the radio loudly, and
rolling down the windows. An effective solution must ensure that the device sound
processing capabilities can differentiate between these benign activities and the
noises associated with severe collisions, such as airbag deployment. Additional
experiments were executed to simulate these events.
First, we recorded the decibel level associated with dropping the device multiple
times form ear height. The results can be seen in Figure 9. Phone drops resulted
in a maximum decibel level of 103 db, considerably less than the 160-180 db
generated by an airbage deploying. We then measured the noise levels associated
with two people laughing loudly and two people having a shouting argument. As
shown in Figure 10, these activities resulted in a maximum noise level of 145 dBs.
Smartphone Traffic Accident Detection 21
We finally measured the noise generated by playing the radio at maximum volume
and driving with all windows down. These activities also generated noise levels of
145 dB as shown in Figure 11.
Based on these experiments, we determined that the ability for the device to
detect sound pressure levels greater than 145dB is limited due to signal clipping.
Using sound levels alone to determine if an accident has taken place could therefore
potentially lead to false positives as a result of normal benign activities. We use
this result to tune our accident detection model to rely on the accoustic signature
as a secondary indicator of accidents and improve detection at acceleration values
below our accelerometer threshold. For example, while the device reporting a noise
level of 145 dB could be the result of a shouting match, a reading of 145 db and
a reading of 3.5G’s of force by the accelerometer would likely indicate that an
accident occurred.
WreckWatch can potentially reconstruct an accident based solely on the data gath-
ered from the smartphone. Due to the smartphone’s presence in the vehicle during
an accident, the smartphone will usually experience the same forces at the same
time as the occupants and the vehicle itself. For example, ∼40% of cell phones are
carried in some form of pocket [17], in which case the device will likely experience
the same forces experienced by the person wearing the pocket.
Hypothesis ⇒ The accelerometer value would provide sufficient infor-
mation to reconstruct its movement during a crash. Due to the short time
period in which a crash takes place, it is possible that a smartphone would have
insufficient processing power and sensor sampling rates to capture enough data
to accurately model the movement of the phone. We hypothesized that modern
22 J. White et al.
(a) Radio Max Volume (b) Max Volume with Windows Down
smartphones have sufficient processing power and sensor sampling rates to aid in
accident reconstruction.
Experiment setup. To demonstrate this approach, we analyzed the data from
the two experiments conducted in Section 4.1 to determine if we could reconstruct
the orientation and movement of the smartphone.
Empirical results. The graph in Figure 12a shows it is possible to determine
that the smartphone was initially experiencing zero acceleration along the x-axis
indicating that the x-axis was perpendicular to the ground. This orientation is
consistent with holding the smartphone to the ear. While falling, the smartphone
tilted such the left edge of the smartphone (relative to the screen with the screen
facing away from the ground) was the closest edge to the sky and then flipped
again such that the left edge was closest to the ground. When Figures 12a, 12b,
and 12c are combined it is clear that the bottom of the smartphone made contact
first, followed by the left edge, and finally the back of the device.
Smartphone Traffic Accident Detection 23
The acceleration experienced during the sudden stop was actually less than
that experienced during the fall. Given what is known about the event, it is there-
fore possible to identify the orientation of the smartphone during the event. By
examining the graphs in Figure 13 it is possible to determine that the smartphone
was resting at an angle such that the top of the smartphone was higher than the
bottom of the smartphone. The decrease in acceleration along the z-axis is indica-
tive of the force induced on the device by the seat as the car came to a rest. Graphs
of other sudden stop events also have a similar appearance, as long as the device
remained stationary relative to the car.
These reconstruction capabilities can help accident investigators identify what
was experienced by the occupants of the vehicle and provide them with infor-
mation that an ADR/EDR simply cannot provide. This information can also be
combined with that present in the ADR/EDR to better understand the entire ac-
cident rather than simply the forces experienced by the vehicle itself. WreckWatch
gives investigators the capability to analyze a real-world accident in a manner
similar to the way they would a controlled collision involving crash-test dummies.
Although WreckWatch cannot provide investigators with all impact information
(e.g., the forces experienced at the ribs [15] or the pressure on the face [22]), it can
provide them with specific information about the overall force on the body and
how effectively the restraints protected the passenger.
5 Related Work
This section compares WreckWatch with related work on accident and traffic detec-
tion systems. Our comparison with related work is organized as follows: (1) intel-
ligent transportation systems, (2) traffic monitoring with cell phones, (3) mayday
systems, and (4) traffic and road monitoring monitoring sensor networks.
Intelligent transportation systems. The US Federal Communications Com-
mission (FCC) requires cell phones to provide emergency personnel with their lo-
cation. This mandate increases their viability as an accident-detection system by
ensuring that position data is not limited to advanced smartphones. Vehicle local-
ization [35] and rapid data acquisition are important to an Intelligent Transporta-
tion System (ITS), which utilizes sensor networks to monitor traffic conditions
and make adjustments to increase safety and reduce congestion on transportation
networks [33]. These systems count cars to determine speed and congestion, as well
24 J. White et al.
as detect ice build-up and other hazards [19]. An ITS is not limited to highway
traffic monitoring [4]. One major advantage of WreckWatch is that it could be
utilized as a subsystem to an ITS.
Traffic monitoring with cell phones. Related work has used cell phones to
construct a wireless mobile network for traffic-related applications. Traffic condi-
tions are often measured via loop detectors that count vehicles and determine their
speed. Since these loop detectors are typically embedded in the pavement there is
a high cost associated with their installation and maintenance [18]. Moreover, loop
detectors are often installed in main highways, limiting available information [28].
Cell phones have been tapped as a potential solution to both of these issues,
because they provide a substantially larger amount of information, and because
cell phone tracking could be available on most roads without installing specialized
detection hardware. WreckWatch is a step towards showing that cell phones are
an effective medium towards a wireless sensor network focused on automobile and
traffic information.
The European National Institute for Transport and Safety Research conducted
a study that used the volume of cell phones in range of a given cellular tower
to identify potential areas of congestion or accidents [18]. This work is similar
to WreckWatch in that it utilizes the cellular radios for the communication of
information. WreckWatch is unique in that it utilizes the Android platform’s sensor
APIs to detect wrecks on a vehicle by vehicle basis, rather than using aggregate
metrics. WrechWatch’s execution directly on the smartphone allows it to access
and utilize significantly more information about the device and user.
Mayday systems. Mayday systems provide voice connection to an emergency
assistance while automatically providing user location. Additional items that may-
day systems provide include remote door unlocking, remote engine diagnosis, theft
detection and tracking, automatic route guidance, travel information, and various
hands-free operations. Previous work [35] outlines the implications of location
awareness on cellular devices, and the effect that this awareness would have on
mayday systems.
The WreckWatch system could be extended to provide immediate voice capa-
bilities via integration with the Asterisk digital PBX. Given WreckWatch’s current
integration with the Asterisk PBX, this extension is not technically hard to pro-
totype. While remote diagnosis seems far-fetched, advances in automobile ECU
interfaces will likely make this possible in the future. With the increase in wireless
keys, remote door unlocking could be accomplished. If the phone has a wireless chip
at the correct frequency then it can simply broadcast the door (or engine) key com-
bination. If not, add-on smartphone sensor interfaces can be built to provide such
capability. Route guidance, travel information, and hands-free operations could be
easily added to the WreckWatch system by utilizing various Android APIs.
Other work [34] focuses on using the cellular features of OnStar together
with accident detection functionality to investigate potential correlations between
hands-free phone calls and car accidents. This work analyzed the proximity of calls
to the OnStar system to an airbag deployment notification. WreckWatch could be
extended to provide this information, and even more information by analyzing
behavior (such as texting, voice calls, Internet browsing or even gaming) prior to
an accident. Work to analyze the impact of distractions due to information sys-
tems (such as cell phones [31, 14]) has relied on imprecise analysis that could be
improved through the use of a system like WreckWatch that can not only detect
Smartphone Traffic Accident Detection 25
6 Concluding Remarks
Reducing the time between when an accident takes place and when it is detected
can reduce mortality rates by 6% [12]. Conventional in-vehicle accident detection
and notification systems, such as OnStar, are effective in reducing the time gap
before first responders are sent to the scene. These systems, however, are expensive
and not available in all vehicles.
To further increase the usage of automatic accident detection and notifica-
tion systems, smartphones can be used to indirectly detection accidents through
their onboard sensors, such as accelerometers. Many challenges must be overcome,
however, particularly the potential for false positives from accidentally dropped
phones. Due to the large volume of “phantom” (accidental) calls to emergency
services, reducing the false positive rate of smartphone accident detection is im-
portant.
Using a combination of context data, such as determining when a user is in-
side a vehicle, sensor data, such as accelerometer and acoustic information, and
intelligent sensor data filtering, accident detection systems can be created that are
resistant to false positives. For example, air bag deployment is only triggered at
over 60G’s of acceleration. As shown by experiments in Section 4, accelerations
above 4Gs are unlikely for dropped phones.
In developing and evaluating our prototype accident detection and notification
system, WreckWatch, we learned the following lessons:
• Accidents exert extreme forces on a phone that are unlikely to occur
when dropping it. The forces experienced during a car collision are extreme and
highly unlikely to occur in any other event other than a high-speed collision. These
events are therefore easier to identify and categorize accordingly. Moreover, by
combining the accident detection process with contextual information to determine
when the user is in a vehicle, false positives are less likely.
26 References
Acknowledgements This work was supported by a grant from the National Science Founda-
tion, RAPID:Collaborative Research:Cloud Environmental Analysis and Relief, CNS# 1047753.
References
1. National Highway Traffic Safety Administration. Federal Motor Vehicle Safety Standards:
Occupant Crash Protection - Supplemental Notice of Proposed Rulemaking, 1999.
2. National Highway Transportation Safety Administration. 2007 Traffic Safety Annual As-
sessment - Highlights. 2008.
3. M. Alsliety. How does SDR fit the telematics model?
4. M. AP TAYLOR. INTELLIGENT TRANSPORT SYSTEMS. Handbook of transport
systems and traffic control, page 461, 2001.
5. A. Askland. Double Edged Sword That Is the Event Data Recorder, The. Temp. J. Sci.
Tech. & Envtl. L., 25:1, 2006.
6. A. Blandford and BL William Wong. Situation awareness in emergency medical dispatch.
International Journal of Human-Computer Studies, 61(4):421–452, 2004.
References 27
7. H.R. Champion, J. Augenstein, A.J. Blatt, B. Cushing, K. Digges, J.H. Siegel, and M.C.
Flanigan. Automatic crash notification and the URGENCY algorithm: Its history, value,
and use. Advanced Emergency Nursing Journal, 26(2):143, 2004.
8. Chris Thompson and Jules White and Brian Dougherty and Adam Albright and Douglas
C. Schmidt. Using Smartphones and Wireless Mobile Networks to Detect Car Accidents
and Provide Situational Awareness to Emergency Responders. In Third International
ICST Conference on MOBILe Wireless MiddleWARE, Operating Systems, and Applica-
tions (Mobilware 2010), June 30-July 2, 2010, Chicago, IL.
9. A. Cohen and L. Einav. The effects of mandatory seat belt laws on driving behavior and
traffic fatalities. Review of Economics and Statistics, 85(4):828–843, 2003.
10. J.P. Cohn. Citizen science: can volunteers do real research? BioScience, 58(3):192–197,
2008.
11. M.R. Endsley. Toward a theory of situation awareness in dynamic systems. Human
Factors: The Journal of the Human Factors and Ergonomics Society, 37(1):32–64, 1995.
12. W. Evanco. The Impact of Rapid Incident Detection on Freeway Accident Fatalities.
Mitretek Systems, Inc., WN96W0000071, 1996.
13. B. Fildes, S. Newstead, JS Barnes, and AP Morris. Airbag effectiveness in real world
crashes, 2001.
14. P. Green. Crashes induced by driver information systems and what can be done to reduce
them. In SAE CONFERENCE PROCEEDINGS P, pages 27–36. SAE; 1999, 2000.
15. L. Groesch, G. Netzer, and L. Kassing. Dummy for car crash testing, October 20 1987.
US Patent 4,701,132.
16. J. Harrald and T. Jefferson. Shared situational awareness in emergency management
mitigation and response. In System Sciences, 2007. HICSS 2007. 40th Annual Hawaii
International Conference on, page 23. IEEE, 2007.
17. F. Ichikawa, J. Chipchase, and R. Grignani. Where’s the phone? a study of mobile phone
location in public spaces. In Proc. IEE Mobility Conference 2005. Citeseer, 2005.
18. W. D. Jones. Forecasting Traffic Flow. IEEE Spectrum, 2001.
19. A.N. Knaian. A wireless sensor network for smart roadbeds and intelligent transportation
systems. PhD thesis, Citeseer, 2000.
20. A. Lenhart. Teens and mobile phones over the past five years: Pew Internet looks back.
Pew Internet & American Life Project, 2009.
21. A. Lie, C. Tingvall, M. Krafft, and A. Kullgren. The effectiveness of electronic stability
control (ESC) in reducing real life crashes and injuries. Traffic Injury Prevention, 7(1):38–
43, 2006.
22. H. Mellander, S. Nilsson, C.Y. Warner, M.G. Wille, and M. Koch. Load-sensing faceform
for crash dummy instrumentation, September 8 1987. US Patent 4,691,556.
23. P. Mohan, V.N. Padmanabhan, and R. Ramjee. Nericell: Rich monitoring of road and
traffic conditions using mobile smartphones. In Proceedings of the 6th ACM conference
on Embedded network sensor systems, pages 323–336. ACM New York, NY, USA, 2008.
24. R.S. Naunheim, J. Standeven, C. Richter, and L.M. Lewis. Comparison of impact data in
hockey, football, and soccer. The Journal of Trauma, 48(5):938, 2000.
25. W.I.S. Query. Reporting System (WISQARS). National Center for Injury Prevention and
Control, Centers for Disease Control and Prevention (producer). Available from: URL:
www. cdc. gov/ncipc/wisqars.
26. S. Rauscher, G. Messner, P. Baur, J. Augenstein, K. Digges, E. Perdeck, G. Bahouth, and
O. Pieske. Enhanced Automatic Collision Notification System- Improved Rescue Care
Due To Injury Prediction- First Field Experience, 2009.
27. Mikael Rickns. Idg news service. http://www.infoworld.com/d/mobilize/
android-big-winner-smartphone-sales-increase-50-percent-710, August 2010.
28. G. Rose. Mobile phones as traffic probes: practices, prospects and issues. Transport
Reviews, 26(3):275–291, 2006.
29. R. Sampson. Misuse and Abuse of 911, 2000.
30. J.E. Saunders, W.H. Slattery III, and W.M. Luxford. Automobile airbag impulse noise:
Otologic symptoms in six patients*. Otolaryngology-Head and Neck Surgery, 118(2):228–
234, 1998.
31. P. Trbovich and J.L. Harbluk. Cell phone communication and driver visual behavior:
The impact of cognitive distraction. In CHI’03 extended abstracts on Human factors in
computing systems, page 729. ACM, 2003.
32. M. Verma, R. Lange, and D. McGarry. A Study Of US Crash Statistics From Automated
Crash Notification Data, 2007.
28 References
=2