Validation and Strategies To Improve The Hydro-Est
Validation and Strategies To Improve The Hydro-Est
Validation and Strategies To Improve The Hydro-Est
net/publication/262159912
CITATIONS READS
4 96
6 authors, including:
Some of the authors of this publication are also working on these related projects:
All content following this page was uploaded by Nazario D. Ramirez-Beltran on 13 January 2015.
ROBERT J. KULIGOWSKI
NOAA/NESDIS Center for Satellite Applications and Research (STAR)
Camp Springs, MD 20746
U.S.A.
ERIC W. HARMSEN
Department of Agricultural and Biosystems Engineering
University of Puerto Rico
P.O. Box 9030, Mayagüez, PR 00681
U.S.A.
JOAN M. CASTRO
Department of Computer and Electrical Engineering
University of Puerto Rico
P.O. Box 9030, Mayagüez, PR 00681
U.S.A
SANDRA CRUZ-POL
Department of Computer and Electrical Engineering
University of Puerto Rico
P.O. Box 9040, Mayagüez, PR 00681
U.S.A
MELVIN J. CARDONA-SOTO
Department of Computer and Electrical Engineering
University of Puerto Rico
P.O. Box 9030, Mayagüez, PR 00681
U.S.A
Abstract - Validation of the Hydro-Estimator (HE) and the Next Generation Radar (NEXRAD) during heavy storms over
Puerto Rico (PR) is reported. The HE is a high resolution rainfall retrieval algorithm based on satellite and numerical
whether prediction model data. The accuracy of the HE and the NEXRAD rainfall estimates can be measured by
decomposing the rainfall process in sequences of discrete (rain / no rain) and continuous (rainfall rate) random variables.
Validation results are based on five heavy storms that seriously impacted human life and the economy of PR during the
period 2003 to 2005. The average discrete validation results indicate acceptable hit rate values for both the HE and
NEXRAD (0.76 vs. 0.87) and reasonable discrete bias ratios (1.04 vs. 0.73) but a very low of probability of detection of
rain for both the HE and NEXRAD (0.36 vs. 0.52). The HE shows an average overestimation whereas the NEXRAD
exhibits underestimation in the continuous validation results (continuous bias ratio of 1.14 vs 0.70 for NEXRAD), which
contributes to moderate overall errors for the HE and NEXRAD in terms of root mean squared error (2.14 mm vs. 1.66
mm) and mean absolute error (0.96 mm vs. 0.77 mm).
The HE algorithm was designed to operate over US continental areas and satisfactory results have been reported.
However, over tropical regions it was determined that warm clouds can generate substantial rainfall amounts that are not
detected by the HE algorithm. Infrared band differencing techniques are using to explore the possibility of improving the
detection of warm-cloud rain events over PR. We are also classifying clouds based on Geostationary Operational
Environmental Satellite (GOES) Imager data in a manner that will lead to improved relationships between infrared
brightness temperatures and rainfall rates.
Key-words - validation, NEXRAD, Hydro-Estimator, retrieval algorithm, rain rate, GOES, brightness temperature.
water and mean-layer relative humidity for the lowest third 2. Data collection
of the model vertical domain. Another adjustment Puerto Rico has a rain gauge network that collects rainfall
enhances rainfall rates in regions where the convective measurements every 5, 10, 15, 30 or 45 minutes and
equilibrium level temperature is relatively high; i.e., includes 125 rain gauges with data available since January
regions where very cold cloud tops are not 2000. Since the majority of gauges collect rainfall every
thermodynamically possible but where strong updrafts and 15 minutes a computer program was designed to derive
heavy rainfall can still occur. Finally, low-level winds and HE and NEXRAD 15 minutes resolution. The rain gauge
digital topography are combined to produce enhancements data are used to perform validation of the HE and the
of rainfall rates in upslope regions and reductions in NEXRAD. The data set used for validation includes five
downslope regions, using a technique described in Vicente heavy storms that have been impacted PR: Three can be
et al. [8]. characterized as a cold front and two as tropical storms.
The HE has been the operational satellite rainfall NEXRAD data over Puerto Rico come from a
algorithm of the National Environmental Satellite, Data, WSR-88D unit located in Cayey (18.12°N, 66.08°W,
and Information Service (NESDIS) since 2002 and 886.63 m elevation). The radar frequency is 2.7 GHz and
produces rainfall estimates at the full spatial and temporal the maximum horizontal range is 462.5 km, and the radar
resolution of GOES over the CONUS and surrounding scans the entire island every 6 minutes. The NOAA
regions, including PR; real-time estimates are also National Severe Storms Laboratory (NSSL) conducted a
produced on an experimental basis for the rest of the significant effort to make possible an affordable
globe. However, validation of the Hydro-Estimator has nationwide operational capture, distribution, and archiving
generally focused on the CONUS (e.g., [1] and [9]) and of Level II NEXRAD data [10]. Unfortunately, for Puerto
has not been performed over Puerto Rico, and given the Rico the Level II data are available only until 2003 with a
differences in topography and climate of Puerto Rico significant amount of missing data in that last year [11].
relative to the CONUS, previous validation efforts may not The NWS did resume archiving level II data for PR during
necessarily be relevant to users in PR. Furthermore, the summer of 2007. On the other hand, Level III data for
validation of the HE over PR may illuminate opportunities PR are available continuously since 2000 [12], so the
to enhance the algorithm for application over PR. Level III data were selected to perform validation since the
Validation of the rainfall retrieval algorithm most recent and catastrophic floods over PR occurred after
consists of comparing the rainfall estimates with 2002. The scanning angle for reflectivity data was
corresponding observations (rain gauges in this study). selected as 0.5 degrees for this research in order to avoid
The accuracy of rainfall estimates can be measured by beam overshoot over western PR. Fig. 1 shows the
decomposing the rainfall process as sequences of discrete location of the radar and the spatial distribution of the rain
and continuous random variables; i.e., the presence or gauges.
absence of rainfall events (discrete variable) and the
amount of rainfall (continuous variable). The occurrence
of rainfall events in a given area and at a particular time
follows a Bernoulli process and consequently the
estimation accuracy of rainfall events can be conducted by
analyzing a contingency table. The typical scores that
measure the accuracy of categorical forecasts are: hit rate
(H), probability of detection (POD), false-alarm rate
(FAR), and discrete bias (DB). The continuous validation
strategy consists of comparing the amount of rainfall that
occurred at specific area in a particular time and the
continuous measurements of accuracy are: mean absolute FIG. 1. Location of rain gauges (stars) and NEXRAD
error (MAE), root mean squared error (RMSE), and (black dot on Region I) in PR. Black dots in Region III are
continuous bias (CB). small and high resolution radar that will be used to derive
The second section of this paper describes the data the bias correction factor for NEXRAD. The radii of the
collection process and source of information. The third circles are 35 km and 90 km.
section describes the conventional statistical techniques to
perform validation. The fourth section presents validation As mentioned in the Introduction, the HE uses
results during heavy storms over PR, and includes a satellite IR window (10.7 µm) data and numerical whether
comparison for rain gauges versus HE and rain gauges prediction data to estimate rainfall over the CONUS and
versus NEXRAD. The fifth section presents some PR every 15 minutes at 4 km spatial resolution, and they
strategies for algorithm improvements. The sixth section are available for the entire period of interest. In order to
presents some conclusions. ensure consistency among these data sets during the
20 April 2005 Rain Gauge where Yi is the total rainfall recorded by all 125 rain
Yes No gauges across the island or the closest HE or radar pixels
Hydro-Estimator Yes 310 395
No 1039 8522
at the i th time.
DB, with values ranging from 0.16-0.26 for the April-May correspond with convective cloud tops that are above the
storms and 1.68-2.42 for the November-December events. tropopause (i.e. overshooting tops), ([14 and [15]).
The lower CB relative to the DB for the April-May storms Convective clouds with positive differences indicate the
suggests that the HE is underestimating the conditional possibility of warm-top convection. We will also explore
rainfall rates in addition to the spatial extent of the rainfall, the use of the reflected portion of the 3.9-µm GOES band
while the opposite is happening for the November- 2 during the daytime to indicate the presence large cloud-
December events. The NEXRAD has nearly no top particles that suggest rain in warm-top clouds [2].
continuous bias for two storms and a strong dry bias for
three (0.41-0.68), albeit with no apparent seasonal pattern
like the HE. As a result, both the mean absolute error and RG and HE Cumulated Rainfall
90
root mean squared error of the HE are also higher than that 80
Rain Gauges
Hydroestimator
of NEXRAD.
70
60
Table 4. Continuous validation scores for the Hydro-
Estimator and NEXRAD. 50
mm
a) 17 19-21 11-18 5 20 Avg. 40
5. Algorithm improvements
5.1 Rainfall detection
As stated previously, the HE uses GOES brightness
temperatures (Tb) from channel 4 (10.7 µm) to
discriminate raining from non-raining events [1]. During
the validation exercise we noted that there are some warm-
top convective events that are not detected by the HE. The
HE generally produces little or no rainfall for brightness
temperatures exceeding 235K; however, there are
numerous events in PR where the HE largely failed to FIG. 3. GOES-12 brightness temperature from
detect significant rainfall. For instance, Fig. 2 shows the
channel 4 (Nov. 14, 2006).
observed accumulated rainfall for all gauges located in PR
(red line) and the accumulated rainfall by the
5.2 Improving rain rate estimates
corresponding HE pixels (blue line) on November 14,
The rainfall retrieval procedure of the HE is also mainly
2006. The horizontal axes shows the time every 15
based on the relationship between the brightness
minutes and the vertical axis exhibits the accumulated
temperature (10.7 µm) and observed rain rate. Estimation
rainfall in mm. Fig. 3 shows the distribution of brightness
of the amount of rainfall may be improved by classifying
temperatures over the GOES pixels corresponding to
the brightness temperature patterns (BTP) with the
gauge locations during this storm and there are few pixels
below 235 K; a comparison with Fig. 2 indicates that the corresponding rain formation processes. The following
channels will be used to classify the BTP with the
poor detection by the HE was at least in part because it
corresponding rain process. Channel 1 (0.65 µm) will be
was not calibrated to produce rainfall from relatively warm
used to classify the events according to the cloud optical
clouds. In order to improve the detection skill of the HE,
thickness. The reflected portion of channel 2 (3.9 µm)
we plan to examine the differences in brightness
temperature between 10.7 µm and the water vapor band during the daytime will be used as an indirect
measurement of the cloud drop size distribution,
(6.5 µm in GOES-12). Positive values of the WV-infrared
thermodynamic phase, and particle shape [16]. Channel 4
window temperature difference have been shown to
ISBN: 978-960-6766-83-1 804 ISSN: 1790-2769
12th WSEAS International Conference on SYSTEMS, Heraklion, Greece, July 22-24, 2008
(10.7 µm) will be used to classify the rainfall events the HE for PR; specifically, the algorithm proposed by
according to temperature. The infrared band differencing Ramirez-Beltran et al. [17] will be implemented to
will also be used to develop the classification algorithm. improve the HE rainfall detection and the equation that
The difference between the 10.7-µm brightness relates brightness temperatures with rain rates.
temperature and 3.9-µm will be useful to determine
whether a cloud top is composed of liquid water or ice. As 7 Acknowledgements.
stated previously, the IR-WV difference (6.5–10.7 µm) is
usually negative; however, convective clouds with positive This research has been supported by NOAA-CREST grant
differences have likely already begun to precipitate, number NA17AE1625, the NSF-ERC-CASA with a grant
especially in tropical atmospheres that support warm top Number 0313747, NOAA-NWS grant number
convection. The 13.3–10.7 µm differencing technique is NA06NWS468001, and also by the University of Puerto
used to characterize and delineate cumulus clouds. This Rico at Mayagüez. The authors appreciate and recognize
research will focus on convective clouds, and the funding support from these institutions.
consequently, the factors to be consider for the
classification of BTP and rain types are: area, depth, References
duration, and updraft velocity.
A variable selection algorithm will be used to [1] Scofield, R.A., and R.J. Kuligowski, 2003: Status and
identify the variables that best explain the rainfall outlook of operational satellite precipitation
variability, and the selected variables will be used to algorithms for extreme-precipitation events. Wea.
develop the training patterns for a self-organized artificial Forecasting, 18, 1037-1051.
neural network [17]. A self-organized artificial neural [2] Ba, M. B., and A. Gruber, 2000: GOES Multispectral
network will be used to identify a set of homogenous Rainfall Algorithm (GMSRA). J. Appl. Meteor., 40,
groups that reveal similarities within the member of a 1500-1514.
class, but different among the classes. The Kohonen [3] Kuligowski, R.J., 2002: A Self-Calibrating real-time
learning rule will be used to determining the optimal GOES rainfall algorithm for short-term rainfall
weights of the artificial neural network ([18], [19], and estimates. J. Hydrometeor., 3, 112-130.
[20]). A successful application was reported [21] to [4] Palmeira, F. L. B., C. A. Morales, G. B. França, and L.
identify the spatial variability of soil to select the Landau, 2004: Rainfall estimation using satellite
appropriate model to estimate soil moisture.
data for Paraíba do Sul Basin (Brazil). The XX th
ISPRS International Society for Photogrammetry
6 Summary and conclusions and Remote Sensing Congress, Istanbul, Turkey -
The HE is a high resolution satellite rainfall retrieval Commission 7.
algorithm run operationally by NOAA/NESDIS that [5] Kidd, C., Kniveton, D.R., Todd, M.C., Bellerby, T.J.,
provides estimates of rainfall every 15 minutes at 4-km 2003: Satellite Rainfall Estimation Using
resolution over the CONUS and nearby areas including Combined Passive Microwave and Infrared
PR. (Global estimates are also produced in real time on an Algorithms. J. Hydrometeor., 4, 1088-1104.
experimental basis.) The rain rates are primarily derived [6] Sorooshian, S., K.-L. Hsu, X. Gao, H. V. Gupta, B.
from GOES 10.7-µm brightness temperatures and then Imam, and D. Braithwaite, 2000: An evaluation of
adjusted using parameters derived from a numerical PERSIANN system satellite-based estimates of
weather prediction model. The HE estimates should be tropical rainfall. Bull. Amer. Meteor. Soc., 81,
especially useful over regions of complex topography such 2035-2046.
as western PR because of the difficulties associated with [7] Joyce, R.J., J. E. Janowiak, P.A. Arkin, and P. Xie,
radar in those regions such as beam block. However, for 2004: CMORPH: A method that produces global
the very small sample of heavy rainfall events examined in precipitation estimates from passive microwave
this paper, NEXRAD clearly outperforms the HE, perhaps and infrared data at high spatial and temporal
in part because of most of the rainfall events were located resolution. J. Hydrometeor., 5, 487-503.
in the central and eastern parts of the island where the [8] Vicente, G. A., J. C. Davenport, and R. A. Scofield,
radar data will be most reliable. Specifically, the HE 2001: The role of orographic and parallax
underestimates both the number of rainfall events and the corrections on real time high resolution satellite
amounts of rainfall, whereas NEXRAD is nearly unbiased rainfall rate distribution. Int. J. Remote Sens., 23,
in these respects. The HE algorithm does exhibit a 221-230.
satisfactory hit rate, but a very low probability of detection [9] Ebert, E. E., J. E. Janowiak, and C. Kidd, 2007:
and a large false alarm rate that is surprisingly higher than Comparison of near-real-time precipitation
that of NEXRAD despite the dry bias of the HE. A estimates from satellite observations and
research effort is undergone to improve the performance of
ISBN: 978-960-6766-83-1 805 ISSN: 1790-2769
12th WSEAS International Conference on SYSTEMS, Heraklion, Greece, July 22-24, 2008