IEEE ICC 2016 Communication and Information Systems Security Symposium

$'HWHFWLRQ0HWKRGIRUD1RYHO''R6$WWDFNDJDLQVW
6'1&RQWUROOHUVE\9DVW1HZ/RZ7UDIILF)ORZV


3LQJ'RQJ Member, IEEE;LDRMLDQJ'XSenior Member, IEEE+RQJNH=KDQJ7RQJ;X


6FKRRORI(OHFWURQLFDQG,QIRUPDWLRQ(QJLQHHULQJ%HLMLQJ-LDRWRQJ8QLYHUVLW\%HLMLQJ&KLQD

'HSDUWPHQWRI&RPSXWHUDQG,QIRUPDWLRQ6FLHQFHV7HPSOH8QLYHUVLW\3KLODGHOSKLD3$86$
SGRQJ#EMWXHGXFQ[MGX#WHPSOHHGX


Abstract²$ 'LVWULEXWHG 'HQLDO RI 6HUYLFH ''R6 DWWDFN DJDLQVW )LUVW LW LV GLIILFXOW IRU HDFK RI WKH VZLWFKHV WR GHWHFW WKH
FRQWUROOHUVLVRQHRIWKHNH\VHFXULW\WKUHDWVRI6RIWZDUH'HILQHG1HWZRUNLQJ PDOLFLRXVIORZV,QLWLDOO\7KHDWWDFNHUVPD\ORFDWHLQGLIIHUHQW
6'1 7KH EUHDNGRZQ RI D FRQWUROOHU PD\ GLVUXSW D ZKROH 6'1 QHWZRUN VXEQHWV WKDW FRQQHFW WR GLIIHUHQW VZLWFKHV VR WKDW WKH WUDIILF
1RZDGD\VDQRYHO''R6PHDQVLVWKDWWKHDWWDFNHUVPD\JHQHUDWHYDVWQHZ
ORZWUDIILF IORZV WR WULJJHU PDOLFLRXV IORRGLQJ UHTXHVWV WR RYHUORDG WKH SDVVLQJHDFKVZLWFKPD\EHORZ$GGLWLRQDOO\QRPDWWHUKRZ
FRQWUROOHUV,WLVGLIILFXOWWRSUHYHQWWKLVDWWDFNDVWKHDWWDFNHUVPD\FRQQHFWWR KHDY\WKHWUDIILFRIDQHZIORZLVRQO\WKHILUVWIHZSDFNHWVRI
DQ\LQWHUIDFHRIDQ\VZLWFKLQDQ6'1QHWZRUN,QWKLVSDSHUZHSURSRVHDQ WKH IORZ ZLOO EH HQFDSVXODWHG LQ WKH SDFNHWLQ PHVVDJHV DQG
HIIHFWLYHGHWHFWLRQPHWKRGZKLFKLVGHVLJQHGWRGHWHFWWKH''R6DWWDFNDQG VHQWWRWKHFRQWUROOHU7KXVWKHDWWDFNHUVZLOOSUHIHUWRXVHORZ
WR IXUWKHU ORFDWH WKH FRPSURPLVHG LQWHUIDFHV WKH PDOLFLRXV DWWDFNHUV KDYH WUDIILFIORZVWRWULJJHUWKHDWWDFN
FRQQHFWHG:HILUVWFODVVLI\WKHIORZHYHQWVDVVRFLDWHGZLWKDQLQWHUIDFHWKHQ
PDNH D GHFLVLRQ XVLQJ 6HTXHQWLDO 3UREDELOLW\ 5DWLR 7HVW 6357 ZKLFK KDV 6HFRQGLWLVGLIILFXOWIRUDFRQWUROOHUWRMXGJHZKHWKHULWLV
ERXQGHGIDOVHQHJDWLYHDQGIDOVHSRVLWLYHHUURUUDWHV,QDGGLWLRQZHHYDOXDWH XQGHU D ''26 DWWDFN EDVHG RQO\ RQ WKH QXPEHU RI LQFRPLQJ
WKH SHUIRUPDQFH RI WKH SURSRVHG PHWKRG XVLQJ '$53$ ,QWUXVLRQ 'HWHFWLRQ
'DWD6HWV:HDOVRGLVFXVVDQGFRPSDUHRXUPHWKRGWRWKUHHRWKHUGHWHFWLRQ TXHULHV VLQFH D IORRGLQJ RI TXHULHV PD\ UHVXOW IURP EXUVW
PHWKRGVZKLFKDUHEDVHGRQWKHSHUFHQWDJHFRXQWDQGHQWURS\RIWKHIORZV QRQPDOLFLRXVIORZV
UHVSHFWLYHO\ DQG GHPRQVWUDWH WKH VXSHULRULW\ RI RXU PHWKRG LQ WHUPV RI
SURPSWQHVVYHUVDWLOLW\DQGDFFXUDF\ 7KLUG WKLV DWWDFN LV D NLQG RI UHIOHFWLRQEDVHG IORRGLQJ LQ
ZKLFKWKHDWWDFNHUVGRQRWVHQGWKHPDOLFLRXVIORZVGLUHFWO\WR
Keywords—DDoS; detection; SDN; controller; D FRQWUROOHU ,QVWHDG WKH DWWDFNHUV PD\ JHQHUDWH WKH IORZV
EDVHGRQDQ\SURWRFRO7&38'3HWDOWRWULJJHUWKHDWWDFN
DJDLQVWDFRQWUROOHU7KHVSHFLDOPHWKRGOHDGVWRVRPHVSHFLILF
, ,1752'8&7,21
IHDWXUHV WKDW GLIIHU IURP WKRVH RI WKH NQRZQ ''R6 DWWDFNV
6RIWZDUHGHILQHGQHWZRUNLQJ6'1VHSDUDWHVDQHWZRUN¶V VXFK DV ,&03 IORRG 7&3 6<1 IORRG DQG +773 IORRG >@
FRQWURO ORJLF IURP LWV XQGHUO\LQJ VZLWFKHV VLPSOLILHV QHWZRUN &RUUHVSRQGLQJO\ H[LVWLQJ GHWHFWLRQ DQG GHIHQVH PHFKDQLVPV
PDQDJHPHQWDQGIDFLOLWDWHVQHWZRUNHYROXWLRQ7KHVHVSHFLILF >@DUHQRWIXOO\DSSOLFDEOHWRWKLVDWWDFN
FDSDELOLWLHV PDNH 6'1 GHSOR\DEOH LQ PDQ\ QHWZRUN
HQYLURQPHQWV IURP KRPH DQG HQWHUSULVH QHWZRUNV WR GDWD 6HYHUDO UHFHQW SDSHUV >@ >@ SRLQWHG RXW WKDW WKH 6'1
FHQWHUVLQFORXGQHWZRUNV FRQWUROOHULVDYXOQHUDEOHWDUJHWRI''R6DWWDFNVDQGVXJJHVWHG
SROLFLQJ SDFNHWV GHVWLQHG WR WKH FRQWUROOHU ' .RWDQL >@
7KHZLGHYDULHW\RIXVHFDVHVPDNH6'1VHFXULW\DVHULRXV LQWURGXFHGDSDFNHWLQILOWHULQJPHFKDQLVPWRSURWHFWWKH6'1
FRQFHUQ>@2XWRIDOONQRZQ6'1H[SORLWV'LVWULEXWHG'HQLDO FRQWURO SODQH 7KH PHFKDQLVP UHFRUGV WKH YDOXHV RI SDFNHW
RI6HUYLFH''R6ZKLFKRYHUORDGVWKHFHQWUDOL]HGFRQWUROOHUV KHDGHU ILHOGV EHIRUH VHQGLQJ SDFNHWLQ PHVVDJHV WKHQ ILOWHUV
LVDQ6'1VSHFLILFDWWDFN>@DQGRQHRIWKHPRVWVHYHUHWKUHDWV RXW SDFNHWV WKDW KDYH WKH VDPH YDOXHV DV WKH UHFRUGHG RQHV
WR 6'1 EHFDXVH LWV DELOLW\ WR EUHDN GRZQ D FRQWUROOHU FDQ +RZHYHU LI WKH PDOLFLRXV DWWDFNHUV JHQHUDWH QHZ IORZV LQ
GLVUXSWDZKROHQHWZRUN ZKLFKWKHSDFNHWVKDYHGLIIHUHQWYDOXHVIURPWKHUHFRUGHGRQHV
2SHQ)ORZ >@ LV D SURWRFRO WKDW VWDQGDUGL]HV KRZ 6'1 WKH SURSRVHG PHFKDQLVP ZLOO EHFRPH LQHIIHFWLYH 6 0
VZLWFKHVFRPPXQLFDWHZLWKDQ6'1FRQWUROOHU,Q2SHQ)ORZ 0RXVDYL >@ SURSRVHG DQ HDUO\ GHWHFWLRQ PHWKRG IRU WKH
WKH VZLWFKHV ZLOO W\SLFDOO\ DVN D FRQWUROOHU XVLQJ SDFNHWLQ ''R6DWWDFNVDJDLQVWWKH6'1FRQWUROOHU7KHPHWKRGLVEDVHG
PHVVDJHVWRREWDLQQHZIORZUXOHVIRUDQ\GDWDIORZVWKH\GR RQ WKH HQWURS\ YDULDWLRQ RI WKH GDWD IORZV¶ GHVWLQDWLRQ ,3
QRW NQRZ KRZ WR KDQGOH +RZHYHU D QRYHO ''R6 DWWDFN LV DGGUHVVHV ,W DVVXPHV WKDW WKH GHVWLQDWLRQ ,3 DGGUHVVHV DUH
VXFKWKDWZLWKDODUJHYROXPHRIQHZGDWDIORZVJHQHUDWHGE\ DOPRVW HYHQO\ GLVWULEXWHG LQ WKH QRUPDO IORZV ZKLOH WKH
WKH PDOLFLRXV DWWDFNHUV PDQ\ SDFNHWLQ PHVVDJHV PD\ EH PDOLFLRXV IORZV DUH GHVWLQHG WR D VPDOO DPRXQW RI KRVWV
JHQHUDWHG E\ WKH VZLWFKHV DQG DJJUHVVLYHO\ VHQW WR WKH +RZHYHU LW LV QRW GLIILFXOW IRU WKH PDOLFLRXV DWWDFNHUV WR
FRQWUROOHUZKLFKPD\H[KDXVWWKHUHVRXUFHVRUHYHQOHDGWRD JHQHUDWHORWVRIQHZORZWUDIILFIORZVZLWKWKHLUGHVWLQDWLRQ,3
IDLOXUHRIWKHFRQWUROOHU>@ DGGUHVVHVHYHQO\GLVWULEXWHGWRRYHUORDGWKHFRQWUROOHUV

7KLVQRYHO''R6DWWDFNDJDLQVW6'1FRQWUROOHUVKDVVRPH ,QWKLVSDSHUZHSURSRVHDQHIIHFWLYHGHWHFWLRQPHWKRGIRU
VSHFLILF IHDWXUHV DQG FDQ KDUGO\ EH GHWHFWHG E\ WKH WUDGLWLRQDO WKH QRYHO ''R6 DWWDFN DJDLQVW 6'1 FRQWUROOHUV E\ YDVW QHZ
''R6GHIHQVHPHWKRGV ORZWUDIILFIORZV2XUPHWKRGKDVWKHIROORZLQJDGYDQWDJHV

978-1-4799-6664-6/16/$31.00 ©2016 IEEE

 ''R6'HWHFWLRQ RIDUDQGRPYDULDEOH F ZKLFKLVDIORZHYHQWFRUUHVSRQGLQJ
)ORZ 3DFNHWV ,QWHUIDFH
)ORZ 3DFNHWV ,QWHUIDFH WR WKH VHTXHQFH RI IORZV xbi LQMHFWHG LQWR DQ LQWHUIDFH i RI DQ
&RQWUROOHU ĂĂ ĂĂ ĂĂ
6'1VZLWFK:HOHW Fbi  LIIORZ xbi LVORZWUDIILFDQG Fbi  
&RQWURO3ODQH 4XHULHV
RWKHUZLVH $ FRPSURPLVHG LQWHUIDFH GLIIHUV IURP D QRUPDO
'DWD3ODQH LQWHUIDFHLQWHUPVRIWKHTXDQWLW\RILQFRPLQJORZWUDIILFIORZV
8VHU6XEQHW 8VHU6XEQHW
6ZLWFK
'DWD 6ZLWFK 6SHFLILFDOO\DFRPSURPLVHGLQWHUIDFHKDVDKLJKHUSUREDELOLW\
)ORZV
RIEHLQJLQMHFWHGLQWRORZWUDIILFIORZVWKDQDQRUPDOLQWHUIDFH
6ZLWFK 6ZLWFK )RUPDOO\
6ZLWFK
8VHU6XEQHW
Pr  Fbi  _ H  ! Pr  Fbi  _ H  
8VHU6XEQHW
8VHU6XEQHW

 ZKHUH H LV WKH K\SRWKHVLV GHQRWLQJ WKDW WKH LQWHUIDFH i LV

)LJ1HWZRUNPRGHO FRPSURPLVHGDQG H  LVWKHK\SRWKHVLVGHQRWLQJWKHLQWHUIDFH
LVQRUPDO
3URPSWQHVV%HQHILWWLQJIURPWKH6HTXHQWLDO3UREDELOLW\
5DWLR 7HVW 6357 ZKLFK LV D SRZHUIXO VWDWLVWLFDO WRRO WKH :H DLP WR GHWHFW ZKHWKHU DQ LQWHUIDFH i KDV EHHQ
SURSRVHGPHWKRGFDQTXLFNO\GHWHFWWKHFRPSURPLVHGLQWHUIDFH FRPSURPLVHG
DIWHU RQO\ D VPDOO QXPEHU RI VXFFHVVLYH REVHUYDWLRQV RI ORZ
,QWKHGHWHFWLRQZHDVVXPHWKDWHDFKVZLWFKLVFDSDEOHRI
WUDIILFIORZV
REWDLQLQJWKHVWDWLVWLFVLQIRUPDWLRQRIWKHLQFRPLQJIORZVDQG
 9HUVDWLOLW\ 7KH SURSRVHG PHWKRG FDQ GHWHFW WKH ''R6 UHSRUWLQJ LW WR WKH FRQWUROOHU 7KLV FDQ EH DFKLHYHG XVLQJ
DWWDFNV DJDLQVW WKH 6'1 FRQWUROOHUV QR PDWWHU KRZ WKH VHYHUDO PHWKRGV )LUVW 2SHQ)ORZ LWVHOI FDQ PRQLWRU SHUSRUW
PDOLFLRXVIORZVDUHJHQHUDWHG7KDWLVRXUPHWKRGFDQGHWHFW DQG SHUUXOH E\WH DQG SDFNHW FRXQWHUV 6HFRQG 1HW)ORZ >@
WKHPDOLFLRXVDWWDFNVWULJJHUHGE\7&3IORRG,&03IORRGRU SURYLGHV D ZD\ WR FROOHFW SHUIORZ VWDWLVWLFV LQ VZLWFKHV DQG
HYHQVRPHXQNQRZQPHDQVOHDGLQJWRWKHIORRGLQJRIUHTXHVWV VHQGV WKH IORZ UHFRUGV WR D FROOHFWRU 1HW)ORZ FKHFNV WKH
WRDQ6'1FRQWUROOHU KHDGHU ILHOGV RI HDFK SDFNHW WR VHH LI WKH SDFNHW PDWFKHV DQ
H[LVWLQJ IORZ 7KLUG V)ORZ >@ FDQ HVWLPDWH WKH E\WH DQG
$FFXUDF\7KHSURSRVHGPHWKRGFDQGLVWLQJXLVKQRUPDO SDFNHW FRXQWV RI IORZV E\ IHWFKLQJ UHDOWLPH SDFNHW VDPSOHV
EXUVW WUDIILF IURP PDOLFLRXV IORZV DQG PDNH PRUH DFFXUDWH IURP VZLWFKHV V)ORZ FDSWXUHV RQH SDFNHW RXW RI HYHU\ N
GHFLVLRQV WKDQ WKH GHWHFWLRQ PHWKRGV EDVHG RQ SHUFHQWDJH SDFNHWV DQG VHQGV WKH KHDGHU RI WKH VDPSOHG SDFNHW WR D
FRXQWDQGHQWURS\RIWKHGDWDIORZV FHQWUDOFROOHFWRUIRUIORZVWDWLVWLFV:HDVVXPHG WKDWWKH IORZ
7KH UHPDLQGHU RI WKLV SDSHU LV RUJDQL]HG DV IROORZV 7KH VWDWLVWLFVZLOOSDVVRXU''R6GHWHFWLRQPRGXOHVUXQQLQJRQWKH
QHWZRUN PRGHO IRU RXU SURSRVHG PHWKRG DQG VRPH QHWZRUN QRUWKERXQGLQWHUIDFHRIWKHFRQWUROOHU
DVVXPSWLRQVDUHVWDWHGLQ6HFWLRQ,,7KHGHWDLOVRIRXUPHWKRG ,Q DGGLWLRQ LW LV UHDVRQDEOH WKDW DWWDFNHUV WHQG WR JHQHUDWH
LQ WHUPV RI IORZ FODVVLILFDWLRQ DQG DWWDFN GHWHFWLRQ DUH YDVW QHZ ORZWUDIILF IORZV WR ODXQFK DQ DWWDFN LQ DQ 6'1
GHVFULEHG LQ 6HFWLRQ ,,, ([SHULPHQWDO HYDOXDWLRQV DQG QHWZRUN EHFDXVH  2QO\ YDVW SDFNHWLQ PHVVDJHV PD\
GLVFXVVLRQV DUH SURYLGHG LQ 6HFWLRQ ,9 IROORZHG E\ WKH FRQJHVWDFRQWUROOHU2QO\QHZIORZVFDQWULJJHUSDFNHWLQ
FRQFOXVLRQ PHVVDJHV WRZDUGV D FRQWUROOHU  2QO\ ORZWUDIILF IORZV DUH
RIKLJKHIILFLHQF\IRUVXFKDQDWWDFN$IORZZLWKKHDY\WUDIILF
,, 352%/(0)2508/$7,21 FDQQRW HQKDQFH DQ DWWDFN 2Q WKH FRQWUDU\ LW ZLOO FRQVXPH
,QWKLVVHFWLRQZHILUVWVWDWHWKH''R6GHWHFWLRQSUREOHPLQ PRUH RI WKH DWWDFNHU¶V UHVRXUFHV WKDQ D IORZ ZLWK ORZ WUDIILF
WKH 6'1 QHWZRUN ,Q SDUWLFXODU ZH IRUPXODWH WKH QHWZRUN EHFDXVH QR PDOLFLRXV SDFNHWLQ PHVVDJHV ZLOO EH JHQHUDWHG
PRGHOIRURXUSURSRVHGPHWKRG7KHQZHGHVFULEHWKHQHWZRUN DIWHUWKHGHOLYHU\RIDFRUUHVSRQGLQJIORZUXOH
DVVXPSWLRQV DQG WKH DWWDFNHU PRGHOV WKDW ZH XVH WR HYDOXDWH
RXUPHWKRG ,,, '(7(&7,21%$6('216357
)LJ  LOOXVWUDWHV WKH ORJLFDO YLHZ RI WKH QHWZRUN PRGHO 2XU PHWKRG LV FRPSULVHG RI D IORZ FODVVLILFDWLRQ IXQFWLRQ
6LQFHD''R6DWWDFNFRXOGFRPHIURPDQ\RIWKHLQWHUIDFHVRI DQG DQ DWWDFN GHWHFWLRQ IXQFWLRQ ,Q WKLV VHFWLRQ ZH GHVFULEH
DQ\ VZLWFK RXU JRDO LV WR GHWHFW WKH DWWDFN DQG ORFDWH WKH WKHVHIXQFWLRQVLQGHWDLO
SRWHQWLDOLQWHUIDFHVWKDWDUHFRPSURPLVHG
A. Flow Classification
:HGHILQHDQLQWHUIDFHRIDQ6'1VZLWFKDVa compromised
interfaceLILWLVFRQQHFWHGE\WKHPDOLFLRXV''R6DWWDFNHUVRU 7KHIORZFODVVLILFDWLRQIXQFWLRQFODVVLILHVWKHGDWDIORZVLQ
KLMDFNHG]RPELHV0DQ\QHZORZWUDIILFIORZVDUHOLNHO\WREH WKH QHWZRUN $ GDWD IORZ LV FRQVLGHUHG WR EH HLWKHU D normal
LQMHFWHG LQWR WKH FRPSURPLVHG LQWHUIDFHV E\ WKH PDOLFLRXV flow RU D low-traffic flow 8SRQ UHFHLYLQJ D VWDWLVWLF UHSRUW
DWWDFNHUV DQG ]RPELHV ZLWK WKH SXUSRVH RI WULJJHULQJ D KLJK DERXW D GDWD IORZ WKH IORZ FODVVLILFDWLRQ IXQFWLRQ PDNHV WKH
YROXPHRIVZLWFKWRFRQWUROOHUPHVVDJHVWRRYHUORDGWKH6'1 GLVWLQFWLRQ
FRQWUROOHU
/HW cbi EH WKH SDFNHW FRXQWV RI IORZ xbi  /HW CPD[ EH WKH
i
:HGHILQH F IRU b  DVWKHVXFFHVVLYHREVHUYDWLRQV
b WKUHVKROGWRFODVVLI\DIORZ7KHQDIORZHYHQW Fbi LVGHILQHG
DVD%HUQRXOOLUDQGRPYDULDEOH 3U  Fbi  H     3U  Fbi  H   O 
­ LIc d CPD[
i
Fbi 3U  Fbi  H    3U  Fbi  H  O 
b
® 
¯ LIc ! CPD[
i
b

ZKHUH O ! O EHFDXVHDFRPSULVHGLQWHUIDFHLVPRUHOLNHO\WR
7KH YDOXH RI CPD[ FDQ EH REWDLQHG DQG UHFDOLEUDWHG E\
EH LQMHFWHG LQWR WKH ORZWUDIILF IORZV WR RYHUORDG DQ 6'1
WUDLQLQJ SURFHVVHV )RU H[DPSOH DQ RIIOLQH SURFHVV FDQ
FRQWUROOHU
UHFDOLEUDWH CPD[ LIWKHWUDIILFFKDUDFWHULVWLFVFKDQJH
,QWXLWLYHO\ RXU 6357EDVHG GHWHFWLRQ PHWKRG FDQ EH
,QDQ6'1QHWZRUNWKHPDWFKILHOGV>@RIHDFKIORZWDEOH FRQVLGHUHG DV D RQHGLPHQVLRQDO UDQGRP ZDON :KHQ D ORZ
HQWU\ FRQVLVW RI WKH SDFNHW KHDGHUV WKH LQJUHVV SRUW DQG WUDIILF IORZ  cbi d CPD[  LV REVHUYHG WKH IORZ HYHQW Fbi  
RSWLRQDOO\ RWKHU ILHOGV 'XH WR WKH JOREDO SHUVSHFWLYH DQG
FHQWUDOL]HGFRQWURORI6'1WKHIORZFODVVLILFDWLRQIXQFWLRQFDQ RFFXUV DQG WKH ZDON PRYHV XSZDUG RQH VWHS :KHQ D QRUPDO
DGDSWLYHO\FODVVLI\GDWDIORZVDFFRUGLQJWRWKHPDWFKILHOGVLQ IORZ cbi ! CPD[ LVREVHUYHGWKHIORZHYHQW Fbi  RFFXUVDQG
WKHIORZWDEOHV WKHZDONPRYHVGRZQZDUGRQHVWHS$FFRUGLQJWR(T
DQGZHJHW
$IWHU WKH FODVVLILFDWLRQ RI D IORZ WKH IORZ FODVVLILFDWLRQ
IXQFWLRQUHSRUWVWKHUHVXOWWRWKHDWWDFNGHWHFWLRQIXQFWLRQ
­ i 3U  Fbi  H  
° n 
D   LIcbi d CPD[
B. Attack Detection Based on SPRT ° 3U bF i
 H 
Dni ®
7KHDWWDFNGHWHFWLRQIXQFWLRQDQDO\]HVWKHOLVWRIREVHUYHG
° i 3U  Fb  H  
i

HYHQWV normal flows DQG low-traffic flows) WR GHFLGHZKHWKHU ° Dn   3U F i  H  LIcb ! CPD[
i

DQLQWHUIDFHLVFRPSURPLVHG ¯  b   
,QUHDOLW\DGHWHFWLRQIXQFWLRQFDQPDNHWZRW\SHVRIHUURUV ­ i O
° Dn   OQ O  LIcb d CPD[
i
IDOVHSRVLWLYHDQGIDOVHQHJDWLYH$VGHVFULEHGLQ6HFWLRQ,,ZH ° 
FRQVLGHU H DV D GHWHFWLRQ RI D FRPSURPLVHG LQWHUIDFH DQG ®
H  DVDQRUPDOLW\)DOVHSRVLWLYHPHDQVWKHDFFHSWDQFHRI H  ° D  OQ  O  LIc i ! C
i 
°̄ n    O
b PD[

ZKHQ H  LVWUXHZKLOHIDOVHQHJDWLYHPHDQVWKHDFFHSWDQFHRI
H  ZKHQ H LVWUXH7RDYRLGWKHVHWZRHUURUVZHGHILQH D  ZKHUH Di  
DQG E DVWKHXVHUVSHFLILHGSUREDELOLWLHVRIIDOVHSRVLWLYHDQG :H WKHQ GHILQH WKH GHWHFWLRQ IXQFWLRQ IRU WHVWLQJ D
IDOVH QHJDWLYH UHVSHFWLYHO\ 7KH HUURU UDWHV RI WKH GHVLJQHG FRPSURPLVHG LQWHUIDFH DJDLQVW D QRUPDO LQWHUIDFH DV IROORZV
GHWHFWLRQ IXQFWLRQ VKRXOG QRW H[FHHG D DQG E IRU IDOVH JLYHQWZRERXQGDULHV B DQG A ZKHUH B  A RQWKHEDVLVRI
SRVLWLYHDQGIDOVHQHJDWLYHUHVSHFWLYHO\ WKH ORJSUREDELOLW\ UDWLR Dnt  WKH 6357 IRU H  DJDLQVW H LV
7R GHVLJQ DQ HIIHFWLYH GHWHFWLRQ PHWKRG WKDW PHHWV WKH JLYHQDVIROORZV
UHTXLUHPHQWV ZH DGRSW 6357 D SRZHUIXO VWDWLVWLFDO WRRO WR Dni d B DFFHSW H  DQGWHUPLQDWHWKHWHVW
HYDOXDWH LQWHUIDFH i IURP WKH n REVHUYHG IORZ HYHQWV
Fbi  b  n  :H GHILQH Dni DV DQ HYDOXDWLRQ RI LQWHUIDFH Dni t A DFFHSW H DQGWHUPLQDWHWKHWHVW
i ¶V EHKDYLRU E\ WKH GHWHFWLRQ IXQFWLRQ /HW Dni EH WKH ORJ
B  Dni  A  FRQWLQXH WKH WHVW SURFHVV ZLWK DQ DGGLWLRQDO
SUREDELOLW\UDWLRFRQVLGHULQJDOO n normal flowDQGlow-traffic
REVHUYDWLRQ
flow HYHQWVQRWHGIRULQWHUIDFH i 8SRQUHFHLYLQJDQHYHQW Fbi 
IURP WKH IORZ FODVVLILFDWLRQ IXQFWLRQ WKH GHWHFWLRQ IXQFWLRQ ,W LV VXJJHVWHG LQ >@ WKDW WKH YDOXHV RI A DQG B DUH
HYDOXDWHV UHDVRQDEOHWREHVHWWR
­ A E D 
3U  Fi   Fni H  ® 
Dni OQ
3U  Fi   Fni H  
 ¯ B E  D
)URP WKH DERYH HTXDWLRQV ZH FDQ FRQFOXGH WKDW IRXU
$VVXPH WKDW HDFK IORZ HYHQW Fbi LV LQGHSHQGHQW DQG SDUDPHWHUV D  E  O DQG O DUHUHTXLUHGE\WKH6357EDVHG
LGHQWLFDOO\GLVWULEXWHGWKHQZHKDYH GHWHFWLRQ PHWKRG $PRQJ WKHP D DQG E OLPLW WKH IDOVH
3 bn  3U  Fbi H  3U  Fbi H 
n
SRVLWLYH HUURU UDWH DQG IDOVH QHJDWLYH HUURU UDWH UHVSHFWLYHO\
Dni OQ
3 bn  3U  Fbi H  
¦ OQ
b  3U  Fbi H  
 DQG JLYH WZR ERXQGDULHV  A DQG B  RI WKH RQHGLPHQVLRQDO
UDQGRP ZDON O DQG O DUH WKH SUREDELOLW\ GLVWULEXWLRQ
SDUDPHWHUV IRU WKH IORZ HYHQWV DQG DIIHFW WKH QXPEHU RI
6LQFH Fbi LVD%HUQRXOOLUDQGRPYDULDEOHOHW REVHUYDWLRQV UHTXLUHG IRU WKH GHWHFWLRQ IXQFWLRQ WR UHDFK D
GHFLVLRQHLWKHU H  RU H 
 
7UDLQLQJGDWDZLWKRXWDWWDFN

3URSRUWLRQLQDOOWKHGDWDIORZV
7UDLQLQJGDWDZLWKDWWDFNV
  D   

1XPEHURIVXFFHVVLYHREVHUYDWLRQ
O 
E  
 O 
 
 O



O 


   
 
O

       
7LPH 
)LJ3URSRUWLRQRIWKHORZWUDIILFIORZVLQDOOWKHIORZVIRUWKHWUDLQLQJGDWD  
 
ZLWKRXWDWWDFN0DUFKWKDQGZLWKDWWDFN0DUFKWKUHVSHFWLYHO\ O DQG  
   
O DUHHVWLPDWHG  
O O

7$%/(, '(6&5,37,2162)620(2)7+($77$&.67+$70$<
29(5/2$'7+(6'1&21752//(56
)LJ7KHPLQLPXPQXPEHURIVXFFHVVLYHREVHUYDWLRQVRIORZWUDIILFIORZV
IRUGHWHFWLQJDFRPSURPLVHGLQWHUIDFH
$WWDFNV 'HVFULSWLRQV
:LWKRXW ORVV RI JHQHUDOLW\ WKH WKUHVKROG ZDV VHW WR 
QHSWXQH $6<1IORRGRQRQHRUPRUH7&3SRUWV SDFNHWV WKH SDFNHW FRXQW RID QRUPDO 7&3 ZD\ KDQGVKDNH
,&03UHTXHVWVZLWKWKHYLFWLP
VVSRRIHGVRXUFH,3DUH 7KH SDFNHWV ZLWK WKH VDPH IRXUWXSOH LH VRXUFH ,3 VRXUFH
VPXUI SRUW GHVWLQDWLRQ ,3 GHVWLQDWLRQ SRUW ZHUH FRQVLGHUHG WR
EURDGFDVWWRDQHWZRUNWRFUHDWHDUHSO\IORRGWRWKHYLFWLP
LSVZHHS
$VXUYHLOODQFHVZHHSVHQGLQJ,&03UHTXHVWVWRQXPHURXV,3 EHORQJ WR WKH VDPH IORZ 7KH FRPPXQLFDWLRQV EHWZHHQ WKH
DGGUHVVHVWRGHWHFWZKLFKQRGHVDUHOLVWHQLQJRQDQHWZRUN DGMDFHQWLQWHUIDFHVZHUHILOWHUHGEHFDXVHWKH\ZRXOGQRWWULJJHU
$VXUYHLOODQFHVZHHSWKDWVFDQVQXPHURXVSRUWVWRGHWHFW SDFNHWLQPHVVDJHVWRZDUGVWKHFRQWUROOHUV
SRUWVZHHS
ZKLFKVHUYLFHVDUHRSHQRQDVLQJOHRUPXOWLSOHQRGHV
)LJ  LOOXVWUDWHV WKH HVWLPDWLRQ RI O DQG O  $V )LJ 
,9 (9$/8$7,21$1'',6&866,21 VKRZV WKH FKDUDFWHUV RI WKH IORZV ZHUH VLPLODU ZKHQ WKHUH
ZHUH QR ''R6 DWWDFNV RQ ERWK GD\V 0DUFK WK DQG 0DUFK
:HFKRVHWRXVH'$53$,QWUXVLRQ'HWHFWLRQ'DWD6HWVWR WK+RZHYHURQ0DUFKWKWZRDWWDFNVQDPHG³QHSWXQH´
HYDOXDWH RXU SURSRVHG PHWKRG DV WKH\ FRQWDLQ ERWK WUDLQLQJ DQG³LSVZHHS´OLVWHGLQ7$%/(,RFFXUUHGDWDQG
GDWDZLWKRXWZLWKDWWDFNVDQGWHVWLQJGDWDZLWKDEXQGDQWW\SHV  UHVSHFWLYHO\ 7KHVH DWWDFNV OHDG WR YDVW QHZ ORZ
RI DWWDFNV >@ LH  DWWDFN LQVWDQFHV RIDERXW W\SHV RI WUDIILF IORZV WKDW FRXOG RYHUORDG WKH FRQWUROOHU $FFRUGLQJO\
DWWDFNV ZH DVVLJQHG WKH PHDQ YDOXH DQG WKHXSSHUERXQGDU\ YDOXH RI
WKH QRUPDO SURSRUWLRQ RI WKH ORZWUDIILF IORZV WR O DQG O 
A. Parameters of the Method
UHVSHFWLYHO\7KXVZHJRW O  DQG O  
$V PHQWLRQHG LQ 6HFWLRQ ,, RXU 6357EDVHG PHWKRG
UHTXLUHV IRXU XVHUGHILQHG SDUDPHWHUV D  E  O  DQG O  ,Q WKH QH[W VHFWLRQ ZH ZLOO GLVFXVV KRZ WKH YDOXHV RI O 
$PRQJWKHP D DQG E DUHQRUPDOO\VPDOOYDOXHVOLPLWLQJWKH DQG O DIIHFWWKHSHUIRUPDQFHRIRXU6357EDVHGPHWKRG
GHVLUHG IDOVH SRVLWLYH DQG IDOVH QHJDWLYH UDWHV ZKLFK DUH
XVXDOO\ EHWZHHQ  DQG  DQG FDQ EH VSHFLILHG E\ WKH B. Promptness
XVHUVRIWKHGHWHFWLRQDSSURDFK:HVHW D  DQG E  
3URPSWQHVV LV DQ LPSRUWDQW SURSHUW\ RI RXU 6357EDVHG
LQWKHHYDOXDWLRQ ''R6 GHWHFWLRQ PHWKRG $V ZH OHDUQ IURP )LJ  D ODUJH
O DQG O VKRXOG LQGLFDWH WKH SUREDELOLWLHV WKDW D ORZ YROXPH RI ORZWUDIILF IORZV ZLOO EH LQMHFWHG LQWR D
FRPSURPLVHG LQWHUIDFH ZKHQ D ''R6 DWWDFN RFFXUV 7KLV
WUDIILF IORZ SDVVHV WKURXJK D QRUPDO LQWHUIDFH DQG D VHFWLRQ HYDOXDWHV WKH PLQLPXP QXPEHU RI VXFFHVVLYH
FRPSURPLVHGLQWHUIDFHUHVSHFWLYHO\7KXVLWLVUHDVRQDEOHIRU REVHUYDWLRQV RI ORZWUDIILF IORZV WR GHWHFW D FRPSURPLVHG
XV WR HVWLPDWH O DQG O XVLQJ WKH WUDLQLQJ GDWD ZLWKRXW DQG LQWHUIDFHZKHQ H LVWUXH
ZLWKDWWDFNVUHVSHFWLYHO\7KH³RXWVLGHWFSGXPSGDWD´ZKLFK
SURYLGHVH[WHQVLYHH[DPSOHVRIDWWDFNVDQGEDFNJURXQGWUDIILF 7R LOOXVWUDWH WKH PLQLPXP QXPEHU RI VXFFHVVLYH
ZDVXVHGLQRXUHYDOXDWLRQ7KHGDWDSURYLGHVDOOGDWDSDFNHWV REVHUYDWLRQVUHTXLUHGWRGHWHFWDFRPSURPLVHGLQWHUIDFH)LJ
WUDQVPLWWHGEHWZHHQWKHQRGHVLQVLGHDQGRXWVLGHRIDQHWZRUN VKRZVWKHQXPEHURIREVHUYDWLRQVDVDIXQFWLRQRI O DQG O 
:HFODVVLILHGWKHIORZVE\FRXQWLQJWKHQXPEHURISDFNHWV $V PHQWLRQHG LQ WKH SUHYLRXV VXEVHFWLRQ ZH VHW WKH IDOVH
LQ HDFK IORZ ,I WKH SDFNHW FRXQW RI D IORZ ZDV EHORZ D SRVLWLYHUDWH D  DQGWKHIDOVHQHJDWLYHUDWH E  $V
GHVLJQDWHG WKUHVKROG WKH IORZ LQ TXHVWLRQ ZDV FODVVLILHG DV D VKRZQLQ)LJLWRQO\WDNHVVHYHUDOREVHUYDWLRQVIRU6357WR
ORZWUDIILFIORZ2WKHUZLVHLWZDVFODVVLILHGDVDQRUPDOIORZ PDNHDGHFLVLRQ%DVLFDOO\WKHJUHDWHUWKHGLIIHUHQFHEHWZHHQ
$IWHUZDUGV ZH FDOFXODWHG WKH SURSRUWLRQ RI WKH ORZWUDIILF O DQG O  D VPDOOHU VXFFHVVLYH QXPEHU RI REVHUYDWLRQV LV
IORZVLQDOOWKHIORZVWRHVWLPDWH O DQG O  UHTXLUHGIRURXUPHWKRGWRUHDFKDGHWHFWLRQ
 $V WKH '$53$ ,QWUXVLRQ 'HWHFWLRQ 'DWD 6HWV JDYH XV 


7RWDOQXPEHU
O  DQG O  LQ RXU HYDOXDWLRQ RXU PHWKRG FDQ 



TXLFNO\ GHWHFW D FRPSURPLVHG LQWHUIDFH DIWHU RQO\ VL[ 

VXFFHVVLYHREVHUYDWLRQVRIORZWUDIILFIORZV 
      
:HRQO\VKRZWKHPLQLPXPQXPEHURIUHTXLUHGVXFFHVVLYH D7KHQXPEHURIWRWDOIORZV

REVHUYDWLRQV LQ WKH DERYH GLVFXVVLRQ 7KHUH LV D VLPLODU WUHQG SRG SRUWVZHHS VPXUI DSDFKH FUDVKLLV XGSVWRUP

$WWDFNV
IRU WKH DYHUDJH QXPEHU RI UHTXLUHG REVHUYDWLRQV ZKHQ H LV SRG DSDFKH SRG QHSWXQH GRVQXNH
WUXH V\VORJG

      
E$WWDFNVDFWXDOO\RFFXUUHG
C. Versatility 

'HWHFWHG
:HHYDOXDWHGWKHYHUVDWLOLW\RIRXUPHWKRGE\VXEPLWWLQJLW
WR WKH GDWD WUDFHV ZLWK PDOLFLRXV WUDIILF LQ WKH '$53$ 
,QWUXVLRQ'HWHFWLRQ'DWD6HWV       
F'HWHFWHGDWWDFNVE\RXUPHWKRG
6LQFH ZH DVVXPH WKDW D IORZ UXOH FRUUHVSRQGV WR D IRXU  

'HWHFWHG
WKUHVKROG 
WXSOH WKH DWWDFNV OLVWHG LQ 7$%/( , PD\ RYHUORDG DQ 6'1
WKUHVKROG 
FRQWUROOHU 1RWDEO\ WKHVH DWWDFNV FDQ ZRUN DW GLIIHUHQW OD\HUV 
DQGKDYHGLIIHUHQWSULQFLSOHV)RUH[DPSOH³QHSWXQH´ZRNVDW       
WKH WUDQVSRUW OD\HU DQG LV D W\SLFDO GHQLDORIVHUYLFH DWWDFN G'HWHFWHGDWWDFNVE\WKHSHUFHQWDJHEDVHGPHWKRG
 
ZKLOH³LSVZHHS´ZRNVDWWKHQHWZRUNOD\HUDQGLVQRWXVXDOO\

'HWHFWHG
WKUHVKROG 
FRQVLGHUHG D GHQLDORIVHUYLFH DWWDFN +RZHYHU WKH NH\ WKUHVKROG 
FKDUDFWHULVWLF WKH\ VKDUH LV WKH DELOLW\ WR JHQHUDWH PDQ\ QHZ 
      
IORZVZKLFKPD\OHDGWRWKHRYHUORDGLQJRIDQ6'1FRQWUROOHU H'HWHFWHGDWWDFNVE\WKHHQWURS\EDVHGPHWKRG
7LPH
1RWHWKDWWKHH[WHQWRIGDPDJHDQDWWDFNFDQFDXVHGHSHQGV 
RQWKHPDWFKILHOGVRIIORZUXOHV)RUH[DPSOH³QHSWXQH´FDQ )LJD7KHQXPEHURIWRWDOIORZVE$WWDFNVDFWXDOO\RFFXUUHGF'HWHFWHG
RYHUORDG D FRQWUROOHU ZKHQ DIORZ UXOH FRUUHVSRQGV WR D IRXU DWWDFNVE\RXUPHWKRGG'HWHFWHGDWWDFNVE\WKHSHUFHQWDJHEDVHGPHWKRGH
WXSOHEXWFDQKDUGO\RYHUORDGWKHFRQWUROOHUZKHQDIORZUXOH 'HWHFWHGDWWDFNVE\WKHHQWURS\EDVHGPHWKRG
RQO\ FRUUHVSRQGV WR WKH GHVWLQDWLRQ ,3 DGGUHVV RI D IORZ 2XU
IORZ FODVVLILFDWLRQ IXQFWLRQ FDQ DGDSWLYHO\ FODVVLI\ WKH IORZV D WKUHVKROG YDOXH IRU WKH VLQJOH SDUDPHWHU RI 3' $ VPDOO
DFFRUGLQJWRWKHPDWFKILHOGVRIIORZUXOHV WKUHVKROGYDOXHPD\UHVXOWLQWKHIDOVHSRVLWLYHHUURUVZKLOHD
ODUJHWKUHVKROGYDOXHPD\UHVXOWLQWKHIDOVHQHJDWLYHHUURUV
)LJDVKRZVWKHQXPEHURIWRWDOIORZVRQ$SULOWK)LJ
EVKRZVDOOWKHGHQLDORIVHUYLFHDWWDFNVDQGD³SRUWVZHHS´ z &'&'IDFHVWKHVLPLODUSUREOHPVWR3'WKDWLVLWLV
DWWDFN XVHG LQ WKH GDWDVHWV LQ FKURQRORJLFDO RUGHU $OWKRXJK DOVR FKDOOHQJLQJ WR VHOHFW DQ DSSURSULDWH WKUHVKROG YDOXH IRU
WUDGLWLRQDO DWWDFN FODVVLILFDWLRQ PHWKRGV GR QRW UHJDUG &'
³SRUWVZHHS´DVD''R6DWWDFNLWPD\EHXVHGWRJHQHUDWHYDVW z ('$QLQWHUIDFHLVFRQVLGHUHGWREHFRPSURPLVHGLIWKH
ORZWUDIILF IORZV DQG IXUWKHU WULJJHU WKH ''R6 DWWDFNV WR HQWURS\ RI WKH IORZV¶ GHVWLQDWLRQ DGGUHVVHV LV ORZHU WKDQ D
RYHUORDG WKH 6'1 FRQWUROOHUV ,Q DGGLWLRQ WR ³SRUWVZHHS´ WKUHVKROG $V ZH VWDWH LQ 6HFWLRQ , IDOVH QHJDWLYH HUURUV PD\
³VPXUI´ DQG ³QHSWXQH´ ODXQFKHG ''R6 DWWDFNV DJDLQVW WKH RFFXU LI WKH DWWDFNHUV JHQHUDWH YDVW QHZ IORZV ZLWK WKH
6'1FRQWUROOHUVRQ$SULOWK$V)LJFVKRZVRXUPHWKRG GHVWLQDWLRQ ,3 DGGUHVVHV HYHQO\ GLVWULEXWHG $W WKH VDPH WLPH
VXFFHVVXOOI\ GHWHFWHG DOO WKUHH RI WKHVH DWWDFNV HYHQ WKRXJK IDOVH SRVLWLYH HUURUV PD\ RFFXU LI WKHGHVWLQDWLRQ ,3 DGGUHVVHV
WKH\ ZRUN DW GLIIHUHQW SURWRFRO OD\HUV DQG KDYH GLIIHUHQW RIWKHQRUPDOIORZVDUHQRWHYHQO\GLVWULEXWHG
SULQFLSOHV$GGLWLRQDOO\WKHUHSRUWVUHWXUQQHLWKHUIDOVHSRVLWLYH
HUURUVQRU IDOVH QHJDWLYH HUURUV IRU WKH DWWDFNVZLWKRXW D ODUJH :H HYDOXDWHG WKH SHUIRUPDQFH RI 3' DQG (' XVLQJ WKH
YROXPHRIORZWUDIILFIORZV VDPHGDWDWUDFHWRFRPSDUHZLWKRXUPHWKRG)RUFRPSDULVRQ
ZH ILUVW GLYLGHG WKH GDWDVHWV LQWR PLQLWLPHVORWV 7KH PLQL
D. Accuracy Comparison and Discussion WLPHVORWFDQEHUHJDUGHGDVWKHKDUGWLPHRXWWLPHUIRUWKHIORZ
HQWULHV DV ZHOO DV WKH GHWHFWLRQ SHULRG RI RXU PHWKRG $ KDUG
)RU FRPSDULVRQ ZH GLVFXVV WKUHH GLIIHUHQW PHWKRGV LQ WLPHRXW WLPHU LV WKH GXUDWLRQ DIWHU ZKLFK D IORZ HQWU\ LV
GHWHFWLQJWKH''R6DWWDFNVZKLFKDUHEDVHGRQWKHSHUFHQWDJH UHPRYHGIURPWKHIORZWDEOHLQDQ6'1VZLWFK
RI ORZWUDIILF IORZV WKH QXPEHU RI ORZWUDIILF IORZV DQG WKH
HQWURS\YDULDWLRQRIGHVWLQDWLRQ,3DGGUHVVHVUHVSHFWLYHO\)RU 1RWHWKDWLWLVQRWQHFHVVDU\IRURXU6357EDVHGPHWKRGWR
VLPSOLFLW\ZHUHIHUWRWKHPDVWKHSHUFHQWDJHEDVHGGHWHFWLRQ GLYLGHWKHGDWDVHWVLQWRPLQLWLPHVORWVEHFDXVHWKHPHWKRGFDQ
3' WKH FRXQWEDVHG GHWHFWLRQ &' DQG WKH HQWURS\EDVHG REVHUYHFRQWLQXRXVO\XQWLOLWUHDFKHVDGHFLVLRQ,QFRQWUDVWDQ
GHWHFWLRQ('7KH\DUHGLVFXVVHGLQWKHIROORZLQJ HVVHQWLDOFRPSRQHQWIRU3'&'DQG('LVDZLQGRZVL]HWKDW
LV EDVHG RQ D WLPHVORW RU QXPEHU RI SDFNHWV 7KLV LV DOVR D
z 3'$QLQWHUIDFHLVFRQVLGHUHGWREHFRPSURPLVHGLIWKH UHDVRQ ZK\ WKH 6357EDVHG PHWKRG FDQ PDNH D TXLFNHU DQG
SHUFHQWDJH RI ORZWUDIILF IORZV LV KLJKHU WKDQ D WKUHVKROG PRUHDFFXUDWHGHFLVLRQWKDQRWKHUPHWKRGV
8QOLNH LQ RXU 6357EDVH PHWKRG ZKLFK KDV ERXQGHG IDOVH
QHJDWLYHDQGIDOVHSRVLWLYHHUURUUDWHVLWLVFKDOOHQJLQJWRVHOHFW )LJ  G VKRZV WKH SHUIRUPDQFHV RI 3' ZLWK WKUHVKROGV
DQGUHVSHFWLYHO\1RWHWKDWLIWKHWRWDOQXPEHURIIORZV HUURU UDWHV 7KH PHWKRG FDQ GHWHFW ''R6 DWWDFNV DQG IXUWKHU
LV OHVV WKDQ  SHU WLPHVORW LQ RXU HYDOXDWLRQ WKH GHWHFWLRQ LV ORFDWHWKHFRPSURPLVHGLQWHUIDFHVWKHPDOLFLRXVDWWDFNHUVKDYH
QRWSHUIRUPHGGXHWRWKHORZULVNDQGKLJKUDQGRPQHVVRIWKH FRQQHFWHG (YDOXDWLRQV DUH SHUIRUPHG E\ VXEPLWWLQJ WKH
IORZV:HFDQREVHUYHWKDW PHWKRGWRWKHGDWDWUDFHVZLWKDEXQGDQWW\SHVRIDWWDFNVLQWKH
'$53$ ,QWUXVLRQ 'HWHFWLRQ 'DWD 6HWV &RPSDUHG WR WKH
)LUVW3'PDGHDIDOVHSRVLWLYHHUURUDWZLWKWKUHVKROG GHWHFWLRQPHWKRGVEDVHGRQWKHSHUFHQWDJHFRXQWDQGHQWURS\
 $V VKRZQ LQ )LJ  E QR DWWDFN UHDOO\ RFFXUUHG DW WKDW RI WKH IORZV WKH SURSRVHG PHWKRG KDV VRPH RXWVWDQGLQJ
WLPH SURSHUWLHVLQWHUPVRISURPSWQHVVYHUVDWLOLW\DQGDFFXUDF\
6HFRQG 3' PDGH D IDOVH QHJDWLYH HUURU ZLWK ERWK
WKUHVKROGVDQG+HQFH³VPXUI´ZDVXQGHUUHSRUWHG3' $&.12:/('*0(17
PLJKW KDYH GHWHFWHG ³VPXUI´ LI ZH FKRVH D WKUHVKROG ORZHU
WKDQ  +RZHYHU WKLV ZRXOG UHVXOW LQ PRUH IDOVH SRVLWLYH 7KLV ZRUN ZDV VXSSRUWHG LQ SDUW E\ WKH )XQGDPHQWDO
HUURUVWKDQZHUHPDGHXQGHUDWKUHVKROGRI 5HVHDUFK )XQGV IRU WKH &HQWUDO 8QLYHUVLWLHV -%0
-%0 LQ SDUW E\ %HLMLQJ +LJKHU (GXFDWLRQ <RXQJ
7KXV ZH FDQ FRQFOXGH WKDW LW LV FKDOOHQJLQJ WR FKRRVH D (OLWH 7HDFKHU 3URMHFW <(73 LQ SDUW E\ 1DWLRQDO 
WKUHVKROGYDOXHIRUWKHVLQJOHSDUDPHWHURI3' 3URJUDPRI&KLQD&%
)LJ  H VKRZV WKH SHUIRUPDQFHV RI (' ZLWK ERWK
WKUHVKROGVDQGUHVSHFWLYHO\:HFDQREVHUYHWKDW 5()(5(1&(6
>@ $$NKXQ]DGD($KPHG$*DQL0.KDQ0,PUDQDQG6*XL]DQL
)LUVW('PDGHVHYHUDOIDOVHSRVLWLYHHUURUVZLWKWKUHVKROG ³6HFXULQJ VRIWZDUH GHILQHG QHWZRUNV WD[RQRP\ UHTXLUHPHQWV DQG
ZKLFKLVWKHWKUHVKROGXVHGLQ>@)URP)LJEZH RSHQLVVXHV´,(((&RPPXQLFDWLRQV0DJD]LQHYROSSSS
FDQ NQRZ WKDW (' UHSRUWHG WKH ³SRG´ DWWDFNV :H VD\ WKHVH 
UHSRUWV ZHUH IDOVH SRVLWLYH HUURUV EHFDXVH WKHVH ³SRG´ DWWDFNV >@ ' .UHXW] ) 0 5DPRV DQG 3 9HULVVLPR ³7RZDUGV VHFXUH DQG
GLGQRWODXQFKDWWDFNVDJDLQVWWKHFRQWUROOHU:HFDQILQGORWV GHSHQGDEOH VRIWZDUHGHILQHG QHWZRUNV´ LQ 3URFHHGLQJV RI WKH VHFRQG
RI,&03PHVVDJHVWKDWZHUHVHQWIURPDVLQJOHPDOLFLRXVQRGH $&0 6,*&200 ZRUNVKRS RQ KRW WRSLFV LQ VRIWZDUH GHILQHG
QHWZRUNLQJSS±
WRDVLQJOHKRVWZKHQWKH³SRG´DWWDFNVRFFXUUHGLQWKHGDWDVHWV
>@ 2SHQ1HWZRUNLQJ)RXQGDWLRQ³2SHQ)ORZ6ZLWFK6SHFLILFDWLRQ9HUVLRQ
7KXV (' GHWHFWHG LW EHFDXVH WKH HQWURS\ ZDV ORZHU WKDQ WKH ´KWWSVZZZRSHQQHWZRUNLQJRUJ
WKUHVKROG  GXULQJ WKLV WLPHVORW +RZHYHU RXU JRDO LV WR >@ 66KLQ**X³$WWDFNLQJVRIWZDUHGHILQHGQHWZRUNV$ILUVWIHDVLELOLW\
GHWHFWWKH''R6DWWDFNDJDLQVWWKHFRQWUROOHUEXWQRWWKHDWWDFN VWXG\´ ,Q 3URFHHGLQJV RI WKH VHFRQG $&0 6,*&200 ZRUNVKRS RQ
DJDLQVWDKRVW%HFDXVHWKH³SRG´DWWDFNRQO\UHTXLUHVDVLQJOH +RWWRSLFVLQVRIWZDUHGHILQHGQHWZRUNLQJSS
IORZ UXOH DQG ZRXOG QRW JHQHUDWH PDQ\ UHTXHVWV WR WKH >@ 67=DUJDU--RVKLDQG'7LSSHU³$VXUYH\RIGHIHQVHPHFKDQLVPV
FRQWUROOHUWKHVHUHSRUWVZHUHIDOVHSRVLWLYHUHSRUWV DJDLQVW GLVWULEXWHG GHQLDO RI VHUYLFH ''R6 IORRGLQJ DWWDFNV´ ,(((
&RPPXQLFDWLRQV 6XUYH\V  7XWRULDOV YRO  QR  SS 
6HFRQG (' PDGH D IDOVH QHJDWLYH HUURU ZLWK ERWK 
WKUHVKROGV  DQG  +HQFH ³SRUWVZHHS´ ZDV >@ : (GG\ ³7&3 6<1 )ORRGLQJ $WWDFNV DQG &RPPRQ 0LWLJDWLRQV´
XQGHUUHSRUWHG:HOHDUQIURPWKHGDWDVHWVWKDWWKHGHVWLQDWLRQ ,(7)5)&㸬
,3 DGGUHVVHV RI WKLV DWWDFN ZDV DOPRVW HYHQO\ GLVWULEXWHG >@ 4 <DQ DQG ) <X ³'LVWULEXWHG GHQLDO RI VHUYLFH DWWDFNV LQ VRIWZDUH
EHFDXVHWKHDWWDFNHUVWULHGWRSUREHPDQ\KRVWVLQWKHVXEQHW GHILQHG QHWZRUNLQJ ZLWK FORXG FRPSXWLQJ´ ,((( &RPPXQLFDWLRQV
7KXV WKH HQWURS\ YDOXH ZDV  TXLWH KLJK GXULQJ WKLV WLPHVORW 0DJD]LQHYROQRSS
DOWKRXJK PDQ\ QHZ IORZV ZHUH JHQHUDWHG DQG YDVW UHTXHVWV >@ . %HQWRQ / - &DPS DQG & 6PDOO ³2SHQIORZ YXOQHUDELOLW\
DVVHVVPHQW´,Q3URFHHGLQJVRIWKHVHFRQG$&06,*&200ZRUNVKRS
ZHUHVHQWWRWKHFRQWUROOHU RQKRWWRSLFVLQVRIWZDUHGHILQHGQHWZRUNLQJSS
7KHUHVXOWVSURYHZKDWZHGLVFXVVDWWKHEHJLQQLQJRIWKLV >@ '.RWDQLDQG<2NDEH³$SDFNHWLQPHVVDJHILOWHULQJPHFKDQLVPIRU
VHFWLRQLHWKH('ZLOOEHLQHIIHFWLYHLIWKHQRUPDOIORZVDUH SURWHFWLRQRIFRQWUROSODQHLQRSHQIORZQHWZRUNV´,Q3URFHHGLQJVRIWKH
WHQWK $&0,((( V\PSRVLXP RQ DUFKLWHFWXUHV IRU QHWZRUNLQJ DQG
QRW HYHQO\ GLVWULEXWHG RU WKH PDOLFLRXV IORZV DUH HYHQO\ FRPPXQLFDWLRQVV\VWHPV86$SS
GLVWULEXWHG 1RWH WKDW WKH ³QRUPDO IORZV´ PHQWLRQHG KHUH DUH >@ 600RXVDYL³(DUO\'HWHFWLRQRI''R6$WWDFNVLQ6RIWZDUH'HILQHG
WKHIORZVGRQRWWULJJHUDWWDFNVDJDLQVWWKHFRQWUROOHU('PD\ 1HWZRUNV &RQWUROOHU´  0DVWHU GLVVHUWDWLRQ &DUOHWRQ 8QLYHUVLW\
EH XVHG WR GHWHFW WKH GHQLDORIVHUYLFH DWWDFN DJDLQVW D KRVW 2WWDZD
VXFK DV ³SRG´ EXW LW LV DQRWKHU LVVXH DQG RXW RI WKH VFRSH RI >@ % &ODLVH ³&LVFR 6\VWHPV 1HW)ORZ 6HUYLFHV ([SRUW 9HUVLRQ ´ ,(7)
WKLVSDSHU 5)&
>@ 33KDDODQG0/DYLQH³V)ORZYHUVLRQ´KWWSZZZVIORZRUJVIORZ
BYHUVLRQBW[W-XO\
9 &21&/86,216
>@ $:DOG6HTXHQWLDO$QDO\VLV-:LOH\ 6RQV
,QWKLVSDSHUZHSUHVHQWDQHIILFLHQWGHWHFWLRQPHWKRGIRUD >@ 0,7 /LQFROQ /DERUDWRU\ ³,QWUXVLRQ GHWHFWLRQ DWWDFNV GDWDEDVH´
QRYHO''R6DWWDFNDJDLQVW6'1FRQWUROOHUVE\YDVWQHZORZ KWWSZZZOOPLWHGXLGHYDOGRFVDWWDFN'%KWPO
WUDIILFIORZV7KHPHWKRGLVEDVHGRQDSRZHUIXOVWDWLVWLFDOWRRO 
6357 ZKLFK KDV ERXQGHG IDOVH QHJDWLYH DQG IDOVH SRVLWLYH