Lijciljii: T' IB5 Z
Lijciljii: T' IB5 Z
Lijciljii: T' IB5 Z
7~ ~s -:~!i·
~----------~--~'
tt:r.t~*i7'1'7''~-
LIJCilJII t'~IB5¥Z•
r _AI~~~J rtm:tiit~iW J r"T-1 - 77 - = /?"J C:l-1-::>t<:~~t.J~J\.:;('J-~0)
~~-~~- 2"*~*~-~~R.If.I7D?"7~/?"7~77~~7D772
>:7.t.fi.B, ~ C: G~l-1tm{tt1~~ -tt- t:'.At.J'Wl'B<.GT2'3;Gt<:o W:F,~~td:< t'b
7 - ~t.f.lf.IBG ~ns~~.lf.l 9n~ OO~GSO)M·~~~~C:ij~2'3;9o
u f.J' G·t~~~7 JL-:::J' 1) /(bO)$~{PJt.J'~1'b:h T \,\~ O)f.J'f.J{;t:Jf.J' S td: \,\0) It:,
~O)~-~ ~~~ .A~~O)~-~-~~--~mM uT~Jf.l9~~t~~M~
diS~ t ~bc!E ~ ~f~*it!vo -111\}:ftjt~ IT I . / ~ = 7 1) Y7ti, :fJJ'L':tff.J'S_t~
:tf* ~0) L.-«-J L- ~~H9 ~ J: -5, Web ~c$~WF~ ~~t: J: ~ 2" * ~ * tJ~~~tJ'
.lf.IB2" n T \,1*9 o G iJ' G~~~~~O) ~f~ t;:<t;J \,IT ti. Web ~c$ !t:~JH!IUJ J:
?It: rg- <· wc61J ~J ~ t 1<:::~2' t.f~t., l T \.I~ EIJ~~~~t * 9 o ~0),3\fvi.B,.tJ
IDt~*~'b~\.\T G *-:>TI-,~ 5'-::t-.A 1--tJ'~<, tm~~~ O)flU~t.f~fiit-9~tt:
~~.:tO)Ii1-'~l.t\C: \.l;t3;9o t O) - /J~. W:F9!Hi-~lt:M-:> td~~tJ'~ <,
~~. ~-~~m~~ij~T·2'*Gko:$:~~~GT·lm~~0)0082"C:~
003
§ ~X Co nt en t s
AI~~~(!)
~fil~~
.A.Im~clct: · · · ·-- ....................... ·- ..... . .......................... .................... 012
0
016
....................................... 024
...,._
tl~~~(/)
-~~~
0!" ~giliil5 ~ J ~~(]) G < ~ ............................-.................................... ·· .......................... o3o
0 ~gilitJ:G~~(])G<~ ············ ............... .... · -··· ... . ...................... 034
13
' """'t'~~ - :+:t'~~ ........ .. ............................ 048
11 1'<7JE, O:.JJj;J'' o-:r- d-..IJ%J'
004
~~~~0)
:to1!~c::J7tif,fiJ
...... 058
005
~~~~(})
7 Jl, ::r IJ ~'A
2 !QJ~m~~JT · ·· ······ · ············· · ···· · · ·· ··· · · · · ·· ········· ·· .... 102
. ...... 112
. 130
006
13~ Con t ents
7'-1-77-=/.?'(J)
~~~~
34 =.2 - 7 J~.:?, '/ ~ r;-? c.z-0)~3t:. .... . .. ............................................ 148
,. =
~
7'-1-7?-=/?'(J)
7ot!:Ac::J7~f;fij
..... 172
007
7'1' -77-=/?'(J)
7 )1, ::r IJ :A' A
4 ~h.i6{}J.=:J.-7J~.::f:.'Y 1--SJ-? (CNN) .................................... 180
008
§! ;}( Cont ents
8
~AT Aim~~
~m~~m
' A.Im~g/ o?'7~/?"l::s lt~:±~ ;;~8 ....... ... ............................. 21 0
<t:> t> ~) I;: ............. ....... ................................................. ................. .._.......... ........................... ··· · · ...........··· · 229
msl . ..·· · · ·· · ··········· .... ... .... . . ... . . . .. . . . ........ . . .. ....... .... . . ......... .... .. . . .......... .. 234
~tt*Bfl . ... ... .... .... ................. . . . ... . .... .................................................... .. ................... 238
009
• SI>J!f
$:·~~~2"tt.t.:P<!!IJI1, ~*OJw.itOJJ:I.'§: §~C. VH1iJ;.9, l..tdJ'-:> c, ;j..~'.i:Jf.ll.'td!.l'lll1, ~~9;10:;g:jf
E'l~ OJ:IIl\:fc'f'IJif!ii<::J: ""c11-::>-r <tc2""'· c::tt. !:>OJ1JI!!!OJ~J'IJOJI'aolll:l<::-=>l.'-c 11ilru~5iiUsJ:U''i~l<t, ''
fJ'fJ:~J!l:ifio f>. \,\ *tr lv.
3'-tc, $:yi<::;G~2"tt.t.:1!!~11, !MI<::If!i'JOJIJ:I.Ij!Jt), 2019~7!'l-f<8ijli'£""C'OJiJ'*i!~:it i;:L.,n'a;~. i1JfD:
~~StJ:<-~att.~~8~M'Ja:.~
J;{_tO))!~·Jj'j~ <:jjl(~l.,t.;tcLit.;J:-(\ ..$:W-i 2Jfilli]P.li.';J;1f", L:.tl.60Jiilt:$J)l~<IO~J:I.Hl1J'"1'1<: sfl!]Lif7
t>tt:mLi ct, tzmWiff.itHoJ: U'.tf%'1<1:t-Ji'l! i_, fJ't.l.*9· M5fJ' t..:ltl<:~i;Odi:l~ <tc~ ''·
• ih'itJ, ~ij\ii~H~I<::-:>I.Ic
$:*91<::ie!!c!tt.cL'~~1J:~, B!!f*-1,, ~£~, '7- t:'.A:&f.Hc l<l., -ttt.-t.'tt.OJ~ll · B!lf*OJi!JiiJt fl'ij\i!lJ
a i!li~~""C'9.tJ:a *X~~~~ - ~- *~-~~~~t_,-r&'J*tt~
010
1 !i!
~~~~~~~-~5- = ~~~.Aimn~
~~~tt~~(~~~~~~~~ o ~~~~.
~~- m-~'Rl' 5~~~ ~ T \.. '~~lfJZ~""Z' ~ 7... ~ *. 2· * t~:;rg: 7... :a=: :±l ~ T <fS IJ, ~
i*ffHt:: lct:JE *.? T \,\;TJ: \.. \O)fjq~t;*;:""Z'9 o
012
1
.Aimti~O):ii::ft(cJ:I!I~--c'97A \.,\ <-:Jt.J'(c:7:J'~9 ~ z: e: lcJ:PJti~--c'9 0
0)~ 1' 7? ~ - ~,'!!,1., \;$fJv'\.~ C: btl' f) ~91..\ --c' u d:: -3 o J.I{iJJB{Jfd:~HU~J:J (;:
J: :> -r #itii£t.J{ A F"'91!: ~X. T u * -3 , 1.. \ b r;b ~ r :Y '/ ::F :z. 7 1
) 7 1 J ~ :t tc. S9
C:§ph,""(I.,\~O)t,, Ssi..\.;\.Ij;01l~\:9o
- :/] 0) ~~ 1.. \_Aij;Oti~ C: (cJ:, .Ars9 0) C mll~ 1<:~-::5 <) f'Jt!J ~f~fD.l(9 ~ L. C: \:,
A~0)~1:J0) -$1i: fte-c~~•~O)L.C:--r9o <:'bS~, ~-~~~o~m
9 :::J '/ r::.' :z. - ~ O)ia:t.J', O)'b 1c:~ u <~lv --c~.-, <rrru1~~~~td:c ~1':;.. - Si9 ~
e: bt.J' fJ ~91., \ --c u J::? 0 ;: ns O).Aim1l~lc~:mr-H<=t~N~3!lb -r ~.- \~ J: ?I<=~
X-*9t.J\ .Aim~Eif*t.J<EI c O)tHEI<:-:JI..\Tfp] SfJ'O)&~m~~:> -r 1.,\~:f::J~t
""C'IcJ:it5 f) *itfvo
~O):fftEC::IJ.····· ·
W<l)IJi:!t.t
::J / ~ .::1. - 9 1 <::
lli:!~:t~
ArdJ<7)~1J <7)-$'(t
::J / l::".::l.-9 1<::
!li:!~:t~
013
2 -:J 13 (;:1:, r ~.R.m A.I~fi~J <:: r~itm!A.I~fi~J <:: \..'? ~:1'~~-c, <:. tz,(;:l::tJ"~
cfci:.Q:5:)'t] (<: ~I3[..,T\,\a;:9o
*~ ~mAim•~~w~w~o~~ctci:.Q:5:tB~$<, ~~~~~-~
2" n T \. \tJ:\, \![7d5L"C :t:t-J~-c ~ a::9 o <:. tl,(<: ~ [.., T¥-i1~lliiAI~D1J§~cl: , ~lUE:BkJ
2"na::9o
~@JW:5:t~JHcl:, mM~W.:t W""Cicl:tJ: < ~~<:: tJ: .Q-5:1'-til<= ~§ [.., T \. \.@,9-c rSSi
l- 'Aij;D1J§C: ~~ \. \AI 1D1J§J 0:5:1'~ c lcl:~tJ: 0 a:: 9 o tc.tC.t_,, -5:1'-~l:W*a* 131;.V
(;:1: Ia: ~£~ b S tJ: \, \ <:: ~ ~ T J: \,' ""C [.., J:. ? o
~ -~ ~-...... ..
A- •• .... ._____ .._._.,_
. • ~-~~t.tff?.:. t: 1.1~'-c't! Q • (t.:t:;ttct'> c-~Q(7)fcimllairoh ..
J -. fflj~I:;S~''LI;l:DbH'l.b.A,-c<· i;J: ' :; __, ::::J :..- t:..-t- 1:51? 1J'1J'?'LL.
' ~\(j;j':~\ 'E,O)~)Jlflt"Liii!*T:'~ ' , *'5~J:c,~J:En0)1imli ::I&.X1
' ~t.d:,~J:E9j.O);f;1/,\!l:tX;J,;t '
~ \:'~~ ,,
•
014
3-:J §H;:t r.A.I~~O)~JJU.Itl!i J (C::: ~Eiu tc)J'·~-z:'9o =t ?C:=t {!£\,\~~~~""Z"Cf.>
~* tt luo L- ""J'- 2 1;:1:, ti' ~(t-]tJ: A.Im1i~""Z"9 o J\:t.J C: t±l :t.J 0);\\§.Jf.g-.bttO)~
tJ" ~ \,\ tc ~, L-«JL-1 J: '? =t :fi~tJ:rp,\,\(c:::'i§;t t::> n * 9tJ\ m~~O)~i\\§.017-0) );.
015
r
02
~~~~t~AI·~~~D~1? ~.AA·~~?AA·~~~~~~ - ~#*~~ ff
? t.::d.>~JI~i**~~lii G ::l:9o lil~f.d!1:£1~1i' x'1'• .A:t.J ~ n t.:T' - ~ ~-t t 1: ~
fi!~-=fil!IJ G t.: ~J §~11: G t.: ~) "(·~ .Q t.:d.>. ~ ::l: ~·;:t: f.t~ff"(·}~Jti ~ n "'(l. '::l:9 o
~y~~-7~~~-~~---~~~~k~~~. ~~ ~5 ~-~~~t
l<:t~~~-VUcf~ \,\;/],~)1\:~ ~~'~;/J{;J5 ~ a::9 o L. ~ ¥~~ L. t ~. 1>17 ; t - ~
Ji;i:~ ~a
A 100 0
7-'9-tN~\, \(J)C::
1131C!~~
B 90 0 :f~c:-9
c
0
E
80
70
85
0
X
?
/ ~~~~ 0 C::9
E(J)ts'~ld:?
016
,-·
mH~~~c-lcJ:, :::J::,; r:.' .:1. -5tfJ\1Jr'-5 :a:;;;t't~ 0, ~~~:r· ;t,:a:{~? -r
~t~*5~t,t te 1:J G a::9 o ~9-t:-T'JI-c lcJ:, <15~7'-5 :a: J\1J9 ~ t, ct I? ~t}J
td:~l!!.5_R:}EO)tc~0)7'- 5 :a:tefJ G -r <n~, t, \PiiAii01i~O)ft\i40);:: c C'9 o
Po~
ATJ t±l1J
0 1
IEml;j:?
<~J)g9.::C::~ ~m;
!:F~'E -T) l.d i tt;~
:¥CRX:9.@
0
••
017
··~-~~~~-*~(~-~ ~~ ~~~6h*~o*~~-~-~~~-
57'J{ c ~~M 1<::~97'J'~~.Q L. ~ t.J~ EI ~--c'9 o .A:t.J 2"h.Q7- 57'J{\,\ <-:Jf.J'~
?•; t., - 71<:::~11 Sh.Q L. ~ ~Wl m~ GT, ?·;t., - 7 p~rc:~*Hl7'J' tci:~ \,\ ~~t~ 9
.Q L. ~ I<: tci: IJ *9 o
tc ft!Jitci: .Q J:: -5 1<:::;\'o~ t,t 51 <L. ~I<: tEEM G * 9 o W..Lid: L." <~-::> < IJ ~ Ld.:: ~
.Q
~~9tJ\ *~'d:-t-~J:: -5 I<: !lEX. --c <tc 2" \,\0
I fffil
X 0
X
0
X
0
X
X
0 oo 0
0 0 0
0
X X
0
0 0
oO
°
X 0 0
0 0 0
/ 0 0 0
0
~:x/'-'- :;)t.J' s ld:~l*-I?U """C'9 o ±fu~ __t Jc: Ah5 ~ Bh5 c. L- \ -5 :r- : r - :,;~,J,~r.5tJ{
2 h5M~.Q~G*G~ "5ot GT.~~ pg~~~9.Q·~~ 7 /7L~~~G.
rAIS~ B/;5~ ~ ~ S ~ ~h < S \,\fljffl~ .Qil'J c \,\ -5!U15~ ~1i G t.:: ~ G *9 o
t~?X.--c', *~~~-~fi-:>T~*G~?o
018
5l~~C'(cl:, 2-:JO);j,:7E;/;§0).:;,-5, ~IJffl9~ i!iU-8-(L.J:-:>-r, ;g.~&! ~ rAf.!iiffl
O)~~J t rsr.§)Ji\O)~&!J t ~'? J:? (L.5:Ht*9 o ~ ~:tt-r.Jii~9-@ t, C. 0)
~~:t~;;t;:~r~HL. (cJ: 13 ~n' 6ili ~ ,.::z -}\ -~~-=> -r ~ \-@;: t n{bn' IJ 9 o c: n *
6 ~5J'~9-@ t.:~, :tih~...t(L.~~~~' -r Jf*
u J: ?o ;: O)~ (cl: , Ah§iffl t B/;§
im~-r ~ -@tet-gJ 2'~9 J:? (<:.~2' a:;9 o ;: O)*''R ~~~9 nrt, ~111~ffbtJ:
JJ'-:> t.:'*ff!C'it!n -r :t , Ah§ i!iVJ:O) JJ' Br.§ili\~0) JJ'.:Yi~~ 1J~.lz:-r ~9 <tJ: I') :3; 9 o
~~' ~-C'9o ~ ·~~, .:g.~ff! ~~~~A/;§ cB/;§~~ ffl9 -@~"8'~~
0)**~~'*9o L.h~ :!IB~...t(L./ D 'Y f--9-@c, ~~:tiO)JJBt'), ~(cl:t') EJ~
(t:. lli~ ,.::z -J\-~~1Jffl9 -@l!lU-8-h{r.lJ <tJ:-=> -r ~' *9 o @J•-r(cl:, t:. O)~rP:J ~ J:
<&.~9 ~ J:? (<=*''Rt,f ~ 12' a:; 9 o ~~O) t~i5' <:'65hli Ar.5 t B l;§t,f *5'3\ ~'R~ ~I
2', A/;§j~lj ~ rA100%J , Br.51~~~ rAO% (=B100%)J t)E~ 9h,iJ:~ \0)~9o
L. 0)~0) C. C: 'L.ilil \ lJ' C', ~11{ ~ f}b tJ:h' -:J t.:~~C'it5-:> -r :t, A/;§ t B/;§ 0)
~IJffli!iU-8-~.:Yi~U-r 2'-@ t ~'? b 't-r9 o
100
!I 90
Al6
o 0
oo
o
AJ6 loo
100
.,
O
0
X YO X X
X xX
100
100
.... 10
65
,.
"
0 0 0 X X X 27
lO
0 X X xO X X
0 0 X X X
X X X 10
X X
0 : AI6JJ'R(l)llR
X : 8 f6)JR(J)~ 816 816
019
7 -r-7" 7-=::..- ?·;t, tii!Uit~HO) 'f-~0)1 ?T-'9ti, ~ B~ -TlvtiiE M t.,\'!'9 1-' J::?
I: AIIIJ1i7 - 9 '!1JOI9 .QO)T-·IHt: <, ~B~7 Jvti ~ 6 f~~ :RJ '!Hilt±: Vt~H
Vn' <t1. '? J~H::k i! f.t:itl-'fi~ ~J :t:9 o
020
(IMAGENET Large Scale Visual Recognition Challenge) ""C' .:t ::k%\fd:t l: fili&§t.J{
~m~n* Ld.::o ~ s ~<= 20151:F~<=,i, -T 1 - :77 - = /7~ffl\,\"llm~~n
t.:@.i~~.~::t o 77 bt.J{J...f,.90)~&:e.~¥ c. \,\btL~ 5% ~t}]~t.J.c, TO)ttflg
l<::ts]![t.J{f.J' f.J' -:J "l t.,' a=;: 9 o
tt
*
~
(J)
ill!
Iii
.....
Hello !
,.
lfiO)~~
: 10
lfiO)"j;:';"J~
Halu?
---- - --
---
.Af.§JO)MEJ9~~m
c::::J/l:::".:J.-. 9t.M~
EJ 9 [email protected] c:, c-
.16-@c lct.~NSfd:t.,\t.::
'¥ - -
~
••
.g.j!S 7'' - 5' ~~~~~1t;
:3
ill!m!1l&i1!1
~,IEML-I::<t.,'
...... ~~
1 j- - 5'~ Hello!
I ::::J/l:::".:J.-91/§§
7' -f0)3;a;
.i\fl-@ 9 .@~m~ EJ!I.Je'91::
7
I ~t±l 9 .@t.::~,~~
• 021
.:r., -77 - .::. :; ·~.ttJ<-~J! it:: :trt. <mni!l-@ J: .:s ';: t;s.? tc. ~ ? tJ' rttJ\ J.j
~ rGoogleO)~E£iJ t W¥1th-@Mf:9i':<:9 o ;: O)iiJf:9i'.C',J:, ~Bit-> AF~M<13'? td~1,000
IJ&O)@i{~ :a:, YouTube b' 6 7 /7 .b. l<:l&f~ G, --t-;: t.l' 6 200 I::? t? )[, x200
t:.•? t? Jl- O)@i{~:a:~ 'J t±:l G-nJII**-T-5 ';:Ff.ll. \ *Gtc.o
L. 0)~11~7' - 5 :a: 3 8 F~M' itT"T 1 - 7 7-.::. :;?·~ tttc. t L. ~, ~E8t-> ;\0)
M:@i{~I<:M G TSS <&:ft9 -@.::. .:z. -7 JL-.f. 'Y f-. '7 - ?tJ{~ 6 h* G tc.o L. O)~Jf
:9i'.:a:• G -~h~ ~~~~~:tO):a:~-G~S:a:-~-@J:.:St;J:., ~b~Tfi
~ B"JtJ: 7 D t? 7.. :a: ::J /I:: .:z. - 5 C':f!il~. C' ~-@ 0)--c'IJ:tJ: l. \fJ' t l. \-5 l'tE!mtJ{J1\3':?
T l. \ ? tc. O)C'9 o
.::O).::..:z. -o /IZ::.
l, I? t.::ILIT!li1~~IT!li~ I Z::. ;t-z"5:H~!l l-" ~~tl~'if:*l~tc.l".fi;: t>?ct>~!ll<&liG9~IT!li~
1'A~'if:*EJJJ~;b1!"(f~~1J:IT!lii~'if:¥J ffii-z"~ -@J:. -5 1Z::.1J:-@ = Google (J)~ffi
022
c
-~ ~~Wl~~~-~~k:::J.f-?~3=.A.b.~~-3l."G~-3~~-0)·L'~S
(;:::~I_,< !ffmGL"cl < 7'1' -77-=Y?'fi, =.:~. -7Jl,.f. '/f-. '7-? 0)1*.ffif;::J;?
L"~f.\'l G td5Zi®L'9f.J', ~liJO)f±iii§. J:i.~~~®:Ldc t cl-3 ,<2, -c', :::J .f.?~ 3 = 7-'.b.O):il.~
~ tJ:i.StL Tl,1*9o
1!t W!<t~nc-51t~~ ~
(!l~!!~c-5:,., :A 7' b. {&~lt) H~~~~i1N G t.::1rii'Jii~1'F~
~c-5H!U!~f*fF~ ~ -+=.::t - 7Jl,:?-·;; f-.'7 - "7
-.I.:t-:A/\- f-:,.,:A'Tb.
1
) / =:1' is 7?1'
'J ::--- :J' is 71J1'
~~ [QJ± O)IM\§1'11<1:J:t1JI-'@ i:Jf,
)E~I<J:J:ttJI-@i:JI', ~~O)~it*ml~EI'(:f~ l!Wf9-@
023
AI~Ii~cti~~~1J~'
~:&9:Q*C'
z:. z:. ""["l;t, A.I!,ij]~c l.' ?ti~~ J:: ~J ~< ~-?"tl.' <z:. t l!, ~fi!Uat~Bta)IJO)If!
~~A l!l. '~*'to 't-r-I:-A1fr.J~ ~:fit It-? t.: Z:. h 6 2 ?a)~;!il;t, ~~a)J:fll!-t
n~tl.~a)J::?~~a)t~-c~~~n-c~~q)""("~~?~ o
• J.IKh~
I !'
I JJ.r.l\lt ! C) -:
L_
024
~ m1 ;~AI~(m~:t-b.
~~~~~~~~~~~3~~R GT~k~~&~~~Th*G~3o
J\'J ::J /~~:t.EI.t :t \,\;t~5fLFf.l ::J::.; r:· ~ -'7 ~~~'<:: ~ ~ T, ti!U&~T':J-7 Jl.t
lt:~c~{~9 ~ <: t "?:: .AFI3~~DliY~1'fJJ~ ~~i.W."?::~ ~ t~ X. G;t~Jc~~9 o <: ~MJ
M, :Et.J:pJT~~~I<::t.J?tc~li, :tto~~~, ~~mt.J~, ~\,,Jlt-Jltl'~ffi
*9o
re.·:; ~ ~ TjO]?
t!!~~TjO]:a-
9tllcf't, \I.,\(])?
025
19so~1-'COJ~2 ~](.A.Im~7' - L. -ri;J::, ID5(\I)J.6.fvtc~::kt.,-:m~~1*fl=9n
~ tL 2i:: l.J teo .:COJ{-'C~i~Ut.J~I ::f ;:1.1~- 1'- ~ ;:1. 7' .£.. ""Z'9 o I =\'- A.J\- f-.':./ A. 7 L.
id:, at>E:>t.J'u(\I)-1Y7'.'J r-~tt-r L \~:w r~~O)i!J~c, fJi.1:EOJ~55t~~9-T
l!.llf<J>~
• If ~atifi
t hen 1'::/7 J[.,I/tf NO
NO
~If#,~I
YES NO
YES
Ga>J<tft!l"'
YES
t hen n't!
-~ ~;t-@
(J)tJ~-K$. -·····
:::J/~.:J. - 9 1 .::
~1."~-QM<:"
.A.tJ~B~~x~
026
I ~ 3 ;~AI~§~7'- .b. 1
~2~Aim~7-b~•~~~ ~7~~~~ ~ -~~~~ ~~~h~~
~~~txtt-a:~®:G te[t-~ 1J $tn:£ El 'if~ @)~ J:-:> '<:tJ: IJ *9o = ~ - 7 JL-
f.·y r-'7-? . 7 7V'~w~. ;a;{iiff.l7JL-::f 1J.Ab. sm1t~~tJ:ctJ~.z-~1-t~
I<:J;' t,\T <tB <~,~tJ'~ I)* G teo ui'J' Gl.W,tE~Id:, ~-~ 0'f*f.¥1J' S ~HU5~
0 t±l 7J It::¥:~ * ~ ~ 9l1W -a: Google, Amazon, Microsoft fJ: c t.J'ij;i#j;~ ~? 7~
~~~ff ? <::~~~~* ~o ~~~~~tt~~tfi~~~~~a?~~t~.
AI~~--~~ ? ·~ ~?k~~~o
'./7r.
::J ~t:~ -7 ~ ~7'
• • •
• • •
•
027
c
I_
-
...
028
;:C7)Jl~ld:, AI~~g€~~~tt~rc~li:1'DJ
t.::~$:5}-(::~ ;Z Ti:J'* \,\*it luo *f;:_, !EfWc!: fci:~1*;Z{!: 7~Jit(:: \,\\,\ , *;Z
tf-a*nt.::-T-5' '!!: 7~Jid;t ~ 7-9 (:t L- <liiNa'T'- 9) t ~V:*9o ~
am~ 0 ~~li "E 7 JL-O)~~~c: '7"'-JL-N~ 7 - 5' ~ fif.l\, \ * 9t:J\ :~H~EI9tJ: Elt~';j::
5A::.J[.,O)tJ: \, \7'- 5' (T .A 1-- 7- 5') {f:JEM. ~it~ L. t C'9 o Section02 C'~lu
~--~90)~~, ~ma5~~~~~:5:t~h*9o
fflc!:GT, *c!:B0)~-~:5JM9~~m:a:~ma5'J~B~~~Ttw~9~L.
t ~~;Z* G J: -5 o *c!:BO)i@{~-"J-"Ji<:, *i:J'Bi:J'0) 5 r-::.JL-'i!:a5 Si:J' G~
.Ars,i:J'{i lt Tt0 ~ * 9 o -=£:-? JL-,;J::@ll•c!: 5 ""-Jl-O)X1/it~f*{f: .5il, T, t: ?s s O)@ll
1~71':*:-z: c5 s O)@llf~t.J'm-z:a5 ~t.J~:.a:~a u-z-~,,~ *9 0 ~~fl9 ,<: , :*:?1830)
'7""-JL-tJ'tJ: <-r:timH~ ~.5il,t.::tclt -z:-'fJJ!tTC' ~ ~~ -51<:tJ: nit, -5 * <~R-z:~
f.::(::\,\,it*9o
-
~~ - O)ff •J 15
:X;
~ ~m
'j
;X:.+-71'\J[, ? ?
-
m ~ ~ ? ?
030
-~~~~R~~-~@~ID2~~7~~~6h*~~ ~-~r~~J~ 2
:tIll¥ lcf'h .Q L. ~ ff· 05 ~ * ~ o Section02 l" 1;1:, ~--a: r 7'- ~:£{/.$:-a: l" ~ .Q tc
lt?:Ht .Q J: 7 tct'R-a: <:; I< <= b, @m~:{f: r@l~t;t 7'- ~:£{/.ft<: c· ~ ~ tc lt~t~
.QJ: 7 tc:t'R-a:sl <<= ~ J ~m~5r.u* ut.::o <= L.l"t;t, r -y;~~ ~h.Qf@: C*X.) tJ'
c 0) J: 7 t~{@-a: c .QfJ'J ~ \,\ 7fm.~l"~-~ @]~®~\,\-a:~~ l_; * ~ 0
* t.::, @i{~-a:~~9 .Q aey,'i$;"1.' t;J~~~*B*ID~ ~tJ':iE l.; \,\ i.J'O) Oiit<: ~o.tt.l'~ ~,
j;::;j\~{*-a:~~g .Q L. (:: (j:~ ~*it fvo U f.::tJ\ -:J T, 1* ;{_ :{f: JJ T :::J" 1) (:: J-)..fJ:it
*9o
-1JO)@J~ta:, :a .:ttJ'J.I~ utd&iOCi. Cil6:1i) tc:tJ ~ * 9 0 :f*'fiffiO)-y;~~rp,fHI
axO)li~I;;J®sn-rt., \.Q
(ll~®ll 3
0? 3?
1? 2? 9?······
12345.6FI3
••
031
I 0 ~Bifi®~J~~(c:J:~~~Jj\~<9~
~~c·~e G ted:: -s tc::, ~gmiJS IJ ~~O)~~Elt~t;t, 7«J L-OJtJ:\, \ -T .::z t-- -T-
5' 1rlEm~it~;: t -c·9 0 -rOJt.:®rc:: t;t, *9'7«JL-OJiJS~~JII~-T-5' 1!:-=E-T
JL-iJ~lEm9 ~ d:: -3 'L. l.dJ: <-c ';ttJ: f) *it luo ~ \, \~~hfi, "E-T J[;tJ{t:J:j:tJ G tc
T)~Ut 7«J[; (:. 0)~~~1J:::}dJ: ( l_; fJ: ( l (;:j:fd: IJ a::tt fuo ~~jfiO)~~C',;:I:, Lh
.-----------------------
1
I
-----------------------~I
I
I I
I
J
7-'-9
0 0
••
~~9.>~*~~~~t~~~~~6h9
032
Kaggle (https ://www.kaggle.com/) c':: l<l:, 1!!3'f-$ 0)7'-$''if4I/7'1 7.. 1--t> AI I
:YY=7~· *~~~~A0)~ ~~=7 1~~ c'::~b~~§~~~~, ftMt>&fi
O)~lllHc ~ u ~ ~JJo:JlftJ~:f&)jjtJ=t:7' Jll~m:±l G, :e::t~ntc =t:7' Jl!l<: 'i:lfitJ~:iZJbbn
~ r:::J/~J <::c':: :::J:Y ~ 71:.,t3/~~o :::J:Y~71:.,t3:Y~I<I:~Ci!li!5~!'f!~t.J~l*F132'
:h~<!Sf'), ~.IJD~:hlt7'-$'t-y i---a=7'J:Y D-f.:9 ~C::c'::t.J~~ ~ *~o :::J /~ 1 ?
O)BfJ{tUIJliL%!:3~67' Fl ~, 1
) -7 -*- ~ 1<: 1) 7 )[!$'-{ b ~MfHil:tJ~~Jfi'2':h~fclll.>,
~.IJ0~0)'1:7-~-:.,t 3 /1<:~*6~~ u < O',;.,l:tJ".J ~~~*~0
-t'O)IiJ;f.J'Kag gle ~li, 77 ?ifJ:~ :::J- ~ -a=lilt.l'~ <:: ,1:: f.J{~~ ~ rkerneiJ ,1:: l,\ ?ttlt
~g~ :::J /~ I;:~~~ 7'-5WH/TO)*a*-a=:lt~~~ *~ o * tc rdiscussionJ c':: ~~ '5 Mi~
O)~:tfflfe:2' n ~ t.' *~ o -t'O) tell!.>, :::J /~I;: '1:7' JJ.,HIE:±l utJ: < ~ :t+51-tJ:9D~tJ~
•sn~~u~?o k~u-~0)~-11--~w~ BO'J.•~~~.>~w~~ uM~ ~~~~~
:!:J u:h*"ttfvo
1'!1~0)-l;t-{ 1-- ,I: u~ SIGNATEC\.1'5 EJ:<$:0) ~ -{ l---:ti!5 I') *~tJ{, 2: '!5 SliKaggle
~~~-~~~<,·~ -~O)·~~~~~~:t?~uM~~~~~~?~~o
General
033
06
~Mit.t IJ~~I;t, 7-9 0)«~'(!>5:!Jl.IJ ~ 7 Jv::r 1J :;t .1...1: J;? TNHJi' ~Jt11!:±:9 .Q ~tit
~~0)·~~9 o ~Mi~ij~Ht~~f.tij,A~W ~ M~~~.Q~tt.t<~~~~
~1'9 .Q,o!atl~tt!l~9 0
? ( ;::_A.~O)(d;
r6sJ tc'
!
80
- 1-
60 70 65
-
75 60
-
90 80 75 70 80 ?
034
Ars~~cl:t..\ < -:)iJ'O)=t 0)~~~ c ~, l&:~ G tJ:t..\ a': a':.Z.tL-t'tLO)~~~ =t c (<:
r!RJ.liJJ GJ:-5cGa':9o tc.c7...1i.abfJ:tc.il~, ~O)J::JI<::sift"'ZStLtc.~~~~
•~Rkt~, kt7...~M~~s~~~ktGT=tk~~~e:m~~~t~G
tJ:\..\(ci:9C:9 o ~C:)HtT #tc. ':JJf~C:)HtT #tc.IJ G, c AJJ:?. JL- -7~1'FtL
~.Z.0)~~~-5*<m~9~~c~C:~~0)~~~7...~C:G~-5 • .Z.GT~M
IJ a': 9 J ct..\~ tc.!$U<: * c ~ ~;:: c il'C: ~a': 9 o ~gilitJ: G ~1§1c: lei:;:: 0) APs~O)
r~~~ c S7...~J ~~tJ~ 7 Jt,:J 1) :A b. I<: J: IJ ~IJt9 ~ C:: c ~§fer GT \,\~0)
C:9o
• tHi~~~~i!J~!2<;81J9 -9
t~(l)~ r13:BIJ9 .QJ
035
~~~~~(cj f??:A. 9 1J /?'J 11~'-r!~-Q
-~~L *~~~m~ ~~~ ~~tL~ft- ~~~~ r ~5~~~~~J~
9o ~ 7 ~~ 1
) y~· ,j.-T-~ ~~ f.J\f)~~~{~~\, \~T - ~~~· )1_, - / (~7
B .
E
c
• D
~/ J
E
•
I r - c --1
B
•
c
•
0 16 00
iY.>StJ1 1.J~? '5.A9~'1t)1C~ ,
1
036
~5/:~jjjtJ: l.; '¥'§1 (<:::<IS\,\ T, '/ 7 A 5 1) / '/"0)~)((;: 1-t*BkJtJ: 5 A'/ (::\,\;Zit rix
~iliiJiJOCJ l' L; J: -3. ~)(:7fJ:j iJi~IJ:, 7'' - 5 D' G ~~tJ:•tlU&tc lt~ibz ~ t±:lL;, d5 a:
l)~~l'tJ:\,\'~¥@.~~1j )~9.@5 A'/c'9o L. L. cO) ~)(j(; C: let: , ?-50)J.W§O)
Bl'9o kC:;Z~ d5~~'¥'~1A0)?-5C:L;T~~·B'¥' · ~~ -~ ~
t±~O) RJ<,*l e: ~,' -3 5 -:J O)JW s t.J'd5.@ tJ: C:dt, 1 5 ~)(:ltO) -T'- 5 c.tJ: IJ a: 9 0
~0)5~~0)~•0)?-5~k<~lv•*~kcL.;a::9o L.O)C:~--~rB
i~IJ 9.@ L. C: t.J'c·~.@ l' G J: -3. L;7J' G, *iUill C: l.;T- =!fH,~b L; t,\O)Icl: r~~
75
80
-r, -~J ""
IAJ"CFll It"' .. G
•
•
•
•
"
•
•
•
•
• •
•
·
'
r:i: ~i!it~ V'i"~<::·l;t,
j ~1.:-),c':tJGl'
~ ilil 'it~t±ll'' i'< ~
I . . . . - - - - - - + I!~
a ~~~~•~~~~~m~r~-~~-~§t6~~J
a ~~~~•~~r~5~~~~~Jtr~~~~Jw~~~
037
~~1t!:it~ c ,1, .;. ~ 6 n t.:~~ c (J)~ ~J llX ~J tJ' 6, 11=1 & (J).J£* :a-ill*11::9 ?J J: ? t:
~-~~ff~~~<ij~~-~~~-~~9?JJ:?~*~9?J~c~9.~~~ij
!':F~t -t~~ili~ ~.-*~c -t~~?Jr.,,m~~~H~h'l"'*9·
~m~~~~<T~~ff•~~<0 ~~~lf6B~~ff~~~~~5~~~~
~ 1J)1i,(J) L. t ~~. 'r!l:Sffi65 0 ~~ (<: ';:J::Bjj~(Jk)t.;:lEWt-t.r'65 0 * ~ tct:J\ 5$1t~og
(<::: (;:1:65 0 *it~. i.J'P 0 (<:::, -'(-(J)f'Jii.Jf.J 1' (:'' htc (t ~ fJ' -:J tc(J)fJ'~W~~ t ~ T 3-
~. -t-(J)W~ij~<~~~5~ffti.J~~~~5~fr~~~(J)~~.ftfi~~~
=t:.oc
~M«1it> 6 x_ 0 J: -s
~~ GJ: -5
~~~U)JIY
~
~TiD c
fli!Mil
••
~~
or
><
038
~1t~1§10) J:E':i%,J:§tr~- ~"C)ili~tc c d;3 0 L'9 o ~{t~~L' J: <~bh~ffl
~~;:;t-tz D ~~Jt<::*Bil' 1_., a::90)L', ifV'ffi'H<:: l,\h T<Jsl,\T <tc ~ l,\o
~IW (State)
rri.IJ (Action)
I-:/IYf-
(Agent)
r.i'iltb
-~
ffilJ{!:~<::: Gto::f.Sli1H~6h~ftlli{~~ Cc'~'£9o;;ttDO)ig'&,
(Reward) E~li:c,t.: t ~I<:, ;f§'fO)£~ Ch < IJ~Gtd:lz~t.J~<:::ttl<:.;0t.: I)£ -9 o
r C' O)~!lllO) t ~ (;:: C' O) j'JIJJ H~~ f.J'J t c'? . ifrrilU:: 1'Ji!JO)~§JJ.'&:bit
nm (Policy) O)L.c~ f:IJjffJ C:c\\,\ £ 9o
ll>1~ (Return)
Qf@. r;15 ~tt~ 1<:. a3 c' -c -t0)1'Jibt.J{ c: :ntnt J: c \O)f.J'J t c' -s f.ri.IJO)ftllifil! ~
(Q-Value) WG*Yo §~0·M~~~U< .~R~6 tt~~~~~~G*Y o
- · II
039
~~~~t~m~~<~A~~-9~- ~~~t~T.~fi~~U*~ . ~~~~~
':*t~~ .Q$~ti1bt- '-/.rr. ECim,:M9 .Q~;t:n~~vt.P6. -t~*~sl ~iiil ~~.'
tt.';t*9• ;:;:-z:·';t. f'Y - Jvj t ~T~J!/] ~~~T. iit.'~~~~Tt-'~*9 •
~rc::: t;:J::jlllj:Jl§-~**sl ~9 ~ c: t r;:J::~ l_; <, c: 0) J:: -'5 tJ:~:I!r;:J::~ <a:: -r·-1;;.. - :J~
~'v\~D:IJ' IJ -?9 < 9 ~ t.:66-z'~~ C: t ~Wi/~ l_; T < tC. t5 'v\o
-t~~~ . m~~~m~J::IJ~116 ~kll6, ~~~~ c ~~O)~s~~ l ~~
~~~T~a::L_;~-3o~WM~~O)HP~~~~. ~~~0)%-~J::U~~O)
~~:b~~;JX~~~~il6sn, 01H.lt5n T'v\a::9 o -f- 0) ~0)1 ~-r·~~. 17~ c~
*
J:: -'5 \C::: tJ: IJ 9 0
20% - - ---< --
0% ------'------'----'------'
160 165 ---"-1---'--
170 1
175 =---'-----'---'---
180 185
*~~~: f*tl11*ff£'tSt iD/liri: *tllf*flUiistiil!l:l!t - $551lcO)!W!~ (!JLJl1Z30if.fsl') J (http://www .mext.go.j p/ compon
ent/b_menu/other/_i csF iles/afi eldfi le/20 19/03/25/ 1 4 1 1703~03 . pdf)
040
~ -c z: z:c:t, G ' EJ :$:0)r%1:J.:f3t3if~O)~:f!trc:: -:J L\-cmstJ G -c < t.: ~ L\J e:
~ b h tc C: G -c, r 160cm O.:J A ;If 14% l' · · · · · · J t,;. C. C: < tc < tc G < Jzt-""- tc G,
:>!t1~ -.:J T-3 "* ( f 7'- 5I .a: ~a}J 9 9 J t.: olf) O)~!Ji C: ~ L\~;Z -Q L. C: 'b c· ~ -Q c·
GJ:-3o
-~, --~~~ ~ ~-51-a:~~99 JL.C~7~-~~L.,k5J'~ l' 9o ~
2050$0)
lf~:!ll-~ld.?
•
.. - I{
2018if-*C'O)
:!ll-&7''- 91!' A.1J Gc
• 19 91li5:Nfr 1f 11" -5 c ,
tJ-tS< ..
041
*le§.t t~~$!~ 0) {f \, \:5:J'-[j" 1<::-:::> \, \ T, J: 1J ~ I_; ( §;tBf.ll_; T \,\~a:; 9 o
J
*le~~~~t~~, S~k~ - ~~~t_.,--r, %~~0)ITm~~O)J:~~~~
JtdJ{~®t~0)1J' c ?tJ\ ~_., -:1 1J' IJ ~B9 ~d2:,~1J{ilb IJ a:;9 o
.z.Jvt~Mc~ttJ{~/J' ~ n~:l.J'!Y t ~_; --r l;t, tc t x.Jin&m;R~t.J{~H:r 6 n a:; 9 o
n&m;R:~ I<::di5 tc-:> --r l;t, J\Fs,O)frli.JI<:: J:-:> --r~ G tc~~ ~ ~ T' JL,I<:: ~ --r l;t~ ~
L. t /J{j;::~ [email protected] t t~ ~ 1J' 6 t:9 o t \,\-3 J: IJ, ilb 6 f)!:> ~i&w)R:J:E ';t L. O)@.W1
O)J:.I<::.5JZ IJ JL? l \,\ ~ C \,\? l BJ@ i3 \?'cJ:£li51) 3:: it fvo
r t;;.'tf ~ q) J:: ? t:i.~~ 1:: t:i. 9 q) '/)>, 1.183 ~ ~ ~) t;:.l. \ J ~~-r di5n,i*le ~t ~ ;f!J
ffl9 n li J: \, \O)-c9 0
. 19!J) illlfi)~~
'. i1/:iEG:J'ij Jit r:~~G:J ~ ~t.J~~#, i.J'?i!~=a:&#!!P-~ t:: r:tl'l;t. rto:i!-TG:JJ; -5 t,~:~i~Wt!:lt.::
i G:Jt.J'J c\.'·:d.::tal!l!t.J~OJm{tGI:< ~,,r.~mr:r;t., tvtit=a:-~-5 t.J;~,,
042
xt G T~~~~'C',cl:, 'Jfel:!)tc =r- ~ t,t a::9fPJf.J' G 6 O)"E"T )L- ,c:::.A.n T iJ} T!!fo.
m~ ~ , ~O)m~tt~~-N G a::~. ~ GT.illO)M-~6, +*~tt~~~
T ~,,-@ f.J', !15-@ \,' (;:j:~f!~Hc::::f!Jffl~ -@t~€dc:::: 4:> fp~~f.J~ tc>: ~ ~ '5 f.J'td: c ~-gg G 3:
l§lJ) 1ii...t?ift!
~I< """"J'/)'(J)T -'Y 'lt7CI:*f/J:(J)j_ ~ l'f;ru]'lt L., t:: ~ I!JA-8'1:1;1:l1\!ill£*~'1t~? t j_ \.I
CMGtiW ••
043
;: ;: -r·t.t, ~~~~ iJ~ t'O) J:? t:tl\'t~: t:O) iJ' ~ .:& ? y L ~ <~mliJ Tt·f'-rt.. 1 ~ 9 o *
~~iJ'~ ~~~:M'"? t t.t -r .:& -r .:&fii.J ~ ~~9 .Q 0) iJ'. ~aift:, -r O) _t Tf.]ilt.> -r:m:~ t:
tllt~-r- .t> .Q%~iit:"?t.. 1 '"( .:&. ~~ L 9 o *
~ t~~tJ~'~tm 'd::~-::> z: t:
••~m~~~~t~ . ~0~t~r~~~ J ~t~~~~~5~~~~t
Cl1X.a'::9o fc:CX.~i~B~;ty-{ /...ff'J~);"/-~O)fJ\ :ffih~ l \0;/] 1 0 iJ5~1t!} p.f;/J\
1) y -:J"fJ..01J 1 , -t"5~(;tfJ..l\0;/J1 0 (!5~$*-~fiJ;fifr;/J\t±j~O);/J', t±:JfJ..l\0;/]1 0
Section04 ~'it lute J: 5 ~c=. A. I!l;01J~ I;tJ\5' - "Y!W~t-'9;0~01§~~ ~ 0 rp
~t~ J m1l~~~IJ?.G J: 5 t vc~ a:: Gtc:tJ\ ct5 s ~J\5' - "Yb'~ < tJ..~~c_·
0rP~Jml'5 a::< l'b'td.. < td..-:J -c l_, a:: l\a':: Gko
·-~~t~. ~0r~~~ J ~~0~I5?.0k~~- ~a::~0 r~-~~~ J
~~;ttd.. < r ~~t~J[!;,~J t l'-3*JTtc:td..T7D-r~11)UJ A.h~ ~ t ~. 9;01:1~ ~
~I~ l_, ~ -3 t9 ~A.Im1l~l'9 o ~ ~ c· 0~-~,IGJ,~ t (;t rM;tBc·iJ5~ J t l\-:J
tc:@~~sm~~~~~-3~t~il5~. Mu-cM~~~~t~~~ B~ il5~
Q)~l:jjjj',G')~l\8 ( ;:1:71.At}%:h~
@~8 1<l?1.A1i
0~8 1 ;:J:5K5g1:J1iii~Jl.\
%:h~
!::.
0
9/1 0
10/1 X
044
~~Ht , ~~HE.!J! ft: ilfi1 .:t -'5 ~ 7'' - 57 7J~f¥tt L., tJ:. ~ttHtf.i.lG 1J "51. 5 * i± lvo ffftJ'
S N:rE~t ~ tJ:.? 7' 0 -T-ft:009 ~ lilf:JE ~et&l'J * L., tctJ\ <::: lv 'c:: 5tMHiit~~tJ~-t!:!
~J!l.&l9 ~ J:? [;:::tJ:. ::>fc..O) let, ::::] / 1.::" . : l - 57 t-:> 1 /57--*'>' r- O)~}Jdt: J: IJ'
)J'-~t a:; 9 o ;(1 L., T --~~ let, ffl¥&~ ~~~0)~0) ;_;;~t->~2", ~ \, \f.i.l(;?J'O);;;tJ:.
cO) r~~ ~~J tL' -'5~1@C: UIJ~Ji a::9o L:O)'Mf1!1&:3i~5R61) ~ 0)1et .A isjO)f±
~c:&l'J , <:: 0) <::: t ~ *lUt :ll istatt ~,,~,,* 9 7J', ~let<::: O) 'Mf1~~0)5R61)7J~:r
J[; ::J. 1J :;(b O) 'Ii1m let * ~ <~ b ~ T L., a:: -'5 O) C: 9 o tc t .:tit J ::-; ::J" t -r ~~ 5!
1
)]'- It ~'Mff!i&:3i t L., T, r ~ 2" J -¥> rtt ~ 1 fJ:. c 'et J: 2" ~? C: 9 tJ\ r.n2" 1 -¥> r~
-~
_I'_ :;-:-" ~~
'· -~ ~ ~ [·~ J
- ,-
') y::f l 0.9 0.6 I 091 0.1
1
) Y ::f3 0.92 0.59 0.89 0.1
...
0.21 0.8 0.88 0.2
045
5tta: c O)-fJ1H;L3::t.:Ar"'~tJ~¥-¥w~~~ ~ t->9\.. \rp~m-z: G tctJ~, l~~t<=t<l:ArJJtJ~
~it~ tc IY.l '<= t<l: r t' A. t..: !ffluta ~ Jdt .Q :fJl J tJ'~~-z: lJ5 tJ, f.l\-:::>~ O)~~t<l:A
r"'~ E! ~tJ~~ x.tcutnt;:t:tci: t; t,:i: ~.. \, e:: ~.. \ -s ~tJ~~ r- Jl-- + 'Y? *
c t,:i:-=> -r ~.. \ 9 0
Hitt~ ~~
~~tilir~(])~cmon c:- l. 1-@
1~w;w~
"fflBI;:::Al. '~i'ZJ'f.* (5' 1-t') t.J\'4 -:>iii)-@
046
~~*~ - A-~AI~~~~m~~k~~~ff·~~~~k~~t . M~
m:~~ (' ~l!l~IH<::-:J\,\~~fu ~~*~teo t8 Gtc~~ , -r ~c·~I~~ * ~o
1 952:$-~
1 974:$- ~
· YES/NO!l~It~.WF~~t.J1'J\9 - ::dr!1Ui
· J\9- /o:lf!>t!JHtlc-::>mll!W-Hi<i~
1990:$- ~
I5U±
· 7-'- 91J1 S~~i!; ;a: EIIJJ~HII til
. )./J O) ;lg~;a:~;t~OJ~~ii
p
J
047
10
~~·~~~-~-~~fit··~~fi~~~*~o·~~AI~ft~-A~~~
fJ' c? fJ>, ~~I. '11 rAI~~~I:f-tfl ~ tl.~ll:HitJ 0)~? t.l: 7 v -;;tt:?l. \ "t:;l§ ;it~
t ~ ~ c·. ~? "tts <t~l::lz:.?~iilii~~l. \"t"G J: ?o
E.A.I~Ii~1J~'~5Fl~~ti, 5~~~1!._
AimM~~~~~tt~*~~t~m~~~- 4?~~§ ~~~~~~~
tii!b o *9 ~*~<=7 - 5' tfff:tt:9 ~tJ'. ®7- 5'tJ~+n'lc:i!b~tJ'. ® 7-
0
048
<Dl®* lc:: 7 - $' tJ~1-HE9 ~ iJ'
9~~-~~~~k~~~-~-~-~J®~ID:r- 5~~•9~~~~*m
(]) 7-5 (c::::X19 .Q~H!'i~ .:Y;~u~~'J~ 7 JL- :J' 1) A.b.. ~9 o -f::(J) tclsl), ~:ft(;:::~ ~
tc ~ ~ (J)t,s. 'v \~~~7- $' (J)~f.jlf.Nd. \. \B (J) (;:::Jj L T ld:, 5J'~J'i:t.:Yi~IJ:t ~ ~ *
"ttfv o
~pti:'WJJ~?JHf .Q ~, <lb ~J'£~1;::: ;f.)\,\ T. 9~1;::: 7-$' tJ~1'¥tE9.@ r!Jltt (f)~
5i(f)~$ft~1l.!l'5J (;:::;f.) \,\~ ' ~-~ ~li +?tlc:::~g :;i] ~~f$9 .Q ~ 2:tf~~ *
9 o L f.l' ~ rt.fi ~ P • • {!:~1m~ t.: ~'8-(f)7CJ:~;11JJ 2::: 'v' -::> tc F"~Jm(;::: ~g ~ T 1;:1:,
~~'T - $' ~ t,s. .Q rif ~ \.. '~*~ ~1*.1 ~ tc 2::: ~ (J):;'E.1.~2~J ;/J{t,s. \, \ fct1J , f iJffl
*
t.J{lt ~ \, \ 2::: \, \ ;{_ 9
0
7/3 30'C 0
7/4 23'C X
••
28'ctC:Itc', 8~Ut
51llL 11J'S:ffitl~1.J'=f>t}
049
®-r- 5 f.J{+ )J'-iC:: 31:> ~ i.J'
ttl~~~iC::<f.:> \YC !jH;: 7-5f.J{ r31:> ~J C:: L' -5 tc W""C'it1'+7J'-fJ:7- .At
*
31:> IJ * 9 o -:J IJ L. 0)!~"8-lt r+~ t: ifl.Q '11' J C:: L' -5 ,~t.J{m:~<:>9 o
7''- 5 ~t.J<+7J'- C:: \,' ~ ~ i.J' c -5 i.J'It, 3@1ffl9 ~fp,JmO)JjE~)j'~-T-5 iz 'Y f-.
O)-~~IJ*~< W ~IJ*9o C::IJb~. ~--T - 5ft~~cA~9~-T-5
t.J{*~ ~.,,-?- - A """C'it. -rn~nO)? 7A C7J'-~9 ~:xt~) O)-T-5tJ{~=ftJ' s
~7J!f!{lz."""C'~'~"""C'31:> ~ C:: §btL T L' * 9 o
ili~<:>~. ~~5 - ~~f-.~O)®."""C'31:>n~~~~~~k~~*~O)-T-5
, ..........
- - - - - - ·-·-1-
. / 1 '\
~
=--- ••• - .
--- -
••
• ··-1---
. 1-
-· r---
o- ·-· -· ... . ... ·-· ..
::J/t:::J. - 5'..t-r:·
Bq-T-5'1f 7-5'<7)f&j~ [;:~:tJ1f
'flfi~ttTt, ~~--+1~~
<~JlJ&L-7''-5'~ 1J'1J1 ~--+ I;:l(1f£,~
E&iWZ"~~--+13~
050
@7- 5 t/'fE. ~It:Jc·35 .o JJ'
-f: 0) tc (Sf) , ~1rn:T~i:ttJ: l- \'fE.t:Eit:ltJ: 7'- 5 (1i~ rc::: *- -:J b .0 -r·- 5) fc:: :tJ G T
•~*H~~m9.o=~ ~n5~~ m~~¥- ~ ~~~ G~~n~~IJ*- it
Iva td:: :tf;f r35 .0 +t - r::·.::z OJU~i[ieyfE~~ rP.l..t ~it .OJ C: \,\-3 ~l!U~!rc:::t~Mill:~
1§1 ~~ffl G J: -3 C: G td~!5, t±:l J:J ~ ru;g:;f.tij.JE~OJrP.l..tJ C: l- \-3 'f£.1·i!t:JtJ: ~ m
fJ' 5 ru~if.tiJ.lE~? /7 - I-- O)~frn:tJ'OO~..tJ C: l-' -::Jtc:<E:S::It:J~~lJHc::~ :t
.0~~~35-00J<:'9o -f:O)fc(Sf),r0~T' - 5~5~~0)$·0)~rP.Jtt ~ ~ (Sf)
tc l- \J tJ: c.· C: l- \-::> tc'fE•Jilt:Jb'-:J :<ES:It:JtJ: 7-5 rc:: ~ttl! 9.0 ~ C: 1J'H G l- \MVHi:OJ
Mi.krcl:, 35 *- 'J 1~~ C: fc!: l- \ :ttJ: l- \ <:' G J; -3 o
:€1'1trl~7'' - 5'
)J Gtc C: ~OJ tf:l)J :tJ'lE'*fC::Jlil- \f[~H<:::tJ: .0 J: -3, "ET' J[_,~ Ell!JT1W~1t (~1§1) 9
.o ? WJ" 'J _:::(L T 9 c~ §ili 35 'J * 1§1) a -:J a::. 'J , £, -g· G:t .AJ3, 0) ,~, ~ 0) J: -s rc:: :J:tE
IDl!i:tJ'Jit C: fcl:~.N 59\ -f: OJJ.@~ ~ .5?. T :t tNWI:tJ'b JJ' 5 tJ: l-' ~ C: 1J'?9 l- \ OJ c ·9 o
-f: OJtc (Sf)Mti!X!'Fi§ic·ws%~~~ G tc C: GT, r35tJ:tc r;:J:O O C: \, \ "3W9~T35.0 PJ
Gl- \O) c·9 o te te GJ1i4f;:J:, ~OJ rp~Jm rc.::J:;J- 7[1 9 .0 tc (Sf) rc::M~!'F i§IOJ'Ji~t.N t9!1~
PJ:f.5W~9 .o:m:9EtJ'1'Jb n -z- <lB 'J, ~13dci:1'J YJ.J rc:: ;~m -c· ~ .o PJf:l~1itf35 'J *9 o
051
~~*~· ~*~*~U·~~~~~~~-~~*A~~*G~. ~~-~-·
1: • .:r A ~~.tst~~tiJ.lit£ c·~J::? l:)li.lfl ~ n ·n' ~ ~tJ' • .:r~•~J ~ Ji -r~' ~ *
G J:: ? .
«- / ''J. 7 ;<. :tJ 0) =r ;z 7 tc~: e:: 1<~: 2o2o 1f1-tf7Jm-r 13 mn~~ L- «-J L- 4 c~.&;E.I 'J
1
)
'!'IJ!fli
-~~m~~cc~ ----~--~
!ll't~5"-f1"~ ':1 ?
? ·:; / U
~~~rrl!l~@i
lfi!Jtilll
-I:?- J~.:f-$t}Jl¥~il~H:;
·---· ~~)ILI~~I!ii~Ht;
m'l-'~t.J: c~rmt~-:!1..~1;::
~btU.: 1-- JI,?lfiiJil!ll
052
~ ~i!fi:tUxfl~_~_~_ __
~:iffi~miJO)~fH<:;!Bl\T :t.~.fflt~~O)~tc9~lifU:IJ{:7\:~ l\c ~n Tl\*9 o
-{~~7~~-~-~9~~c~~$~-ffi~~~~~~b~9o*~~~
/\ - 7$ili~f'Jbhtc~~~~i. ~~ ~ ~ blc::: J:: IJSll.l~ra,:IJ{~::l\:25%, 7
-{~~~7~~~~%~~-~ G *Gko
•
80% 20%
)~;fflfJ~·
E.:.Sfd:\,\ I
053
~~'a:;§f21':ffl'<:~0)6!> ~ il'!i~ ~t&bfci: \,' tc. ~. .l:~~ffl!f! \, '~lll1i'""Z:' IT {~tJ'1'Jb
b. I-- L-- - t-: 0) 90%~..t tJ~ ~ .::z -r b. '<=- ~~~ i§:bh -r t-' *~ . z: z: -z:fr:bh Q
O),a:, ~$;0)fllljm-:r-v -r- O):!i~r->. r- L---5'- tJ'fiJ m ~ ~ -r -7 =n; [;m~tJ:
~~.A~ ~ G k~-~~o L.O)~- ~~t). ~-O)fllljm:!i~~~- G, -~~
'i-t ~/.,·~;u~ ~~O)-z:9. nox_ --c Jli:qo~ ,c~:. ~ m '<=-~f*O) J5~=.:r.- .::z r->
L
+
QOI
~~m~
:it~~~~ . ~fflti.:)5t
~-7"·;; H\UIR
l'¥~v#- i--
:it~~Ut · ~fflt*:55tv #- 1--
=.::t - :A
SNS
054
~.iMJ:flfH<: :t~~~~tJ~fiJffl~h Tl\ *9 o it~I¥JtJ::tO) C:: uT , ~N 6ht.::
•.iM~6~*~*~~~-~~~0)~~~~-~~Au~fi9~~c~ - ~
7 :t IJ ::t) O)~:tRtJ'=~~H1 6 n* 9 o
055
~ - ~~~~7®~$® 1 ~~ ~~ ~~~~~0*~0 ~~~~~t~. M
~~~~~~ - ~~~~~~~~~-ft®~t~~o·-~~~~~~ ~ ~~
~~:,;:~:, M~®ttl.l'J~~Dlfil! id:c®~11t . ~n*-r®~~~c~~.A:t.Jt G-c
7 Jta·'J A'b.~~~2"tt, Jm~~ ± ®~ftz!J[~.D~®? 7~55H~~~~;~uG*
~ o Amazon"t> YouTubet.;: c 2" * ~ *t.;:Web~ - t: ~I: !.b.:<~:&. Ldc, !JftE.:t-:;,
t .:t.AJ,z ';: t-:;, T :!lii'Jlit.;:M·~~Y Jla' ') A.b. (f) 1 ~ t \,\X.~\: G J; 5o
-- -- ~ il!l!i!*1/~pi'J~I
__ .... ....... ~-·
~ --~- -------- ,..
......... ... ........... ...
Ollri:.rt.JfcY.;.Q ....
rM!ri:.l1/tJ: ~ 1
·-~~tJ':t.J~~:IiG Tl-,~®1:~ o
lm7LH<:ttl2" n~J.b.:~~'<: ld:, M~®11J.liJ-t>~tflliid: c ®~1itJ'1'.t:I.JD2" n T~
0. J.b.:~~~ -rnS®ffl.~.:tt~.A~G*~o .A~~~k-:;,T~. ~*®!.b.:
~~6~.AGkM~ffl-~c~-~G*~o7~7 ~ ~?~ -~~~=~ -~3
~A.Id:, ·-~~~fiJfflGtc rscibidsJ t\,\5~-~~~fiJFF.lGT , ~®~5
t.;:M~I! 0)5~~ ~ ~)00{~ G, ftt*IJ: Web~ -~T" ~ ~ 7@~ :t:i-tJ'~'J-:;, T l-' tc.
1'1=~~1~~ G T\,\~®1:~ a
056
3~
ifti~*c, M~~~t->7'4-:15-=:.;?'!;:~
~~~~~~~~~~~<:~*~~~ ~~~
S !ci:~~O)ml~I~~!;: 7 :t -1J :::Z ~ ""Ct,,~a=;
~0 ~O)r.::~!;:ta:, ~f*O)':J-?7D-1J'SEl
1Jf9)~0)C'~ 0
12 --~~0)
~*'7-?70-
~ T- I.t, ¥*C: ~ {,::,- .:::z 7.L..mJ~0)'7-? 7 r:l - ~~ -n ' ~~ t... J; ? o .A 'r:J.:J..-
JL-O):Je!f&~~UO)~fi!6?~ c:·&-~~.::. c: 1.1~ <s ~J ~ 'ttJ~· , " 1:: ·;t ., .::·c: 1: 1 ?T.?
MrutVt"\.' ~ ~'t o
~~ ~ ~ :.; ;z -T 1>. 0) I~MH:J:, J.M m0) :.; ;z -T L..:d*l9H:: : tt>''-', :P J ~.t :J. 1) .A 1>. 0) )g
~r>tttftlt~~O)ttfllirP:J_tO)t.::61J t<=~1'T£1f~t.J{?? <, 7o -tz ;zra~~ * t.:: 1.. \fc~~
I) CMW:~tL~?T~ I'J@: 9<:C:) t.J{#~(..;~g \.. \ C \,\.::{_*90 7: 0)t.::61J~7
M :::t'7 - ? 7 D -
@J\1 J\-
;\=j;;< - 5(])
®f'.&:fflt~~ 7-:::J. - =/7'
7 )[,::f'IJ :J.'J.,.(j)
~tR
<l»jj~U~*(})
~ruft::~flllj
®7- 5(])
f,§~t::~~M:
I/::;;=7 1)/7'
058
CDr",UO) :J:Eiti~
~~~~0) ';.;A 7 .Am!~~ 9 .Q t \,' -? ;: t (i, r f. ''J 1-- ~Jl&""t'~~~ :tf!lt-> iJ
tc \, \j ro~~~J!t~ iol..t '-' tc \, 'J tc~: cfPJ;/J' '-' 13 0) § fl'gtfil'b .Q 'cl:9-r9 ~~'=¥'
0
3
~~~dJ.Ifl iJ T § fl'g~)lpjG9 .Qtc61J';: ';t, r~~~~-r c fvtc~:·~~~~fc\,\0);/J'J
~~'f*fj'glt:Wi'?""f~1T:ii5X..~< T';i:\,\'ta::ttfvo ~~~~""t''i~lt:, 31(61)""(\,\
. .
®~A 7 .!.\aigf
';.;AT .Lx~~tiL.cf.:>\,\T(cl:, ~~~~~0) ~~~1*\-,td~:-f*t IJTO) 7 D-~:15
X..a::9 o ~(L.7-~ ~ c Z:;/J'13l&f~ iJ T , :wJI~(JkJ(L. C-? \,\? tdlj""t'~IJ.Ifl9 ?;:,0)
~~*~iJ?~'?t*61JT<f.:> (Z:c~ , 0) ~0)7DtA"Z'~-~-~~~O)~
@7-$'0)!&.
~~~~:;.; AT.i.x,L.cf.:>\-\T, ~~-\->.:Y;J!U 't:~IJ,EF.J9 .Q7 - ~0)~~(ci:/I'PJ?zid:
~~~-r9 o §l)J';/J{~~? T\-\.Q-T - ~ ~5'H<::=t, '15~Jft->:IE~tJ{~Im iJ T \,\.Q
7 - ~~, ~ ~~-f.~f-~13~· 1J k7- ~~~Jfi9.QZ:C~""t'~a:;9o ~
~5' -f. "J r- 1J'S7-5' ~~-9 .Q :tJ$ 1<:: -:J \,\T,iSection13-rMm~J a::9 o
059
@;t~~!:F~? Jv:rJ .7-:'.AO)iltR
1
r~ -.
~~ + ~~
1'1'\/l- 1118 l.
• 41(
....
I I
... t~ s:
T = 'Et1J
060
@=E7)~0)~~
cv.:;;;J!IJm~O)~!if e: ~filii
-TlU*El*iJ{t±:lt.::: I:?~IDf.;Js J: lfff1illi~ ~'Jl ' 3:9 o ~llt'JH<=fiJffl Lt t.:::~l~d<: c 0) <
6 \,\O)'tj:ijgt:J~l!Jl~~l'E ~:b'~D~ <:: c ,;:~:, StAT .b.O)Ji:ffl'<=dBl'T :t.::k:~~~l'
9o 3:k, ~~l'il5h~~biJ:~tt~~~ O)k~@O)~·-I~~=?~~7
a=:-cn:-s~? -r~f'J~~l% Lt a=:9 0 t.:::tc. ~_;, :r Jt- :::f 1J A'.L>.,;t&.& ~_; -r ~,, <'<= -:Jh,
~~'J~~~O))l:i:t:J,<::X'J9~'li~g~ ~O) ~U13-t.J'!]'~ <t~?TE*9o .:Z:O)t.:::~, r*
ffl~95%0).mJ.ttiil5h';f~ 6 fci:l-' J c l,\? tdJ 5W I) 7-1 ~~:1E6t)T ;Js <£~~
:f.J\ cl5 'J a=: 9 o ~~IE c ~ijl{iffi 0) 15* ';t Section17, 18 -r fW ID'G [.; a=: 9 o
@~A740)ii,EJ.I
061
-~~~~~~~~~~ . 7~ ~ ~XA~~E·~~~fi~~~~~-~~~m~
~&·~fi~PJ *~ o .:.~i!?~ 3 ;...- -ct;t ~ * ~*~ ~ -~~~f~/J)ii:?I.'TM~
l.-TI.'~*~ o
7- $' :a:!l>(f~9 -b /5} ft (: u-r - 1i!Ht::~ ;z StL -b(7) lei:. ~ ~-c: 7-'-11 ~~~~l~
~~(: ~ 9 o~~~-~~~~~(7)~~:a:M*9-bk~~--~-:a:~ffl9-b
~~~~.0~~ 7- 5 :a: ~B9-b~5~ u<~:a:~-b~,::~.~~§ ~ ~ ~?
t.:::·~~- =£: 7 Jl- :a:1'FP.X:-z- ~ *9 0 uil' 1_, , § 7J'""Z"~2~9 -b il' s ~ ~5.i~ 1_, t.;":
~1nlt~ st.;':~ ,,~:t d5 ~a:: 9 0 'fJ.f tc::l-.X""f(J),~ I<=;J:~ 1_, a:: 1_, J: 50
. +~t67-~·1.i'fiif*"t'~~1J'
~~~S 7- 5:a:U~9 -b-~(:X ~~ § ~""Z"7-5:a:~a9-b~~~~ .
r 7- $'(7) ~~~~ ~-bM00 J t~-~An-b ~~~~~*9o~(: l_,""(, d5
-bD~ iJ{-iJ- t" 7. :a: ~~*1 9 -b PJ1l~tt :a:M~~ ~ lW~ f5~U9 -b ~ (: :a: ='15' ;t -r ~ *
1_, J: -3 o if:ra, ~1tf 1_, il'M*"J il{~ Jj:: u tci: \- \t~ -;§1 1<:: ~;:!:. 5 if:ra, !J)(~ 1_, tc (: 1_, -r :t it
\,\if\, \~+1tf~¥JJr U iJ'~ *~a:: it fvo
a::9o
062
~~fft->:Li?Ji~l;t, f*1i G T ~\.Q'T - -$7 «- A~-1 /-$7 -f. 'Y t-- tJ: c~~lff.l G
-r ~' .Q ~-8-t.J'(!5 IJ * 9 o ;:. ? ~' -:J tc T'- -7 « - A ';t ~ <O)t~-8-, fri&t->:lf~)3
i!J, ~filifli7f~tJ: c c·flj!f.l9.@;:. t t/-<: 2 .Q J:?, T'- -$7 IJ[ El t.J'Jf.~ G T ~\ a;_ 9 o
fiOINJ~t· )
it?DY-9~"
(
t:IML~,~....,......_
I
[ .....,.,.,..
...••••tt I
·-
~
CeliS~~ Q SearGh
....._.... ~""'
~· J. 329,177,519
;,;; 7,582,741,540 -
063
1/5'-f. ·;; H cl:., @i{~ · !JJ@i · E13Pf ~~ci:.G ~c L.dc~l.l~~tJ:-T- 5i.M~
fffl~h T<IB I), -t-:> c -t § ::kid: -T- 5-"'.- .A c § ;z.a:; -g o c (cl:.\,\;t_, AFa,1J~7
Web 17- c:·.::z iJ' S s ~(7)7'' - 5' 1f:tffit±l l_, T~~~ ~~~flj .Ff.l ~~ ~ ~ 3 tc~:~ s:t
It: a:: c ~~ 7 CJ 7 5 b1J{iB<'B!~ c fJ: I) a;: 9 o ~ ~ -c' lei:. -i- 0) 155! c l_, T 1-t*~ tc~:
Web
)j~(J)fiJJf.l : ~ .:J. -tf'- 7'5r)tf'
+t-1\'
1 7/IJ
W eb API 0° Web
API II
Web'?D-'5-
..
~ -
Q .A '7 L--1 C:/?''
/0?"'51>..
064
-15T::A? l.r{ t:':.;?· !;:t, -~ li~~H<::Web API~:11'~91<::&HiWeb-tt-ll--?
Web"J"- t:" 'Ai.J'67-5' ~:!1)1.1~9 ~ L.: ~ T:9 o :A? L.--1 t:':.;?' I;:I:.~!L:, Web
APi t.J'tH:E L;f,J.L\ Web"J"- t:" 'AfJ'S 7 -5' ~:!1)1.~ [.; tc.. \,\~-'8'?, Web API T::!DI.
1~T:2'f,J.\,\7-5' ~&:~~~ G """(\,\~t~-g-(;:::fiJ!fl~h*9 oA? L.--1 t:'>?' !<::l;:l:.,
1}~~h """(\,\~Web? D-5-fJ'§:!(;rt"fFJJ)GL;tc-:::1D75b.~ fiJ!fl G *9 o
Web"J--11-- ?Web -lT- t:" :J..0)7- 5' !;:!:, Web-tt-J\I<:::ff(:E G T \,\ *9 o fb
k~~~h6~~Jfi9~~2'~,75~~?77'~~-{:.;5'-7I-l'A (~0)
c [.; T 7 - 5' ~ :!DI.1~ Vt" \,\ * 9 o A FJ3~ 0)ft;:b I)!<::: ::J :.; r:.· :::J.. - 5' fJ{Web -tt - J\
1<:::7?-tz:A 9~~-8-1<::1;:1:, Web API ?Web? D-5 - , :A? L.--1 t:':.;?'-:::10
7 5b.~-{:.;5'-7I-1:Ac~i)7-5'~IDI.~G *9o
Web API 1;:1:.~1#~1<:: J:? TfiJ)fl fj;t;_fJ{* c /sf) 6 h T \,\ ~~-8-t.J'~ <, * tc..
Web-lT -1:::" A 0)1±.f~Bt~O)w~~~ 5Nt It:< \,\,~f.J'~1~T:'9 o tete[.;, ~ :t ~
:t Web API fJ'Jfl~ ~ n T L\f,J. \, ~~-8-1<:: IHIJffl T: 2' *it lvo ~nit: tt [.; T :A? L.-
-lt:" :.;')'~, ~*~~~O)J:~~~b-l7-l f-.? -tt -t:":AT:S?T:i:J7-5'~
~!I:~ n T \,' ~ W~b "7- /\It: ~jjffi G tc.. I), "1 - J\ 1<::7\:. 2' ~~ ?ilf~ .!§.;t tc.. I) [.;
k~-8'~~~~$~~ff~~bh~~~tt~SIJ*9o
W eb API C. "A? 1./ 1' ~:1'./(J);i. IJ 'Y 1-- • 'T :1- IJ 'Y 1--
· ;fiJ ffl!Ji*il~ ~U:: <11) G n T t6 I') fiJffl · Web API iJ<tJ:\,1 cfiJFI'JL' ~ fJ:\, 1
Web API ur>-r~' · 7'-5 O)ICZ~t<:%1H81If¥IT9~ ~
· 1±~~~0)~!1-a:::;Nt-:>G l-\ c iJ((j5~
· Web API iJ~fflS: c! :h T ~~I'd:~ I Web
· 1±~;Jt~O)f,'~W~~Ht~
17- t:";<..0)7'-5iJ~Illi.1~L' ~ ~
· Web API 'c~)Ec!:h T \,lfJ:\,17' -
· iM\JJ:ffH·~bn~ PJ~gttt.J(® ~
· - JE:O)m1ftc;<..:f-J[,t.J (li}~
5UlH~<:'~~
065
14
-~~~7 ;~.-:::r 1J 7..' 1...1:7 - ~ a-5§91!!1.1:11, 7-$1 a-7 w:r 1J 7..'1... 1:~ L. t.:Jf~l:
S~9~ ~t Y~~~9o ~~~~,ft-~~7-~~~~-~~~~~ -~~
~'- $1 (J)!~Jf~l:-:>\. '-rrutaA L, *9 0
1J T :::]' 1) 7-'- ~ 1;:1:, 11:7JIJ'\->1J:fv C' \., \ -Q±fu±EXtJ: c' tO)'T- 50) 1J T :J 1) ~~
uT\.,\~BO)C'9 o 1Jr::f •J 'T-5 l;:l:~l!u-\->9\.,'J:? lt: ~i@lt:~~~h*9
• 7-"'Jit.I.~::J-7"-f ~~
7~Jvi / ::J- ~' 1' / ?'lct=t ::> t =t*~t.;:=¥$C' , ~1J 7::J' 1) IUH: -:JO)~
~~~JIJ!:l:iT*9o
l*9o
• One-Hot.::t:~::J-7"-< ~~
One-Hot I / ::J- 7 1' / ?'I;:I:J"IJO);g Wit.i=: 1J r~ 1) ::8 It: l.;, -3& I_, tc.~IJ It: 1;:1: 1,
:t:n~~O)~~~o~~--c~~* 9o <=O)~a, 1Jr~~O)@~~~~~O)~
066
~* "5~)1,
3
I/::J-7'1' /?'
2 ::kll&: 2 2 ~~
~
~
3 ~0~ 3 3 ~
(f)
--;!
4 ::kll&: 4 2
0
-E
:A
C::
::J
?
l~
~jij
~*
1J"/"'
I/:::J -7'1' /?'
2 ::kll& 2 2
3 ~0~ 3
4 *~~ 4 2
~* One-Hot 0 0
I/:::J-71'/?"
2 *~~ 2 0 0
3 ~o.¥ 3 0 0
4 ::kll& 4 0 0
067
. ft~f~
~ftre~--~k~~~~~~~~~~~~~~o-~~0*~~~~~~
~~~~, 7-~0){itH<: *~:gO)if-jfitJ{~~ ~ ~ -c ~O)ifiMJ~if-1~J.liH;:~~t
-~n~Ji
X:t~~ii~cl:f~O) log (;Xt~) ~~ ~ (log ~;::~~9 ~) ~ t c·9 a JIO)f@:~:f-1-:>
. A?"-•)';/~
~~-~~~~~0)·~~~-9~~t""("9 a T-~~~?T~~O)Qf)-:J
068
3
I I I I
' - - - -- -- - - £!:~
0 10 20 30 40
700
600
500 -T'-9(])
400 U51i&t-'
300
200
100
-
L
0 0 +--r--~-r--~~--r-~
o 1oo:x10 2000000 JoOO:ol 4ooiDJ 50CiroJ oo»Joo 1oobooo 0 10.5 11.0 11.5 12.0 12.5 13.013.5
8 iio:>ilil!!Hcl: -1 00 - 10 0 8
6 Min-Max 6
7..7-IJ/'J'
4 4
2 2
('\ ('\
300 300
l¥~ 200 l¥~0
51~ 400 5:!'~ 1
200 ~~fG 200
100 100
0 0
-100 0 100 -4.0 4.0
069
15
fJ.!Unt~~"Z't;t, ~lfl9 .Qf,Uit:.g.t.HtT7 JJ.,:j' J :J..' k. ~iXtR 1,, t:T Jv ~f'F$: 1,
1 *
9o ;: CT)iz? :/ s / -r-·,;t, t:T Jv(7)11=$: C: $~(7)/J)!t: "?I.' -r, II~~ ~d.> -r 1.' ~
*(.;J:?o
t~;IH~~~ l<:c!B It~ .:c T'JL- e: lcJ:, .A:t.J ~ nt.:-T- 5 tl' s di5 ~tl:l fl C.AtJ=r-5
I<=M9 ~?:t~.ll~-=f)PJJ) ~ ~~ tl:l9 t.:6f.>O)~IJIFE"T J[.,O) <:: C: """7:9 o L. 0) <:: C: lcl:, r1iiJ
~iAh~tOO~WWT<~m J ~~~ -Y9~C:, b~0~9<~0*9o
mlcJ:.z-n-i:'n:l\:~ ~~.ADOJ%tJ'~t~ ? -rc~B fJ , .z-ni<=J:? -r c_ Jvt~:tO)~i\
nsn~tJ'tJ~;R:* o *9o ~~!JH<:, WtJ's tl:l -r <~ tJO)O)%:ti.R*? -r \,\~ e:
~X. T <tc ~ \, \o .z-0) J:: -3 t~'E7JLt~f!=JiJZ9 ~ tc6f.> It: lcl:, i\t±:ltJ 9 ~7- 5 tJ{
I·.·\
300 18 108
720 44 4 1020
1070 55 5 1610
070
=t:7 JL-~1'FJJt l.J tdl~,~-r (cJ:, -t-0) f*:Jim-c0) ~/11!.~ C~~O) U~ ) (cJ:-ct.: s ~ t.:J:
~-8-ii(~ <::: ~c-r9 o -t-O)t.:~fPl1J'~ ~ .Qt.J'J! ~i:Hcl:M~ *t!~ o 1 :X O)@i{~~
A~l.JT~~ ~c ~m~hTl.J*5~~tt~~~*9l.J, * *0)7~7~~~
~ttT~~( ~~~ ~h~~~~ 9.Q~~l.J h*tt~o ~0)~5~~80)'E7
JL-,t:M l.J , ~ fJ ~ \-1t±J1Jt.J<c·~ i> ~ 51t~1E9 ~ ~ <::: ~ r~~ J C:: IB'-U *9 o
3
5 /:9'bt~llfl.W~i~IE9.@
)\:fJT--9 'ET! i,. lli:h IE~
300
720
1070
18
44
55
4
5
.. ~ .. 108
1020
1610
135
1120
1380
~5~-~~M~k~-~-~9.Q~c~C'~*9o
~ 0)~ 5 ,<:: , lt17~9 ~7"-51t:M l.J T lcl: -i1!~B"Jit:~;\\,~'E7JL-f.J{~WJ-r9 o ®
.lci:M~ e: iVJft'O) 2 -:J O)J\~ I-- 5 -c~I!t.J'5J(:AE ~ h~ O)"l\ ~~=r- 5 ~
7-f 'Y r- C~-8-) 9.Q~ 5t.:J:J\~..>< - 5~~9~<:::-c~ l- ,:r:::r;L- ~ fFJJt9-Q~
(:: jJ\C'~ *9 0
071
..Z:.h L''d:~[~H<:, .At.J7- -:$71<:: 7 1 'Y 1--9 ~ J: -3 t.J:@:ii@'ET' )I,O)J'\'5 .>( - 5'
\, \ ~ a;: G J:: -3 o
';:: -:::> \, \ T ~ ,;t T <:::. 0) J: -3 t,J: J \ '5 .>< - 5' ~ i*9 ';:: ld:, c 0) J: -3 id:
~l!il~;iJ{@ 17] tJ;O) c· G J:: -3 tJ\o
I<: ld: :t J c 1~*t.J: :t 0) :t ~~ <db IJ a:: 9 a:: tcXtJ 7- ~ :tif.l&tc lt""Z' ld:t.J: <,
0
mlt'H:T'Jt- : y =ax+ b
072
9«TO)"F~7'-5' 1ct{PJf:l:t < IJ ~l.; "F~2" tt 0 L. c C:\ 'E "T'J[_, O)J\7 ;J..-
5'tf~~~2"tLT~\e'_ 1~J.zlc:JEL.;~\.:r;;~~ · 5:i'li!.l'H~5f:~t±.J:tr-c·~-QJ:-sr<:tJ:IJ3::
J \ 'Y 7-"F~ <:" (;:1:, 1 @J (J) '¥'~<:"9 « T (J)"F~-T- 5' 1ct ~J:f)ZI,J:f 3::9 o -t-tdt::
xg l.; T _:: _ =J\ •;; 7-"F~ <:" (;J::, 1 @] O)"F~c· r J \ ·;; -T- +t-1' _A' J C l.; T ~~JE l.; td5z
0) -T -5'~, ~"Y7-1'"Y"F~l"~ 1 @JO)"F~l"1~(J)7'-5'(J)h1ct~hJZI,~<:",
"F~~~1ft!jl.;;3::9o
5' (J)q:<f.J'S 7 "Y-:7, Ldt::, - l:5'33:: td;J:: 1 ~ 0)7'-5' ~~J:fJ6~ <:" '¥' ~ l.; , L. h~
< I)Jlg_l.;;3::9o *2i~rt:llt::9«T(J)7''- 5'1ct@CJ:f36VL.c(t::tJ:IJ3::9t.J\ '¥' ~*5
~i;J:: J: fJ ~1~(!)13: -3 (t:: ~i!CJ:f36~tc7'' - 5' It: 51--:J ~ Sh0t.::66, "F~(J) )IIi'lJj'; \t::
J:--=' T'l!ffjgt.J<~t;0 7 - .At.J'<lS IJ 3::9 o 3:: t.::, J\ 'Y 7-"F~ l<::lt«T "F ~ 1tfr -3
@l~t.J'::g,.< tJ:-Qt.::66, ~w~:]i:t.J'--_j;:__~ < tJ:-8PJ1m11t.J'rS:J~\c ~;Z3::9o J\·;;-T"F
~ c ~ 'Y 7-1' /'¥'~ (t:: ~ ~\T \;:1:, ~J((J) Section <:"2" S I<:~ l.; <~~~Jr. l.; *9 o
.::_ ) .
=--"""'k - =-:\ ....,.)
= -~
-
- M •:f-
.
9«T(J)-T'-9ft 2:. = ri'";17;:2)::!L:
- ~(L:"F-~ fJ't;::_ ;t. I) (;:p(--j("F-~
073
'~'')17-~~c
'.t/71'/~~
' ' ·:; 7-~iS'I1~7- 9 ~ -f5<:~!!9 .Q~~!<: ~ .Q t::. 11) , "E -T Jv O) ~ffil: ll\¥re,lh'J'
;I)>~J
*"to -:/JO):;f/71 /~iS'I1, 7-9~~,~ -('-?~i!V?-?"E-TJv~~ iJ."t·
~ffi ~ Tl. ' <t::. 11), "E-T JvO)J!fJi~'V'fd!ILI:~"T? !IH~O)if.> .Q~$;t"t·~Jtt> 9o *
}'\ ':I 7~9-z' ~~. 91'\.T. 0)7-1_1 {t~? T. "'E7 ) [.,O)!OF~ {tff? £\~t.J~dt> '? *
9 o -t-O)tc6f.>~$!R'fra,~~~l=~l<:~ <tJ: '?, "'E7 J [.,O) !OF~ t. "'E7 JL-1<: J: ~-T;JtH~
~'?M G T.ffbh* 9 a ~O)J:-'5~ . -T~{t~f?-GT.~R9~~${t:;t77
1 /:'f:~t.O!J!U* 9a
* tcJ 'i. ·:; 7!0F~-cl~, fiT G ~ \ 7'- $' {t "'E7 J[.,,<:J.OO!fl G tc ~ \~1§l, f/TIB 7 - $'
9«.T.{tA~t.GT.~R{t~'?~90~~~'?*9a-t-O)J:?~~'?~ G~&
187-9
074
;t / 7 1' /!ljf!i!i(cl:, "E-TJlii<::~:H&O) -T- 5 ( ~ .=r\ ·:d~ c IJP(<fh~'J'~ fd:.§ll.
m~, ,~O)-T-5)~~A~M~ T~~~ ~~~tt~~$~~0 ~n~~•
-lf-1? J L>tf~<, ~ ~ ~-\-r-?'t.J{=FI<::A~ c~¢(<::~0)-T-5f.J{~~~nt.:::=c
-T- 5 0)1jl,j¥Nicl:{~t.:::ht-'~ <~~ -11, iftr G 1- \7'- 51'\.)00!it G I<:< <t~ I)*~ o
~11f.l
(~m:t/J:l, IIRJ) Wiut-17''-9~
~;~*~
'E 'T'! IA7)~~ 'E7' )[,(7)~ill£
075
lltit$~7 Jv :::J 'J ;(.L..t.:sl.'-c*:m(J)7- 9 t.:M9 ~7 i!IIJ · .;TB'!i~(J)~8JEt1 t -c
-til~ t-·9ti, ~!i£(])/5~ ~ rs,ltx ~ t -t (])*6!~U1 *-:>
t.: <.IJ!(])f.t 1. '-i> (]) t.: t.t-:>
* '*
-c 1.- 1. 9 o ; : ; : <:-11 7- .A 1--7-9 t.:J:; ~ lE 1.-l. '~SiE/5~:!~$V'* 1.- J:? o
t~Miit~~ l<: <f.) ~ \Tm:~ tJ: L. t t;t , 'T' - '71!:~~9 ~ L. t ~:*JOO)'T'-'7 0):5f
tJ\tf:l""[ <~0)~9o
)R.{tti:Jjg~~&E9 ~ 5 X. ~:k~ tJ: L. t lei:, r~Bit:fiJFf.l G tc.'T-'7 ~~Nit:
~b~~\ J t \,\5 L. t ~9 -'fO)fc.dt)lt:: t;J:, ~~7'- $' t t;J:J.l1Jt<:~ill9 ~f.::: !It)
0
b1£:·~~~Ff.J9~~~j;:~~~-(:~~0)~9o
~E, ~~?- '7~-'fO)a:::a:;:7A!--7'-'/C:GI:~Ff.l9~t, ~IDf~O) 'E'T
076
~~7' - 5'~7:::Z i-- 7 '- 5' C:: L "L ifffl9.Q (: ... ...
~~7"-'9 :r:::z t-- 7"- '9 ::UOO)T'-9
I --
~~ ~ill ~I'll 3
tilt
'ET'J[, ~~~O'J.'t:T'J[, ~~~O'J.'ET'J [, :tilt
~
~
0 (])
/
0
t
:::z
:ffi~ : 100% :mM: 100% :r.J~:?%
c
(1Fs8~ L..: n 1.QO)'"'("
:J
(:*W0)7''-9"-0)f.l~,
7
i5J 157''-'91.:::~ L/-rl;t 91J:tr55R1t•i1ilb'/ J:9
n~tJ:f,lj~J b1J'St~~') j,f,j
0 ,. ~
0 .~ ·
:ffl/1' : 100% ffl/1': 7 0% f,!j~: 70%
(f}Jd)"[ .A:h<!ht.::7''- '9 (7-:::Z t-- 7''- '9 ci5.1 15:!*55l
t~(7)'{"*~7'' - '9 d::. •J ~ t~ 0) 1"19i~iHl~ c 15J~(7)5R
M1i)W;"5 .Q~B" t, i!5 .Q ) 1ttU§1JI'Jtllffl1"2' .Q l
ttL c ·(;:l:, ~~~H<::~~T' - 5' c T- A. f-. T'- 5' 1U::' '3 b ft:h r;J:'J:: \,\ O)l:' G J: '3
fJ'o \, \ <"J fJ'1:J$ fi<J5 1J *9:b\ 1~£Ht:Jtc~: =F5! cVC ;)U''\- :J':f.J' G 71\- J[., ~
7? H~~IE C:. K- -5:J'~U3Z~~~IE (K-fold ? D A./ \ 1
) =:r·- :Y 3 / ) 'Htl:fi' G *9 a
077
;J; -JI.- 1'"7" 7 Htill C:: ~cl:, 7'- 5' {f:~~FF.l-T-5' C:: 7 A 1-- ffl-T-5' ~<::ilt>-@~IJ
~~~~LT~~~-@, ~?C::~-~~~~~$~~o~-~~Ff.l~-@7'-5'
~~ci:-'E7 J L-O)ti~~~t: ~*a~-@ tc.tht6. -@ "' <~ ~v \I~ -s t.r~ J: l-\ ""Z'~tJ\ ~ruH<=~ffl
~ -@7-5' ~tJ' 0't6.9~-@ e:*m 0) 7 - 5' 0) l,\ 6l-\6t6. J\ 5' - >'ii:t~~~-@ z::
C:: tJ~~~ t6. < t6. 'J a=;~ o 7'- 5'~fl'!J%:;;V6.~~~cl:, f&Jzl!O)~~~~{f:9-@ C:: ::1
~~~ - -$'0)~--~~~~J:'J~W · ~~~~~~~~?TLa=;-:Jk~,
7"- 5'~Jtt.l~l=;t;l;i;::
~ ~ ~~\3"1;:::
@!ffl~ tt ~~;nc-9
4: 1
C:: O)Jt\- )[., f--:'7? ~-- ~~iEl'~cl: , ~7- 5' 0)-ff~tc ~t{f: 7 A 1-- 7--5' ~<::~Ff.l L
a=;91.J\ T- A 1-- 7--5' O)~U1n<=iiffi 'J fl'CV., -@~~t6. c ~;:::, JE~~<::~ill~~ fd:lv\
;: C:: tJ'CV., 'J * 9 0
078
K- 7T'~U~~~ill~J:, It\- J[., t-: 7 '7 t-- ~ill~c:tt"", /\$'- /~lc: d::? ""t 3ffi~
1Offl~OCOJ~~~;mti.J'&:'!t: C: fci: fJ a: 9tJ\ ffl.ttt.J? C: :t/b. <ftbh -r \,\ ~~
ill1J$c 9 o
c9 o L. hie: J: fJ 1~ S tL~ =r- $' ~'c: I/Gi G tcJ\$' - /9""-r ~~"§1 · *9?:~iE G a:
9 o -t- OJma~ i'J' S~-8-Et:J~c::: 'E7 J L- OJ~OC~~ill9 ~ OJc9 o 9clc:ilfr G tc 2
JOJ'F$C:.tt~ G -r~ <0)~~7-$' ~~n.Qtc69, 'E7JLtOJ~ocrP:J J: t.J'~~
079
18
~liit~~"£7 J[t(])~liEt: J; IJ' "ET' J[t(]):fl:t.J~!iiU:::iE~O)~Ut T'- $1 ~f~~;: <::. tl-r:-
~ * 9 o L iJ' L, ;tUtT'- $1Ci. -f(])"ET' Jv(])tfii~~9illliY:H:~N L -z:~; '~ <::. C.t !5 ;t *-tt
fv o ;: ;: l:'C;t., ~Ut7 - $1 iJ' <:> "E T'Jv(])'liii~~ iE L <~JJ!9 ~:1])!~~~* L J:? o
.:Y5~U C:: :iF§t.J~ c t1 <· G \, \lil!Eh T \, \~ 0)7'J'1J{{~ C:: l.; TlJ?.na:: 9 o -1:JO) ):)'~~l:'<J5
ntt, -z-n-f"nO).A:JJtJ~-z-n~nfoJO)=JI"\.Jl.ttc:: 7J'~~nt.::O)tJ\ ~e: L.;-r~~
c· ~ *9 0 l_; tJ\ l_; L. 0) J: -5 1J:~~tc tt-c ,;:1:, r L. O)=t7 JL-t;:l: c lut.,::t£1lg1J: O) 7J'J'
<J5 ~ \,\ t;:l: r L. O)=f: 7 JL-'<: J: ~ $* "- O)~IJ~t;:l:.~3.~~ ~ O)!'J' J C:: \,\ ? tdlt~ tc>:M
rp~t<=*~ sna::-ttluo
-fL.-c0~tJ:O)~, ~~~7-5r~~m~~~m~~~&tt~~r~~J9
~;::. tc9o L.O)iz? ~ 3 :/""Z'ti, @J!IiflC::7HJl:t<::<IB\,\'"f=f:7Jl.t~W!Zfiffi9~feH~
~*lj:1i' l.;3:9o
~IDitC:l:t<:'lcl:'l'-t~
te:tJ .LEa te:tJ
G~
15 20
80 - 76
45 48
tl:l:tJ
IEa
.iE*
0 0
I ~I l', t:'tl <6(, I
0
X -
X
X :.iE~
I ~ ;'( '@(}) ?
:'f.iE~
080
@l~'E 7' J[.,OJf!tlli ~J:~/.fs:a"J I<:,
tl:l1:J C: JE* O)~f@:OJ~5:J' ~ 1!5 ~ r 75~~~~~J
~<:: J: ::> ·niJZfiffi~ 2 ~ tc elf), [9]~i'E7' J[.,OJ §iJZfffiit~H~!<:: ct-3 It ~ }~J, \ !J:, <:. OJ-=t~gR
§ ~ E (J) J:? t::~~t9 .Q fJ\O))lt, \ C: G\;t a:; 9 o 2" ::> -r <~'!!..OJ«-- V'fJ' 6, 1-t*
I¥JtJ: R ORIEf*~), RMSE (:if:1J:if:P:;J=*~~), MAE (:if¥:;]~~1~~) 'if ~il
2
..
..
.........
. ....
......
,.
081
( 1) R2 CR:~f*~)
R2 (~~~~~) ,~, 7)~~~~~~ 1HJW~ (~~0)*~ ~fd:C' ~+6 x_~ L t) 9
~ <: C: l'f~ Sh~t~~-r, a;:? tc. <.:Y5~.U -r~-n,,tJ\.\t~-;S{f 0, 91'\.T75~U-r~
082
~I..\ -r, 5H.il'E 7" Jv ""('9 o 5H~=t:5" JvO)WJZfilli""('li, @J~=t: 7" JvO)~.g- c ~tel:
tJ t±l:t.J t IE~WtJ{~& tJ ? ~;\?I-:-; tJ{~~::15 x. 6 n~ tc. ?tJ, -z-n 6 O)J '?1- :-; ~
51-8-ftJIJ t \,\-5 ~lc::: 9 *
tJ 9 o tc. c ;t(;~POJ t r XJ 0) '7-"'
~ <:::: t tJ{~* t tJ:
3
J v~:5:J'~~9 ~rp~~""(' iJ5tL it, t±l:t.J t lEMtJ' l& tJ -5 ~J\?1- :-;let 2x2l'4 J\5-
T: True (-i'>~~:t.JI'~~-:JT\,1~)
F: False (-j'>~ :t:f~tc. -:JT\, I f;j:\,1)
roJ c:P1J! P : Positive ( roJ)
rxJ c:P1J! N: Negative ( rxJ)
9tJ\ JB~Ic::: liil'lt 6 n 9, t::"Y-:7 O)~'R""(' \ifb tc. r:t1U~ G td-~WJ 0) ~ -5 1<::5:J'
~~ G * 9 o ~tr:. C'~ G tc. T' - 5 I<: -:) t, \ --c li lE L, 1.. \)J'~~fl' ""(' ~ --c \,\ * 9tJ\ fft~
"':;~-c~~~~ fr ?IJO)i~
7 - 9 ~ IE G <~!1Tt- 1~t;£W
083
L.L.'C'~;l:, TP, FP, FN, TN-a:~IJfflGtdt~ft-JfJ:fffilljm~~4-:> , i\1B:fi'V* 9 o
)£EiH7JIJOJ~lH>~m G *90J'C', *~ G fJ:b' G~Jf~@)-c <tc cj ~'o
IU~$ (Accuracy)
TP+TN
lEm?¥=
~1*(7)~ (TP+FP+FN+TN)
T: True ('H.Rt/~t<:::J-n,,.Q)
F: False (.Y~f.l~'~t.'::::JT~IfJ:\,1)
roJ c-FfJ! P : Positive ( fOJ)
rx J e: -FfJ! N: Negative (fxJ)
~m$ (Recall)
TP
TP+FN
ililll¥1;J:, *~It:'< Jt.-tt :de~ - ~ 0)? ~, .1E G <'<' )[.,(: G -c*m'C'~ tc~
~0)1/IJ~c G-c~~cjn *9o ~ffl.¥il'fflt,\Gtl,.@-7 -/Zc GTI;l: fJ\'Y~'<
)[., t G T:5:Hfi: GT .:t F"'~!mfJ: <, il' -=> '<' J[.,O) -b 0) lilii* ~<:: '<' J[., t G T7J'M Gtc ~ 'J
t ~, ":) tdt).JL"TC'9 0 ~1*~n G-c 1a:, mmO)~!fitJ<* If Gn *9 o W9mOJ~
W[(<:B ~' T li, (pg~'C'Icl:to-: ~ \7' -~ (J \'Y) ~friJ~C'cl5 -Q ('<" JL-) t!J!UI*JT (~~·tl£)
GTG*5 L.cJ:i'J.:t , WSm'C'~.@-7'-~ (xJL-) :a:~~GTG*?L.c (~
~1i) O)/]iJ\fB~C'9o -f:O)fc@), ~ffl.¥1J'~J~cjtl,.@O) 'C'9o
084
~'15$ (Prec ision)
TP
TP+FP
F iii (f-score)
2X 1ij!~~ X ~(3-~
F1~=
¥ij!J2~ + ~(3-~
-t~""{'~~m~n~O)~F ~ ""{'9o~~~m~~-!3'~~~~-~~70)~
'~* t<: d5 ~, -1JtJ'* ~ < tJ: ~ ~ :t -:, - 15 tcl:JJ, ~ < tJ: ~ * 9 0 ~ O)~m¥ C!l~i3'
¥0):lfl~ C WMO:lfl~) -a::JUl~~~""{', J:~J:~'Wffllim~~~~*9 o ~h~ F
1@. ~ ll~J!,3\ 0) ""{' 9 0
085
~¥t$til: -t,
I\~ J'\-1'\? )<-9 t:
=E-T'J ~(/)7 :1.-
7 Jv::i 1) ; ( AO)tifm~
= /~'
IRL.t ~it .Q f.: d.> I:AO)=f. -r ~ 7 Jv HPI!l Gt.I.
< "tl;t t.I.6f.I. I.' I ~ 7 ;( - -$1tl ~ ~J*-9 o ;:_ 0)1 ~ 7 ;( - -$1 ~ , l \11~ - 1~ 7 ;( --$/c
lllj1tJi*-9o
J \ 5 :/> - 5 t.J~W!~~O){tjt ~ t->-t}]f:i-fci: c', :C7' J[.,O) t:p I<:~~ -2' :h ~~f*S"Jtc~:{~-c' <J5
~ O) I<::X;J G, J\ 4 J\-J\5 :!> -51J::C7' J L- ~{PJ~}ZJ::\:1<: 9 ~ O)f.J' Ci~~~, =~)Zffll~'R,
=~x!lil~/ci: c) t \, \ ? tc :C -TJ [.,O)j;;:~ ~ ~@)~{@:~;w:'* l_.., ~9 0
~
1~5:;(-9
~
-'f'f'!l-Q)¢51- 2 ;'J:_ y=ax2+bx+c
-'E'f'!l-Q):t:H'=
086
~JC v-c 7 J[;:J. 1) X b. C'2~..X5T/1 7 70)~ (~O)'t-TJL-) ~:l{UU9.@ L: c
~~X..*9 o """f ~O)~~f.J'~O)'t-TJL-c 9.@ c, ~~~~H<::fMc'bf.J'IOI.f~9.@ <::: c
f.J'l' ~ .@ -T- 5 ~;t -t L: I<: f-1 ;( ((;f 6 ~ ~) 0) *-..:> t.: jit@. \,\ ,¢..\ tc c ~X.. T < tc
~ \,\o tm~~~--r l;t, 7 JL-:1 1) ;(..b.f.J' -T- 5 ~~~9.@ L: c --r, ~O)'t-TJL- (~
B:tlii\,Jt--z:' 65.@ t.: ~' @il\,1l1.." I;!:Et1i\U:t!.~ 2''--c -3 * < 'i3UJi \:' ~ T \,\to":\,\ L: c t.J'bf.J' fJ *
9o L:O) ~*:It~f.J'*~~"""Z:'9a fd:;t.), L:O).t-31<::t 7' J[;O) :~IUJif.J f.J\):EfJtJ: \,\ L:c
*9o
~ T, ~)Z~f.J\ 1 O)'t-T )[; C:l;!:.§j!~~~T -3 * < ~lji l'~ fci:il'-..:> t.:O)l', ~/3t
1-- ut.:'t-T JL-~f~.@ <::: c f.J'--r 2' * Ld.:o l.J il' l.J , -T-5 O)fd:f.J'-..:> tcffB:lJ'I;t ~ O)
t -TJ L- (~~) il'~/*;::2'<?i-tLT <t.>fJ, L..tL--z:'I;!: ~O)t7'JL-~.t<~lUJi--r2'T
\,\.@ c ~d: §X.. *it fvo L: O).t -3 fJ:t"T JL-\:' ~;!: , ~~-T- 51<:Xt9 .@~/3tld: rE:J <
. L
087
fi]AZ- Si'O)~J,;:l:, ~~~ 'ET' J[., '<:: d'3 (t ~~J?JSU<::? 'v \ T~ }{. te :t O)T: v te1J\
~~lc::I;:J:f1Jffl9 ~ 'E T'J t, -i-n-z-n -r:5;R~ v tc~:(t n lttc~: stJ:\,\J\1 J'i. - J\ 7 ;~..
7 (:: \,\\,\, J\-{ J\- J\5 ;1.. - ~ fi~:fm0) $ T::t :J t :t ~ \,\ }\-{ J'i.-J\5 ;1.. -~ ~
~,-g·~m-r:a *9 o te te G, {~ffli O)•t.J~~ <t;s.~ t :t~•~lc::~t~::l::f.J{~::*:: 9 ~
te66, ~~7'- ~ f.J{~f.J' :J te l? 'ET' J[.,f.J{~~!ET:il5 :J tel? C::, -@]O)~~T:~'~
e: tc~: ~ ~~ii:t.J{::ka "'\~-a- 1c:: l;:l:f iJffl t.Jt12EJift-r:9 <: 5 "'\ :J tc.:t~&lc::l;:t9 ""-r -r:
0
l;:l:tci: <\,\ <? :f:p0)*£!JJ-'8-:bi:t ~ ~1j l.; , -r 0) 9=J T: :t :J (:: :t ~ \, \} \1 J 'i.- J 'i. 5
:f..-~~•m9~=J:$if•m ~n a::9o <:0)~5~~*~*~=F$if~~v *
9t.J\ <: <: T:l;:t-r0) 9=J T::t ~ <fUm ~ n.Q :t 0)~ "'\ <?tJ'*Bfl' v *9 0
00000 00000
00000 00000
00000 00000
0 0000 00000
00000 00000
· -t---.:"tO)tfiJJ.i%t.>iH:iitrr97.>0H' , - ~' < :J n' O)ft!l. JJ.i% t.> tt?: iitrr L.. "f 0)
t.? t t. J::~\/\1' 1~ - 1~7;1. - :9t.Jq~ <P l.'t.-:>tt.J;.~\1\1'1 ~ -1\7;1. - :9
l?;h-Q Hlim-t;;,
- L. t:J' L. ~+~•m•~;;~;: 1: t.j:;;, t::t~>. -t---.: -~n9-QtilJJ.~t>ttO)~tl>n'-'~*~
-c Eitrr9;;,.: t ntlft L. ~ '7 - A t:J{ ~ ~, * t,;:-~ $1.J{:f!H£ 9 -Q
088
/\-{ 1\ -1\7 .>(- >' O)*E!d':f.ilbtt~ 7/7 L. 1<: ~11'9 ~-¥
$ o {PJ J\>'- ':-'§itf'J9 ~f.J,~:Jl'l:AE9 M2Wc~1'J9 0 <.: C:
~~~~k~, ~~k~~~=90<:C:~~&
089
-~~m'l:s~.' -rf.l!:~ ~ ~J ~m' ~ 1-r ? 1:11, *ilili-T- 9 t t.t :Q *•(])
7 /'(JI-1'1 ~
7 - 9 tl&,~1"9 o - ~xl:, *iGiti-T- 9 Jfl(])7.1'(JI-1ttt 1: l;t~ll!1fitJ'tJ' fJ 91J', '*
~~lb~m'H~? t"'fiJIIJ*=Il~~fl:;~ -tt9''1:, 7r\Ji-1ttt9 :Q-T - 9 ~j.,•f,t ( -z:·~ *9 o
hfiil t \, \"3 ~~ 7? $7-fcJ.I])fJ', ~;fflt~ ~l' -'¥U J:E t_., fc\,\ t t_., *9 o il!iH~I<::IilE
mO)~¥&tJ'{113-~ h T \,\fcJ_ \, \fc~, @j~- -:> --:>l])lEm~ Atl'-'¥U:J'E l_., , f:I]) J:.
tuT,~-~-I"~fiiJ@~--~ll-:>~~lfct61J,~M~~MV~~IJa::9o
71'\Jl.-ft(t(J)
::J .A 1-- tl}&i\,'
71'\J l.-ftft(J)
::J.A 1---t.J'il!;\,\
090
~~~-~~k~5~. --~- ~~~·~~~~~~~~- *~®~-~
f.J' s 7"'Jltf;:tft~l'(~ ~-~ ~~~ ~ ~!Z,~tiifj t) *~ 0 ~ f.J' ~- {PJ~~~(;:
Jn~~n (t J: L'®l' u J: 5 t.l'o 3
*~Jet, 9: ~-- 6 t> t.,l-'7- ~®7""Jlt~f'F~9 ~ L. t C'~ o 13JjStJ'i<: I~5)1Jt.J'
-::/ ( ]\:jiO) ~- ~ J: t) =5, [~j:JIJ1J' 3:: ~ S b l_, \, '0'~0)~-~ 0) .:;:71'()[t~f'f./JX l_,
lj liffi.\SA
foJ.\Sifflb'
¥~;t-rt>S?
091
rtlra, (query)J C: \,\ -')
lmiil~1!l-r~<t, r~'i!i:& (Ieamer)_._~ r!I9JJl1J~ (oracle)J
092
~~~(learner)
1?7?
Membership 3
Q uery Synthesis
l=l
';;1'{)1,1';;: L,
7'-5'(7)~*1)
(7'- JL-l
~tmutc:
*~'S p l.,t,\ j''-5'
stream-Based Pool-Based
Selective Samping
Sampling ~ro, (query)
j
't-:JC::'t *~'SpL,~
:f'ifflC:
a:~ Sp l,\, \ fd:lthi;l:'
%gf-~
T'- 5'% 1 -::>)1M;' fi~
IH~ ?-"'JL-I;t
OOZ:'9
(';il'()!,j";jlt%1'1"5)
~lb, (query)
093
~-~#~ffi~~-~-(~t~ft~n#A~A~~Y.~*~-~~<~~-~
\.I~(: c·~ o j'-' - ~ ~fljJfJ~ ~tllit!':F~t:1'J\. 1 "'(' 11, folii:lt~(~j)IJtj; ~~ 'ij/;l:!l!~c· ~ o
a::9(;H§~~1~dt:-:::> "' ' -rm-:> T eta~ a:: Lt J:: ?o ~§00~1* C: (;J:, rc!5 .@~~:b{
:*: ~ \,\ C: ~ ~;:, itho:>~~:t :*: ~ \, 'J rc!5.@ ~~:b':*: 2' \,\ C: 2' ~c:. f{gO)~~(;J:Jj \
~ \, \J (:\,\-:;>ti:~~O)L.C:l'9o "M"~'ifJEO)ffi~~f*, f~~'if~O)ffi~OOfft(:
"''"''*9 a tc C: xJ;f, ~~1.J'~l-,}d~cf4s:~ :t~ l- \~rPHt:c!5~tc~. ~~C:.p.js:
~i;J:JEO)ffi001.J' c!5.@ C: §X.. a:: 9 a ~R tc: ~~001* C: C;J:, rc!5 .@~~'if ~ 1~ ~it tc
e: ~ tt:, 1~0)~~:t~i~9 .@J 001ft0) <::. C: 1:'9 a ffiOOOOf*C: t;J:)31J~l'i!5.@ <::. C:
'if 1!~ Lt a; Lt J:: ? a r ~~:b'~ 1., \).j~ c .p.js:;i::b';i:"' \J C: \,\? ffiOOOOffttC: <f3 \,' T i;J:.
r ~~'lfie!l~iitiif4s:~:b':m < tJ..@J ~~OOffti;J:JE Lt 1., \:b':t Lt n *it Iva Lt :b' Lt.
r.p.js:~'!f*~it~-~~~U .@J~~OOi*~ JE Lt <~O*itluaf4s:;i:~*.:t T
:t~~i;J:1E!l U9, tete"}$;.-:> T \,\ < tC. ~-n:: tJ.-:> T Lt *\,\ a::9 o~~t~C~t~IH~~~)
!ltll
* fl'A. = ¥.!f!il '5: !lfF L-c~ft~ tt0 c:c
094
Df~toml C:: let, r:i.fi::~:Het!Z<;l:!iF1:1*lf*t.NJ \,\~~O)r13%:, ~~..tJ 1.,\j}flllO)~~O)
~ 7 A I-- O)pjz~ C:: 50m l!OJ '7 1 b.J O)~f*=t~fJ;I..ffi ~O)PJ~~1~1J<r'S:J \,\ t i ;t iK
9o L:O)~~"C'(jijh~ ~M~~~ ~~"C'9o~~~~~h~~-O)~h~~
~ G, 50m 7! OJ ? 1 b. -b ~ tf ~ OJ let Elf'?.\ L' (jij ~ t i ;t ~ "C' G J; -3 o
t.::tC.G rA::t--AD~±~t->iil;:( lmm~~O)m~tJ(r'S:JiK~ J r~t~T"A 1--0JP.lZ
~t.i:~lfhlt, 50m l!OJ? 1 b. -brP:l~9 ~J O)J: -3 lt::~:liF1:~f~Ht::11lO.~t-> t:Hi!iU
-:>ItT G * -3 C::, 1J';t? T*Jlt.i:~t~? T G * \,\*9 o
095
~-~~s~-~~~ff3•~~- T•~ ~ 3~ti~~ 5 ~~~~~*~0
~- ~ ~:5J'ttfGtc~-.~l!l t ~n-Q=t~ c·~~") t~-t ~n-Q=t~("~-")
~~-~~~~-Q(::~~~-Qk~~t~~~o ~~ti~~5~~~. ~~~~
~~ -Q~R1J'5 ~~'.b.1~~Rtci:~"C' ~ o
1::1'.!11! : Hill, Austin Bradford (1965). 'The Environment and Disease: Association or Causation?". Proceedings
of the Royal Society of Medicine. 58 (5): 295-300. PMC 1898525. PMID 14283879.
096
~ffR~fi-5 z::. e:: tf~11£tJ:~i51ct, ~¥-1 -=> -z l,\g-T-5 ~15e:-=> -c ~~l<=lftl-\
*
7:i'ffr (~1tl.~ffR) ~f'Tl, \ 9 o -t- OJ5J't!T.:.F~OJ 1 -:;-//·, IEI9ii11tlt'i7'if 1' / T9 o
L. OJ-'.F 5~C' l<l:, t~Ji!.~O)"Ilfi~C' l<l: "!Jjl:fi§ " .L.j9j..O) ~ *tJ{I~I£~t> S tJ: l- \ L. C:: ~
fiJ!fl G* 9 ~*~ · tc 11 ~ ~ft ~ tt-z • ~~ • ~~~9 g:::;; '/ 1/ b. ftttw~®
0 ..
C'9o
65 66 67 68 69 70 71 72 73 74 75 :!j:~
#ml : Shigeoka. Hitoshi. 2014. "The Effect of Patient Cost Sharing on Utilization. Health. and
Risk Protection." American Economic Review, 104 (7): 2152-84.
097
22
•~~m'~ AT 1... ·n:t~ t.- t.t 't nltt.t E> t.t ~ I(J)I;t, ~A 7 J...(J)~.Q .~. ~~:ff::i:l: li
~Jm-r~ t.t ~ 1 .#.. -r9 o a- ~~!l!ffi9 .Q J::? f.t ~A 7- 1... z.·l;t 7 1 -
~ 7 Jt- F 1\ ·;; 7
JL.- - 7"iJ~~ ;:: ~)' 7#Jiit~lbf'F a- 51~ I§;:: 9~it-t if>~) *9 0
~~Gk~G*9o~0)-5~, M~O)*~(k~X..~~~D)O)~~MNif~
'T-9
098
im,),~~ ~ nt.: :~UJT O)T'- 9 t<:~-:J' t, \ T ~B~-'ET' JIAf: ~!fiT G T
t, \ < J: -5 tc:i: 11!Mi\t~
~:.;A 'T b. l' tel:, :.; ;z 'T b.O)~fflmJMnltrt<: -i-O)j:~~ -t, \ ~-=f)~U9 ~ 0)1J{Jj£ G t, \
~T'-91J{~il:iJ'S~Yil~~ttT~1LGT G 3: -5!J?.~-r9 o
<:: 0)~, :,; A 'T b.O)~~-\,\O)~fL:iJ{~ l'il5 ::> t.:: IJ J$0~1<::~<:: ::> t.: IJ 9 ~~
~8~<7)~[':~
:[~~
.:H!IJil!lJ;~ L-'<7)
I
I ~*;J!<7)~1JO
I
I
I
I .:Nl~ ti!J~:[
I ~lt'i'?-il"JI~~v;
®:ti~ 7-(-~
Fb?Jl--/ I
-- --- I
~B~1JJE9 ;: .Q DJ ~§1'!:!:1:J~·
~\,1~pfT :[7 ]~
099
mttiat.J tJ: 7 1 - ~;' '') ? ;~ - ~
JB :11' tJ: 0) t.J\ El 't:: ~ x_ tJ: \,\ r"',~at.J tJ:
7 J:
71'-~J'i.·y?J~-7-z'9o <:.n~IWUtt.:71- I''J\·;;-?Jv-7.!::\.\\,\, 11\:V:
uk~~O)~~~~~A7b~"1:~<:.0*9o
N*~UOJAt±c Bt±t:J~5J!J!.< 't::~~~~~{.ie:? tc 1-- L--- ~~AT b.~1'F? tc
cu*uJ::?o -i-n-t:tnOJ!-- L---~~ATb. lcl:, iUJTOJJJ)(si-T-?I~~~v-c
~mtJJ1ll.si%B"Ivtc-T-5' %'.':F~
~~tJJ1ll.sl%a-~vr.:
7'-5'1.J'!¥~
~tlt.:7 -( - ~
I b? Jl.-- "1
7'-5'
1---L-- - ~ ~~fd:JU~s l%
~:A'T .b.I'C./~·'7 B'lvtC.'T'-5'
100
4~
~w•~s.~•*~wm•~~<~m~n~
7 Jv:fiJ A'bt:-=fWfm~l:-:>lXC. Wi~~~~
L""Cl'~*9o ~*~~~lcJ:1'0JiHI:~fJ*9
ti. ~ <~nl;:f:;::;:tJv~~~~:~-j'< t>wt>
~l'W~9 o u"J(fJt:~~""Cl'~*LJ:3o
r
lEI!!; t 11, 7- 111:: -t ? t -t 7 '~' ·:; t- 9 .Q '~ ~ ~ 1 <;: t J t.:· t Jist? -r J:: ~. '-v ~.- .~: ? o
f:O)f;:I!J)O) =f.$i;.t VC ;: ;: T£1$IEIIJI · :IIEI!fflJ • ~lJi~ IEI9m • DI ~ .:A 1-IEII'm ~~
rutvn.'~*"to
t:ltJ~)O)~~ J~';?-.0)~~
l!!t8Jl:l!:~xl 1~•1 l13illl:l!:~YI
102
•~~~~~~. ~~cm~~ru~•~~~~~~sh~•a. m@~~
ff.lL.'*9o t.:~.::Ucf!J,7'6/60)%_H::~~9~m~~~~ G-r. r.5~iiim. ~11'
60)~~ &••0)~~~. ~-~~~~~*~*~~O)~~~Sh*9o ~
hSW~O)m~~~~x,, x2 , x3 ,···~ G-r. Y=0x,+.6x2+ D x3+·· · +•~l. ' -3i.t
'L: G, ~O)~"C".'~~tci:{*~0.6D ··· ~ -~3j<llt)~0)11{~~~"1".'9 o ~ O)i.tt;J:-:7
~7~-r~•oo~G-r~~h*9.~ft~m~~ft~~9~r~-O)~~Jt
~~~ C:: t11{-r~ ~t.::llt)~Ji (weight)~ rPJ!';:fh, w"C".'~~h~ C:: t ~~ ~ *9.
~0) ~~~•9«~~. •m•~tt-r9. ~h~. kt~~•*~t•*BO)
J: -3 ,L:, m~0)5!RL.\~ft~ji!jj)J t ~ ~)tBJj~~ 'L:.A.h -r~@]~~~fr-3 t , lEG <
@] ~ffl11'-r ~ t.,i: ( f.,i: ~ C:: t "1".'9 o ~ ~#t'Jl.•li ~ ).i£Ht ~ 'L: ,;t, ;ffi~O) 5ta L.' ~)t BJj~ ft
0)« ?1J'~ ~ ~a'L ~ -s s 11'-:n~ IU~. ~ fl# <~ t 11'~t:JJ tL: t.,i: ~ * 9 0
r6®iliiiDm x, ~j!ll]~ y
{(j)@§,@fl§,
lR:b' S (J)Jfr~ X2
~ §····· ·0) ll~fii
!1~~0)7\:~ ~ x3 ~~(l)T'-9)
tt~~O)ll! x.
JfiiD
y=Ox,+L~.x2 +e
103
1
~f*tf@:t'R-ctc~:\,\t_~x_snv:±~-8', ~~aft.l£~0)2*, 3* . ... >i!:~X-*90
L.L.C:\ ~rty=0x 1 +6x 2 +0x3 +· .. + · it:XfGT, ~~tci:{*~OL. D· · ·t e
~*~vO)~, -~~~~-c9. L.O)~ ~rt-c~~~**-c~x.v~~~~
c ~, \ ~, \ 9 * o ~.X~~ ±~t->9 C:, J: iJ t~Jjttc~:ff!J~>i!:~!iUR -c 6 * 9tl\ @J~~*a~O)
ff!J't'J(tJGF3i:AE: (<: tJ:-:> T G *-50) -z:')i!@: G *u J:: -5. 'T 0) ?"57 -z:' id:, ~X ~~
300 (C Gtc tc~ i<:ff!J't'Rt.J'/1'3i:AE: (<: tc~: I), ).®'j2~tJ<~L. -:J T \,\ *9 o
~~it[QJ~Il'!
6
y
4 -
2
.. •• •
•
• ;~~tf;l::: t:!t,l(if.~'
/
lllll'J~:IJ~'filfll(;:f;j:-@
0
-3 -2 -1 0 2 3
X
Geron, Aurelien. Hands-on machine learning w ith Scikit-Learn and T ensorFlow : concept s. tools.
and techniques to build intelligent systems. Sebast opol, CA: O 'Reilly Media, 2017.1]) Figure 4-14
'lf~~lc: f"F~
104
~ DJ~'A j... (iii~) IQI9ffl
fi'J '=*$0)XJ~C: V"C j}hfrn: (ftEO)frn:tJ'S:l\:~ <j}htdii) tJ'it5-:>fc~
'@lt;:@)~*i1i~fJ'fttHj:9hfc>:=bO)t;:tc>: -:J -n.~ * ?, C: l-\-3 L. C:fJ'it5 I') *9o fi!j'
=*5!c· tj:~j~J!i~O)=*~U~9 ?;;tc61), t!liiJ~:tJ':l\:~ \,\ C: ~~~~~t;:~;z?;;~j~
lj:~F'ffi' 1<::7\:~ <tc>: f) * 9 o -t z: c\ Jl.hfWJ:O) ~~~ 'J'~ <9?;; tc61) tc:m 1- \?;; 0) 4
tJ'i [] ,, .7- "181~~ l ' 9 0
,., I -· I
80 0
0
0
Ul Ul
0
0
?i-ttfie 1JI'im*->~ I;:: ?i-tliil!O)~!Ill~ iO:~'R1i
y8 <')
0
0
*~<~~ + y 8
<')
0
0
5'H t 1J: <to: -:J t.:
0 0
0 ~----------~--~ 0 ~--~----~--~
0 20000 40000 60000 80000 0 20000 40000 60000 80000
X X
• •
• '
•
.
•
. ... ••
•
•
• •
< f))g~ .
IEmirn!O)~J81JfHt.;;gjl, ,t.O) ~ @ !!if6lili!c ~-@
105
m:@l~c~d:, ffi~O)S$~'ms~~~O)~?tJ~(It).Q clE t_, < @l~tJ~-5 a:;< c~t.J.
< t.J, .Q (:: ms~ [_,*[_, teo ~ < 0)~~;/]\~~ [_,""[ ~ \ .Q il' s (:: ~ \? -c f.J,/v c :til'
1v c:t mBA~~(<=A.n -r t_, a:;? 0) (d: J:: < t.J. ~' e: ~'? <:::. e: c·9 0 2" s (<:, ~rJtJ:t
~~A. L, a:;9 o E'UJl.IJ!Ji.c ld: r@J~i*~il':*:~ ~' L. c I<: J:: ~~ 7- JL-7 -1 ~~X.~
rj[J c ~' -5 ~"*c9 o
$~.1Htd.i&'J'=*;!c~cl:, ~~~~~~~O)=*fD c L, 'L~~~~~~i&,Hl: L,
"""[~'a:; L, teo mBA~~O)~lJ1JtJ'31!11Jct.J. ~' (:: ~ l<:$~t.J.fid '=*$~1'J? (::
c lv c /v@]~f*~;/]\:;;1\:~ ( f.J,? T L, a;:~' a;: 97J\ li.JJ'!IJIJ[ (<: J:: ? T 7' [.., - ::f ~ il'
~.QL.c~-c~a:;9oA~~~~, ~~~~~~~0)2*m+~~!Ji.cL,T,
.. \ '• ~~(;t:j'l.,
~~j!!(;t:lj\~\, \"fl,
*-'fi\,\1.J\
:y;~~~Ml~:1.J1'1'~J:E :Y;JliJ *B!if!tl~~
106
E~~~~~~~. *~<*~T2~~~*~o 1~§~~~~~~~~~
~m~••~~~~~c~~~ft)~. ~~1~~~~~~~2-m~••~
~ 15~~\:~ (L2iEftlJ1t) o L1JE~IJ1t~ffl\,\T~Y~~fr~ ~ . 35a:; ~1H~~ 'i
fd:\,\~Bfl~~~~~{*~;lft! O (t:fd:15tl=f([1J~ ~ ~a:;~ o t~t.=6f:>:<t ~:1H<: ~'~fd:
L11HliJ1t J: ~ 1J' fv t.= fv c~1J\ ~~ffi~ ~ JEili (<:::: 1i o (<:: 915 L. ~ 'i 35 a:; IJ 35
~ a:;-tt fvo t.J:<!B , -~8'9'<:: ,i, L2iEl'!U1t~~tJ{ -T )lW~ ·ii1i~(j:~\, \ ~ i§ btL T
\,\*~0
'i Elastic Net1EJ9~ ~ OSJL'ih T \,\a:; 9 o fd: <10, = .:1 - 7 JL- ~ •;; I-- '7 - ? (Section
34~~) \:~ , L1 JE~IJ1t~L2iEl'!IJ1t~i5e:~ L. ~ ~. ~~~~}Lp;t Gh*~ o
L11EfliJH:; C: L21Efl1Ht
· 1QJfMf*~C7)~~~~C7)W~~-*
. ~~~~l<tifbtl~l,\
J?lJ : I 1 I + I 2 I + I -3 I = 1 + 2 + 3 = 6
i'IJ: y = x +2x 2 -3x3 + 4 (7)
IQJmf*~l<t 1, 2. -3. WJtl<t 4
~~~m~~,•~~-~~~-~~~~M~~~aa
iE~re~~•~§~~a<~7~~M · 77~~~~~>
107
24
-tt ;Y-- "-"'-? 9- -x ~;:.... ';t 7 - 9 ~ -t? c -t 51~ :119:l.iW*fH· 51< tz.liJ(J)=f)tr.·c
71 - 7·7- =;:.... ~7'7' - .t... ~fft> Ill. '-tlit~9(J)!fl-z"'1::£mt(J)/J)t;;1:"9 o :tJ- ;?-J!-
;t;;~ft?.:. c ·c ~~~~~(J)J:l.W.~~ 51< .:. c -t "Z"~ 9 o "*
\:' c!5 -:J T :t:t.J%Wt.J' S \:' ~ ~ tc tt~~ ;: c ;/]{~~It: tJ: IJ * ~o -!Jif- !--I'( -7 1-- Jl-
c~W c 0l!€~~ -v- ~ / c \,\\,\, SVM \:'tel: L. 0"Y - :J/~i&:k:(t; G T \,\ *
~o~M0G<~~, ~-·C7)~~3~*\:'\:'cl5h~g·~~~~~L.c#~
c. !l¥1<fn *9 o
108
SVM
r • • • • '" • • :~I
X
-x,
X
~~k~~~o~~J:?~~-8-~~?~$~GT.~7~7-~~SVMc~
* JL-~:!1:J'~ t) *~0
') 7 1-- ""'7-::Y"Y SVM ,d:, ~~!U~ ~&~~~ c J: t) J: L\~'R*7:l'/lJIE1:J'~~ ~ J:? ~.
\,\pfg)~ r•mGL\J ~- 1t<:ff.l\,\* ~ o ~h*c·~SVM (/\- r::x-::Y 'YSVM)
c~~~t).(&M~~~~k)x-Y"Y~~-1ifA~~c~~~~ifM·~
109
~\., \ -c' jJ- * Jlli~ ""{'9 0 t.J -f.JL-$ta:, 5.fRiffJO)±j!~f.J\-t t> .z- .:t fftlf.J{ -:J t.:Jf~
(~F~'R%) ~<:: tJ: -:J T \,' ~~13-(<:: Ff.j \,' 3::9 oi.fR~~O)±j!~f.J{f!Ef.J\ -:J T \, 'tc~&,;:J:: , 'T-
~ 1J'5WfG 1,\~~:§[~f"F -:J T , ? 3:: < ~lf~~'liilfPJft;t<:: ~~ J: -5 I<:: / 0 'Y f-.. G~
~h~~~a:;~~o ~0) ~ -~r ~ m ~ - ~~ ~-~~~~~M ~ ~~ · ~J
t~mG3::9o kt~~ A ~tB ~ O)*~~, -~~~A~, ~~O)~~~B
~O))fR~~tJ' B ~ O)).fR"l.l t<:!ID 3:: h T ctci ~, ~:Rlf~~'~ 'cl: /fPJ ~g""{'9 o G i.J' G, f~~
t \.,'? ~t;:fJ:~W~~~1JD 9 ~ t, 'T- ~ 0) ,~f.J'2D ±fu&li.J' ~ 30 J:t!:!~ t<::g'{~ ~
9 ~~--~~ , ?3::<-~~~PJtt:~~~J:?~~-~~Wfk~~~ili~~
< -ct;:J::~~ *~~o -t-O)f'F~1J~m~9~0)f.J't.J-f.JL-~~~9o t.J - f.JL-~
~t G T t;:J::jj') Si7 Y (RBF) t.J -f.J [., ~~IW:Itt.J-f.J[.,tJ: ctJ{~ ~ 3::9 o t.J-
,'
~M 20
1F~~:$J'fli
l"~"'("(,l~
110
L. L. *(.'I'[)( IJ __HfT ~ t.:: SVMO):&f'Jit:t:::EIL: 4 "":)1:'9 0 CD¥-JW:~t.J'?P \, \~'8-1<:
~~1:'~~ c:. c, CZ'Ytk¥WilO)~f.J{-T- 5' O)~J: IJ ~\,\~.g.-r=E>~~-z:~ ~ c:. c ,
®±.lW.ctJ:~ @I~. -'fiiiD. Jm:s:p:iiD c=~xJtO):s:p:ffij~-tnl:)_j}O)~X7t""--~ft:9
~ c:. c) ~51 < ~ ~c: li, ~W.I<:Jli\, \~O)Jf~ ~S9hlt J: \, \t.::l'!), -T- 5 f.J'?P
\,\~~'8 .>< -T 1J ~l!WJ ""Z'~ ~ c:. c, @2" * ~ * tJ:t.J -:.t.J[.;~~~1~ ? c:. c f.J'c·
~~kl'!), ~~~~~~-~~Sh~~c~¥~Gh*9o
mf'JT (:: GT lcl:~XO) 3,~1:'9 0
CD-T-5' O)Wf..f.J\~ \,\ (:: ~t~~Fa~ f.J'31=m' iL: f.J'tJ'~
~ c,®~W!iO)~tJ{-r-5 O)WJ..J: IJ ~ \,\~~~;:~:, t.J-:.t.J L- ~~O)~lf:l:nc:J:?
1~""?.' 9 o 2" S I<: )1.h 1@:~ ~ ""- 0) lit-ffl (:: GT , lE }i?;f@: (:: ~ m'f@: 0) i~W ~ SVM (L: J: ?
T)R:lE9 ~One--Class SVM (:: \,\?-¥$-b~ IJ *9 o
SVMO)#ti.lfl
t
AIIJI(I:; 7'-5'i.Jf7 - ://~ I C]\fo m:ki t 7-;;·;_,
.::c l cJ:-?o~-TIL-7 -r
t t
m1Nt 7-:J/J:-IJ$>!-Ic<P> ~ljl{l:; @~;;i,Y;;Jz;IJ:;I;:(! <
QT'-9(J)~~(J)i5~ t.i;Q.::.ciCJ:QIIi]RIJ
;:(J)~IHJ(J)
7 - 90)
&l!l>l {l " \&l!l~1<~:1lftm9.@
~liffll:f~(J)
. U~-._
111
25
~~*~.Y~mNOT~lSh~A#~~?T~Miff~~~T~.A~~--
7"0-!? ;:q:)li\, \~):li;~f.:clt>. ~*1J~:b1J> ~)~~\,\~;f)~~~"['~ 0
~tJ~ukJM•~~*9. kc~~~~c.~~t,t~•~c.uT.~D~~~
i.J'1!::7.J'~9 .@5R:iE*1t1'F.@ <:c. 1!:::15 ~ * l_., J: ?. %.51li\.t.J~ 1 5tl~25~. ~~f.J{
40%~60% C7) c. ~·~;;1<:)1:-z:'~ IJ. -t-hl;Z)'}f.J ~~t~ -z:~.@ C: 9.@ c. 5R:iE* c.~
/ - P:
yes
1'~
no--mJ-1'
' 11UP.F W/ 1: 4-5 ~ ' <: 1~.
~ ~'XIx 1: 2?t~UL-<:c'<
I it<Hf.I~~~O)tJ~::E)liE.
*:a: ;
CART I
i; @)~!UJRJ!O)il!-;3'1;1:, ~.I-t.: .
1: * ~ 0) 1;1::-f'i* I
,; C' 1;1: f,j:
i*ifl0)?1Ji'l
<lltili 1: f.!:~ D
112
60 -------- ------
4
40 ----------- -,
0
15 25
"(";:! ~0 a~~t~~.:ct.f't<t'!~.
11 3
)R~*O)~~I;t, f5J'-l!fiJO)~:h\-'~ J lc::~-:5\-'"""CY'-~ 0)5J'-llf1Jt.r < IJ ~G 3;9 o
~' 91 *~O)j@:lc::tJ: f) 3; 9 o
'!' tl. ~~~1'/ ~itt 148 15 7 158 162 164 168 172 ' 76 ISO 184 'IJ y- ;::r- "~ .'t':
5 5 1.000 0.500 >l'lHfJ 1.000 0.500
0 1 0.000 0.000 5 4 0991 0.494 0.892 0.444
0 2 0.000 0.000 5 3 09 5"- 04€9 0764 0375
0 3 0.000 0.000 5 2 0.8€3 0.408 0604 0.28€
1 3 0.8 '1 0.375 4 2 0.9 ' 8 0.444 087~ 0.417
1 4 0.722 0.320 4 I 0.722 0.320 0 .722 0.3?0
1 5 0.650 0.278 4 0 0.000 0.000 0 .390 0.167
2 5 0.863 0.408 3 0 0 .000 0.000 0.604 0.286
3 5 0.954 0.469 2 0 0 .000 0.0110 0 .764 0.375
4 5 0.991 0.494 I 0 0.000 0.000 0.892 0.44>1
114
5R:J'E*(7)7:J'~1!:~~:t~ tJiiV - ~(<= .A.? -c~_,,~:;r::~1~Ha:;~? -n,, <tc./JI), mil
~7- 7 (7)7:J'!J;;1:fflgrla:J: <tJ. '?a:: 9 tete G, J.@*~tJ'~ <= '? t->9 <tJ. ~ (J)"T:,
0
"F ~ 1!': ~ \,' c ' -T ;~U jjg 1J 1!': rPJ J: ~ tt ~ <:: C:: tJ' ""\! 2: a;: 9 o -* ~ tJ. ~ ~ l;l: REP
(reduced error pruning) t U¥1tn, ~J!ttJ'~ft GtJ. \, \(J) -r ~n(t .J- ~ ~ '8-:>
t 't ~U~(J) r%'.1 ~_, \)ffi.lffl (? 7 .A) (J)~ .J - ~ (<:: ~ 2: ~X. a:: 9 o ::J .:;z 1-- ffl~IMt~)I.IJ
'?(cost-complexity pruning)"T:I;l:, fl'B~*(J)~./- ~0)~ (~*l£gr) tJ'-:f;::,f!: <~
GtJ. \,\J: 71<:: G """:)""":), ~./-~I<= .A.-:> T\. \~/f'~'lo/.J (::J .A 1--) 1!:7~6 GT t,\fi:
*9o
/1""-
/\
lil! IJ!lail,l""[f., ~.J- ~· r ;:::HlJi~J!J tf ~l:E*1i
~M:ti~1t;
l.JfO:~I~S A -=>T\,1-Qc-sa::< m~t.:e:
:?:t~J~tl~\,1 )@~~
=::f'~Mf.>~l-' l.J~gl,\
115
26
J7 ::..r~f ;...- :7'Jv~~ c l:t., ~H~H:~JUllh~bitT 1 '?0:>~'9-=t:-T Jv~1=.1£9 ?.>13)!
l'9o r~A$;J;tLI:t.'Jt~O)~;!;J ~-~~B-r~m9?.>1J)!c'b~'*-*9 o
J7 / i f / 1'Ja-~Bl' t;t_ ~mm'OJ "'E T' JLt:a= 1 -:)fF~ 0) l'iii!51J *it fuo :ffl~
OJigt., \t7" Jlt1,f tc <~ fu{''f? T-8-i*~it ~;: cl', rE'lm~O) "'E T' J Lt:a=f'F ~O)tJ~
@1-QO)'f:T'J~(;j:
fflMti~t.,'
ili:tJ1
ff.5f'l01i .Q c jij!fijffrt~
-=t -T'J~ti~~-g .Q
7-f-77-=/'1' 7/-tt/7'Jt-*M
X j.;:.(])T'-'9ti£\~ (' T'-'91f.tt~~1-'ld: <Tt. OK
116
r /-tJ / 7"Jt/jt'£1 \:' lcl:, ~~0) -'E -T J t- 0)-r;ma~~ :t c. (c:~U~a'gtJ:r)ft~*.a~
~*~*~o ~hi:'~ . ~0) ~5~--~ ~-T~~-~*~~ 0)\:'~~5~o
1? § 0)1J)!icl:, r~lll~~ J C'~ o <: 0)1J j*icl:± i<:7J"~Ji:O) :±~r8- l<:ffl ~ \ S h. -*
3~?kT ~~ -~--~~T~ ~·c~O *~o 2?§~r¥~J l'~o ~
-~. ~MO)k~O)··~fi·~~-~~~bh*~ o T~~~~·~~TB
~~~-r;~~~~c G *~o 3? Ei t.J' r1JDI¥~ J \:', r.:s:p:~J O)~~~ c~X.~
*
);k-C'Icl: 4, :sr:~C'Icl: 4.4t.J'ii.§iJZ1iffi.:Y~ c tJ: 0 9 o fi~O)~{(cl:1.JD·f~C'~ o
A~ fu c B ~ lvlcl::J\:O)~@i 7 7 /C', ~U!ii~WJ!flffi~ ~ § l<::&~tT \,\~ tc.~A c
5 4 5 4 4 4
5 4 5 4 4 4.41
117
:r::,rij·::,;7·Jt,~~ l<:: lcl:::*.:2' <5.Ht-r 2 --:::>O)~$tJ'ilb IJ *9 o
1--:::> El lci:J\.:¥'/? (bagging, bootstrap aggregating) -r-9 o J \::f >7-clct:, 7--
t-.A t-7·;~7'i*~ff-;)-r:@:T'--71.J'<;~JII**T'- -$'~~!1&*Jl, ~P.X;G*9o 7-
~~~ ~ ~7$t~ , m•~~s~~~b-r-~::.;7~~T'-->'~~IJ~9~
:lttll3~ 9 ~) 1J$"1:"9o ~l l*lT'--$' 1 i\lll 1 i\llll<:::tf G -r 'ET' Jl-~FF.l~ G tc-? X. "C'
~~~~'}\,\, ~!1&0)-T;JI~*S~~~ G-r:&~i¥.JtJ:7)~1J~~j\,\*9 o ~~~'ET'Jl-
0)7)~U*.5~1<:: lei: ./ -1 ~ (I!Ut~~~tJ: t::) 0)~\Vt.J{~*n """("\,\ *91.J\ ~ ::,;7 ~
~ -'E T' JL-~ 1-'F ~;:: t tJ'-c 2' ~ (J)"C'9 o * tc, ~!/&(J) 'T)~U*a"'~ff-? ;:: t -c./ -1
..... ..•.
••
• •• • ~7-5'
...• •• •
• ••
. . .. . ..• . .• ~· .
118
2 ~ §! fj{ 1' - .A 7 -f / ?' (boosting) -c' 9 o / - A T- -1 / ~· ( L. L. -r 'ct.
AdaBoost t \,\?=F$~~ll.F.I G *9) -r~ct:, *9IDII**-T-$7 'S: 1 ~ilt)O)-=t-TJL- IL:
~W~tt, ~5rul*oa*C:~~O)f@~ ltf3l: G 3; 9 o ~j(O)-=t"T Jl-~~~9 .Q~~c: ~ct.,
*
~ <td: IJ 9 o <:: O)~~m -r Fl3 l. \ -r l. \ .Q AdaBoost let, 2 ~ 7 A 0):)-H~I<::::ffl l. \ s
=
tL*9o 3 ~ 7 AlJ....t0)7:J'-~~1'J? !PJ~O)'T~ 'Y? let, SAMME (Stagewise
Additive Modeling using a Multiclass Exponential loss function) C: !Jif~th 9 o *
l 1
119
27
iiiiO)-f! 7 :/ 3 / -r·';t 7 / if / -:iJv~~0)-7 7 ='/ 7 ~~11- 1.- * 1.- f.: o ;: ;: -r·,;t, hc>
fflt!.-T5/§~7~~~~. ~~~~/~.~~~-~71/~~~ij~~*~ o
5}-~,~-c:'f;j:~~ :!!'li:
"7 / :9'J.,.(;: ~ ::e
J
/~ /~ --·
/'-. /.::::,.. /'-. /~
1\ 1\ I\ 1\\ I\ 1\ I /1\ I\ I\ 1\
120
.A~ ·.:t + / ~·-z:(t, -"F~~~~ 2 -=' (J...jJ:.) (<::7:J'ft * 9 o 1 ~~~ EHtJ\~ > 7
C:~lJ J: -51<::, 7"- f-. A f-. '5·;;:1$c·{~t.::T'-5~~'ET'J[; (0U: D V'AT-i 'Y
? @l~~ - 7 ::,;7 b. 7 :t [._, Ar-. t&. c) t<=".l2~2'tt, ~=E7J[., (f)7;~u*fi~~ tl:l G *9 0
~X (f) 2 ~~[9§ E1 (7)".j2~ \:' tt, 1 ~[9§ El 0-T)l!U*.S~~ .AtJ t L., T 'E'T J[., ~ ".F~ ~ tt 4
*9o 3 ~fll§EI~~ ~~ ~-~~~~ ~, M0~~ -z: 0 .:Y ~M-~ .A tJC:G T
~~ L., *9 o 2~~1l"~ E1 ~~0'E7J[;Itllfj0.:Y;~u *S•~-"J2~9 ~ t.::l!!), r M~W'ell(l)
L.tLtt: J: -:J T' T' -5 (f)®j I') \:il5~J\ -{ 7 At T'-5 (f)~f) (;J: t') ""(:'~ .@)\ 1) 7
Y A~ J:.~ tt:ID!J[Iic· ~ 21': 9 o ;z 5 'Y :'f ::,; ?"(f) L., <#~ ~31It&. 1~Uc·f7U ;Z T #~ t,
~~~~T~~A:IJ{~~~~, ~~A(f)~~:t ti<: G T~ St<::~ ~~l- \Tl-\<
C \,\-5 *(/);t;)~:IJ\~ I) [._, - C§ ;Z~ 'C' L_, J: -5o
iij§ltl
121
$J~1·-AT1' /7.--z'i;:i:, ~:<E*~fiJ.If.I V-z.-*91 @]§0)7)llli~f:fl.\*9o
1@l§O).:Y~~~~-t-0)~0)7~~~'1r:<E•m~T~~ abttk:t0)~~~*
9o C:::O)~-'ir00~9~~~~-:J~~~M~~~b-:J~(~C:::c~~-·~~
( ~ ';:j:fJ ~ * ttfvo
~~~I.{\(~ c::: tit:: ~ -:J '"(' c::: tL*-z'O)'E-TJ[.,O)~~~~O) .m. ~~ ~f.J{bil' I')
*9o-~'ir•:i.E9~ k~~, ~~'i!: J.Em:r-9 t~T~k~~:<E*~.:Ym'ir
f'Jb tt, .:y;~~M~'ir:<E~ffl~T~~~btt*9o C:::ni<= ~ 1'), ~fT~ \,\'E -TJv iJ'
iJt, \'E:TJ[.,O)_X.#,\0)1\~~'i!': ~ ~ l,\*9 0
~DC-:1- 7.. -T -1 :.;~f i;:l: /\~ :.;7 t i;:l:~tJ I'J J\-1' 7 .A'iti'JU~~, *'¥'~0)~~
il' 6~~'ir 1!Eii6tt* 9 o c::: h't:: ~ -:J ~J.®~~it::tJ~ PJ1J§•I'i:t 65 I'J * 9il\ ~
:<E*O)•t->~2' 'ir~W 9 niiJ.®'¥'~'irlltJ~1* 9 o
~~~*~-@
1.y!j2~:;_K~~
7JIIJ(2@~) 'Pi!!U*B* (:iefiT) (2@~)
7)Jl1J*.5* (:!ellff)
~fflVCJE~
~f!H.. <J:E~
~~~*~-@
1.y~~*~~
7;)11J (3@~) 7iJ!U~.5* (:ieWf)
'J>iJ!iJ~-5* (:lew;') (3@~)
~f!!l.;<J:E~ ~fflu<J:E~
122
11Qli3(7)~JI
0.8 0.8
0.7 ~QIJ7-9
0.7 1!1111J7-9
0.6 ~il*B* 0.6 ~l\11115*
0.5 0.5
,..
i11~ -
0.4 0.4
y 0.3 y 0.3 4
0.2
0.1
0.0
rM I I I 0.2
0.1
0.0
m
~
~
-0.1 ~
-0.1 (])
-0.~ -0.2 0.0 0.2 0.4 -0.4 -0.2 0.0 0.2 0.4
7
)[,
21Ql§O) ~:ftlj ::J"'
I)
0.8
0.4 0.7
::z:
+++ !\!l~
!l>!l!i*Bll!+ .b.
+ ~§O)~l!ile* 0.6
0.2
.·r+--
+
ffll!jl(7)~·~•r - ~
+
0.5 u•~·~~)
~
mo.o ~.· + ~ ~=- 4· cO)l\lil 0.4
++V
.f ++ l?-t:_.,!,. . +
·:- + •\-
-t.
.... ot-+
·~
y 0.3
0.2
-0.2 fj111f0)~~~-J •
t_O)~~ 0.1
-0.4 0.0
-0. 1
-0.4 -0.2 0.0 0.2 0.4 -0.4 -0.2 0.0 0.2 0.4
3@130) 'UJ
0.8
0.4 0.7 !j!l!l¥5!1! +
f~l!fO)!l>!l!i*Bli!J c':
~~O)*l\11*5. +
J
.. ~
.....
...":.""
O)~~O)~U~*
,. .
••.,.,:{!._ ~~.
0 .6
0.5
f:>l1£0)!l>!WJ*5li!J c':
O)j1i~O)*'Iil*-'ll!
.. +
,+.:,"!,..""'. ~ !..,;<·
Y0.4
0.3
..
+ +.+ ~
0.2
+ 0.1
0 .0
-0.1
-0.4 -0.2 0.0 0.2 0.4 -0.4 -0.2 0.0 0.2 0.4
x, x,
::B!ll!: Geron, Aurelien. "Hands on M achine Learning with sciklt-learn and Tensortlow." (201 7).
123
Cl V' .A 7 1' ·;; 7 !819iiH;t, r!BI9WJ c I.\? ~Jih'J' S 'fiil'iJ' ~ S (])fi(])-'fiJ!lJ ~ ~T ? c ,~ tl :h
1J" t> ·r 9 ti. ::E t: ?tm t: ~ n n 9 r JJ- ::r 1J :::x: 1.>. ·r 9 0 ~ <lh t;t iJ' At:::. A t.t tJ' s.
Yes/No(])*~~~tlf9 9 ~ * ~* f.t~ilii-r·:t<IJ JI'I ~ tl. "'fl. \*9 o
:/.A-T-1' ·;;?00~(~7- -=E-1' FM~) (::1., \\.,\*~o OY~ 7' 1' ·;~700!1&1cl::b~
124
:Si$0),A.0)7"-:9
:U~J-. 0)7"- :9
1 (=100%)
- - - - - - - - - - - -- -;_ :. -?'"
I (0/ 1 )0) 7"-:9~ ,' D ~A T1 'Y?Bll~
.!i!l2l9ft!'\'>a12J!J;l" ('l'/~ 1' ~~~) l"
mlljjcJ".QO) Ici:HGl.' 0/1 0) 7"-:9~
\ ,---------' Ci~O)!I!3i®c!::GT~!J.!
'
0(=0%) - --- -- - - -- ' -- -- . ----- ------------ --- --- -
-cG*?k~. D~~~1'~~~--r?*<m~~~<:t~~~*tt~ o
125
29
""·1 ~r ;...-,;:7 JL--ni, /\\1 -A'tltiE:c ~'? Ef.>i~ m ~' ~ 9 o .: n ~ -r-·O)Ef.$ii t li~
~ij,/\\1Xm~~~?.:t~~?T,~~~@~~~G~~-~fi?.:t~~~
~9 o
J\.::f:-0):& ~ (y) 0)-T -5 Ji!iU<::r- :1:5&-:> T \,\.Q J @:~~ )j(<lf) * G teo tO)@:*-':Rli
~J:\; y = Q X + D,. ""C' ~9 L.. t :lf.""Z' ~ .Q tc.6f..l, r- :1:)0-:> T \,\ .Q J @:~ ~ 1 -::>3-_K<If)
.Q L.. t li, r-:m,:s, ~ :b G \, \J 0 t D,.O)j@~ )](<If) .Q L.. tIt: I~:IJ'tJ: fJ * -tt ~o
G:IJ'G, r-:m ,:s,~p[...,\,\J 1@t2 1ttr3..1<6f..l.QL.. tli r .yO)j~:IJ'chtclt,:S,~b
[..., \, \O):IJ'J ' rfi£ 0) f~l;j: c nt21t ,:s, ~ b [..., \,\ O):IJ'J t \,\ -:> td~¥1)(~ m-e""""[\,\ Q L..
t:t~J*G*9o ~@l ~li@:~~sl< L..t""C''Jf;.Qtc.6f..l , -T-5:1J'200ilbhlir-
=i=,:s, ~ b G \, \J 0 t D,.O)~~*<If) t; tL* 9 o T'- 5 :IJ'';!.-'fJ: '-\I~ c :l.J'tfrlcl:~~""C'
~~<~ .Q (&~bG<~<~.Q)L..t~®-""Z'b~fJ *9 ~, &:::t- ~-z: ~
T'- 5 :IJ'2'@10) t ~ :t 1000@0) t 2 :tOt D,.O){~ tJ'i±l 7J ~ h-Q t21t""C', rtO)
fit.J'c nt.: It ,:s, ~ b G "\O):IJ'J t.Jtb:IJ' t; t,;.1, \0)--z-9 0
J:. '- \tc. 6f..l, .J:Eit:T'- 5 J;ZJ!.O)~~~ &:B9:!-z' ~ .Q J:. -3 It: id: fJ *9 o
126
y = O x+.6 'T'- 9H'J>fd.t,'
C:'"5 s t, li!i:t.Jf[E] L:; =
- 11!!a)ftia)OJil'§tttJ Q a)fm
y fil~tt~~~<:~t~l,l
;k~l, l
C = l , .6=2
2 .6a)~
X
'
y = O x+.6 _
7- 91.Jf~l,l
y Q a)fli ~
-11!!11)1f§a)D]Il'§ttt.J~'
Jj \~l,l ~
Q=l ,A= 2 ~
X 2 .6 11)1~ ~
(])
7
)(,
:::J'
1)
7..'
L.
/"(.., A'~Wdcif:bn~ O)tJ', ~-r .:~..O)~J]!-z-, r::n~<Hs:!l!il:t.J'Simit9~*~YJ~
=F$-z'9o f91Jc ul:3*~./Z - J L-O)!¥JJ5JIJ~~X.3::9o J!t~./Z-JL-tcc./Z-WS<:J:j=l
~c r11!t~J cl-'-3!!!~fd.J<~< 1d:~c~X.Sh3::9o 9fJ::b"5, J!t~./Z- WC'il6
~;:: c t.J~Jm~ c fJ:? """( r111t*~ J c \,\ -3 !!!~ t.J<~ < fJ: ~ *S!lli!:tf~t.J'n~ 0) --z-9 0
;:: ;:: ~' r1m~J c \,\-3 !!!~t.J'i3-3:: n~ .)( - Jj_, tJ<~~)Z - )[, ""Z'il6 ~pt~~}j(IY) *
9 (*'5~-7Jmi.t9)o <=n3::-c-O)~~~cct IJ, )Z -JL-:~1'-f:0)75%tJ'lE*'./Z-J[, ·
25% t.J~~~.)(- ) [,~ (16 ~;:: c t.J':b :b' ? """( \,\~ c [.; *9 *tc., lEm' .)(- )[,0)
0
- IE~t~:/-- 1 '.-a)t~t.J'<:',
rllft*'IJ c t- '? ~:!iH
~ il: tt"t'\. lt~1.J1 ?t.::tJa)
- 90% 0.2
--=72.7%
0.275
25 -il;~;/- -J!-Cl)fd_t.JI(!, * )1. - )~~f*O)t.ifJ'1'
rMIRJ c~,-:>~1'!
% rmwu c\.l?~;!!t.J~ ~;J;tl'{'~IQ'l;O)
-0.2+0.075=0.275
ail:tt -rt- ' t:tJa)- ao%
127
~-~-~~-007-~~7~~ ~~~7~0-~®~~~~~~~~7~
c-~~2~~~~*~ o ~h*~~~~~~~~~- ~ ~- ~ «~~-~~
/ · 5~:lE*~- L.hfl' S~,::S\K-3.!jJ~5'A(Section31 ) · 5 /~''b. 7 ;;t t_.,.:;z ~ (Seciton
27) t~ c O)~:Jm~m? J[.,:1 J ;::(b.I~CDI<= 5Hi~~h* ~
1
o Ci)O)J\:~ t~¥!f1~.H~, ~
hS~::P J[.,:J' 1) ;::(h.,fJ{rfPJ S fl'O)"T-.IJ '<:::~11:; G "Z~~~ h T\,\~O)~~~t~\,\J
e: \,\.:, ~ e: -z-9 0 ~ <*-z-.:r-~ {f~R ~ ttT75~~*Ef~{f3:!<6f)~ ~ e: l<=r~~H,,tJ{
~ ~ tc.clf), r 7- .IJ tJ{ c 0) J: -3 1<:::~1:. G T \, \~ ~il'J It::~\, \"Z=15 jt~!B,~fJ{~ ~
It::'§- ? tc 'E 7 Jt., ~ :15 ;z. "Z t, \ <tc. elf) , 00 J: ~ ~ I~J~EI".Ht:: )lpt ~ tL ~ttl~~ l;t ~ <t~
~~~0
128
~~~7Y~~~y~~~~N~~~®m•~0~~~h*~~ffi®~5
'<:: tc. < ~ !u ® 7 J[; ::J. 'J A' .L:di ~ <, lt~l'fl~- ~ h tc. :IJ$ ~7HIT ~ J.i 61J-@ <:. C.
f.J{-r2' a;:~ o ~St<:, ~~ A':ti:f£ 1flf.ll- \[email protected]'<:, tl:l7J ~htd®t.J'chtc't'3'
~b u l-\®f.J' (65~ l-\,;1:,3, ~b G < t,s.\-\®f.J') t<: -:J l-\T®fU&t.J'1~ sna;:~ o
L.h~ ~ 0~~-tt~~8 G k~~~ft5L.C.~-r2'~~C.~~, ~~~~~
~t~ 1'T 5 C.~~'<:: MCMC ("~ J[; ::J 7 Jm~j!i "E Y T- :t.J J[; D ) $C.~ t;fh-@ ~ 2. .::1
@.:Yj~R l-\~ 3-:J®I~t.J'65 0 a:::~o c®~ 5t,s.~ -TJ[;~ ~8t~ ~i.J'i.J'~ ~C.
~ ~1XM~~~-~-~ttf~~~~~tw~~~
~1 ~J?/~ 7'-'Jj,~,;t. 1'7jlljt.:tt~t.~: < 7'-1fq)~~m~t:t
Ill,.:_, 1J1' ~ ~
ill¥~ /c 7· 7 ~ :,- ?·a-~8 ~ m", 9 t. m~ tJf'IJ\"' t= "'t: t.~: ~
129
30 ~~~U**ffc
~~fm~fm=E7'J~
t*;~~r.U"'E-Tlltl;t, ~~"t"~ft l-TI-'( (11\jiHIJ) 7 -9~C'O)J¥HJT-t->7~~~i" ?
r~~HIJ?HJTJ ':~IJJ§ ~ n .Q;fiJC~t • mHl£~~ -'ET' lvT-·9 o t*:ii!HT'Jv tU.i!!HT' Jv t
1.'? 2 '?0) -'ET' Jv~*-!lh1H:> -lt t.:"'E 7 Wt\ ~11>1. '?7ff"f·,1Jm ~ n Tl.' *9 o
oo;v.;?U""fl<ttJ:l-,.,.._9
(g!J: 1)/t,~'Q)t;t~)
1 I 1 I ?
I I 1 1
I I I
• :
?
• I
I
'
• •
130
Gf.J' G <:nf.J{;J5~ffiO)'Y J'i.x O)~;J!Ull!:tc-::> tc S c? --c: G J: ?o ~ iF 2~ Gf.J'
~ \ fd: f.J'-::> tc 0) I<:~~~\ 2' fJ: f) 100 3J3H<:: fJ: ~ L. C (d: a': 9 d5 fJ a': it lvo -::J a': f) d5 ~
L. 0) J:? fJ:'T - 5 ~ mH•'Rfd: c O) 'E 'T J[; --c-*9 -'¥5! ~<:: (d:, Section23 l."~BJ'I L.,
tc @l ~~~t!T:t d5 fJ *9 o L. O)@J~:l.J':f!T c II~H~~IJ7.J'tJTO)~'v \fd:, ~T ld: 61J~'T - 4
5f.J{j:lt1Z:f.J' c:.:;, f.J', El a:.m ~t.J{d5 ~ f.J' c:.:;, f.J'c:"9 o ~ lct @l ~ffi:7Nfr.lcl:7- 91PJ±
- 51<:: L., f.J'~IJm-r 2' * tt lvo 19l.:ll--c:tJ: <El ct§ ~f.J{ d5 ~ 'T- 5
f.J~~9l.:lz:l."d5 ~ 7
I<: @]~~~.:f!T~11'? c, Section21 -c<~BJ'I L., tdi£11-jtEJOOtJ: C: O)rp~H!f.J{~ G ~ PJ~lli
11f.J{d5 f') *9 0
~~HIJ'E 'T Jt.-1<:: let, El ctEJ~O) d5 ~ 'T- 5 ~?a': < ~BJ'I9 ~ L., <(f).f.J{d5 ~ tc
61J, ~~HIJ'T -5 O)~{JTI<::Ict~*~IJ 'E 'TJ L- ~~~Jf:f.l G *G J: ?o
I!'F~(:~~O)
7'-5-tJ'S
I' I
I
I
I
1
I
I
I
I
I
I
I
~-6>(:, tf.'v\tc_\,\
;:: O)illl) ......
:1
I
-
:
I
1~ 1
: ~-- :
, ....-- I
I
I I I I
I I I I
I I I
I I I
I I I
a/1 I I
l .......... I I I
I I I I
l I I I
I I I I
131
B~.hrt]IJ"ET'J[;t<::ti, ::li!;;:;fs:~tci: sc@J ~ (AR) "ET'J[;, ~!JJ:sp:~ (MA) "ET'J[;
"P L. h S ~ *,§ Ji 13" b 1i tc. ARMA "E T' J[., fci: c ~ l:z IJ:li~t.J~ il5 IJ *. 9 f.J{, ::li!;:::$:~ t<::
Q tc.ISI) ~I:z fci:I~ ~ L. S L, tc. ARIMA "ET' )[.,"\=' SARIMA "E T' J[.,t.J{~IJffl ~ h T \,\
*.9o
AR 'E 7' Jl> C: MA 'E7' J!>O) :ft ~JE Gi3-bttt.:::'E7' Wl'9 o <:
!3 c @l ~~tt.J:;p:¥!J
ttS 2 ?O)'E 7'Jt>-'5:,!EG;3-bit.@<: C:li:~ 'J. ~ rJl.li~lt::~IJ
(ARMA)
Gtc'E7'Jl>-c'-9o
132
~~HIJ'ET' J[., (C:: ,ct, ¥:.:$:~td: El c@J ~ (AR) 'E -T'J[.,, ~!JJ.!jl±';;] (MA) 'ET' )[.,
t-> <:: h ~ ;~d.§.JF@!b it t.::ARMA 'ET' )[.,tcJ: c OJli~.i'UJ~i!5 fJ 3::9:t.J', ¥:.:$:~(;: r~
OJf&Hctj.,' G1i1JO)~ C: fJ;Z-n,' .Q (;:1:9 J C: 1-' -5 ~ ;t:!Jc'E T' J[.,~~gt G 3::9 o t~~
~rj39 'E 7 Jl- :t ~*~U 'E T' Jl.-0) V' C: -:) c9 f.J{, (3: D' C: 0)7\. ~ 1J:3j: 1-' ,ct, rli!,;~U ~
n.Q OJ 'ct:.:$:~OJ ~t~-c ,cttcJ: ~. 'J e: u-cmH\j u t.::-T- 5 ~~~13f.l9 .Q rw;~u -T-r·;t.-J lF~
~
t' .Z.O)~'<:~Wiht.::;;$:~ 0)~1@i:~ mElfl9 .Q r~~& 'E T' )[., J 0) 2-:) ~ ~fl#-8-bit !#
~
t.::'ET' )[., cil5 .Q,~\.'9 o t.:: C: ;tl;:f'Y J'i.:l- 0) J:: -5 tcJ:1:.'to/JOJ1:.,\!!,~~~j~IJ9 .Q~'@!,
*
(J)
1:,1@, ~ :1J' Gli!.~Uii&t.J'-71-h T I.' .Q $lfi0) <:: C: ~ fiJ!jj!IJ ~~ J C: I.' I.' ;3:: 9 o
~ a~ ~HIJ£-t.fT -r ,;~:, ~ rr:1 ~, tJ!) 7'- ~ ~ ~ ~;11 .:e 7' Jld:: N> ·n;~: ~
"(5JtiiJI99
~~;tj .:e 7 Jldi r~ Q)fj§ {i 1l I., iW Q)fi t ft..l"'( L"~ li 9'J ~ tjit
it (., f.: t <1)
133
r:;:.l k itiii (k-NN) )~c
~ k !JL±;J {k-means) )n
.:. tt 6 2 --:J(J) 7 Jv:f •J .A A !;t~~tJ~11;! -r 1.' .Q f.:~ - .I;....:;.:: 70)~ -z:--t i~l<ll ~ tt tJ"
tJt-·9 o c:·-s 6 <b ~ .Qflk ~~~:iE G Tf1Jffl9 .Q f.:~iJ;.tf.:~iiiU:: t.t? Tl.' * 9tJf , ~$t
~13 ~<b~~-r *?f.:< Wt.t .Q 7 w :f 1J 7..' A t-·9 o
,. ,. ?
~) lvC:' 1 9 7 j
~) lvO::' 2 10 5 'l
,- • J
ld: L, 1 3 6
?
t,;:L,2 4
134
~§~J ;IJ'c:!51J3:;9o ~--7 1) "J f''~§~I~L fLtc5iJ'l.\bJ9)~ r~~J ~~btL
~~(J)iff\., \
::9 ~ 911i)I<=P3 ~Jm < J: -3 I<= 9 ~ ~ bil' IJ ~9 < tJ.IJ a:: 9 o tc ~ .:Ziik=5 l' c:!tJn
li, PJ(J)i=p(<:'¥'~-T'- ::$70),~iJ'5f~A~d::-31<=PJ~Jm<, ~\.,\?L.~l'9o -T
0)1~, c. O)PJO)i=pc·tJ-=> ~ tJ ~ l. \ 7-"'JL-~, 5:1\~i'l ~ tc l. \-T'-::9 0) 7 «JL- ~ vr
t±:l:7J~3:;9 .
~b ~ ~ \.,\ -5 L. ~ c·9 o tc ~ ;Z(;f L. O)f~UI<: <IS\..\ T (;:!:, k=5 ~ ~ tct~~ ~;: 1;:!: r I)
fvc:.· : tJ.~= 2: 3J ~tJ.I) rtJ.~ J ~5:J'-;eyj2'n3:;9iJ\ k=9~ ~tct~~I<:(;:J: r l)
fv2:~~=5:4J~~IJriJiv2J~~•2'n~c:.~~~IJ*9 o B-::>ttJ
'li~g(J) J: \..\ k ~51i'::JE9 ~ tc6!:l 1<:1;:!:, 1-IBO)-tm:ffl\!~~ ~ fl5J:fj]H<:, 9 «T 0)5"'-::9 ~
~B-T- ::9~T~~-T- ::9~~~Ttt~~~~~T~ft~3:;9.
~as , - ~i<= k tJ'::k ~ l. \ Ia: e::.:r·- 5' (f)/ -1 .::( (,3'\n) I<= J: ~tt~g(J)1f£~~1fD
.:ZSh3:;9~, -TO)~k<2'fv0)-T- 5'~~-~A-::>T~*?k6!:l, -77~~
135
;:: ;:: i.J' s (cJ:, k3JZ~;!O)~l.!J!O)jflttv·~: ~¥~5t v-c \,\ ~ *9 o k 3fif*;!t.J{f~ gffiif5
Jl.dJ{retm ~it5 '{)~'~lcl:it5 ~ *it lvo 5tl~ c 0) ~ lv L.' c t,; ~ 1<:, 1--- '<' 1--- ~;IJD.::tt.-:
3 -:>~ -7 ~A~ I<= ::J:]' ft ~ 7 JL- ::1 1) .Ab ~~J I<:52, T \, \ ~ * ~ J: -3 o
•
••••• • • • ••
•
•••
•• •
2 c \,\ ? t.-:J: -3 It:*? t.-: <0)?5 ~ ::J. l<:~'lt ~ c \,\ ? td~HF~ZJ'* \,\*it lv o
L. O)J: 5~~~fd:~~~~9~k~ , ~ ~ kM·tJ~M, ~~ - ~~ ~ffiO)J:
-3 It:, *? t.-: <~'iJ' n T \, \~ J: -3 1<: IJ:~.::t * it lvo
t,;<f.)~~giji(!5 ~ ~~ c IJ: ~t,; ~, ? - 5 tJ~ \, \ <-:>0)? ~ A 5 D' S~P.lZ2' n T \,\
~D'iJ{btJ' S t,; \,\f.-: ~, ~~l~Ht: (J: k O)~;E It: -f.JI~tJ{~,~ c t,; f)* 9 o L. L.l:
~ fd:lv t~<3-=>0)?~A5~~~sn~?~c~~~, ? ~A5~~3 c~
TJ.i~*9o
®~A> ~)](~~
~.?<. It:, $t l~c5Htt.-:~? ~ A 5 cc 1<:~0)? ~ A 5 0) ~ -5 :i:{;$:0)m:,[)~::;_K
136
@~ t>Jrr\.,~A)O)? 7 A 5' t<::5J"~t@9
~A>:t.>~3:K *-:> tc ~, 7 './5' b.tc:?Httc.T'- 5' ~~!Jt, ?J"tt® l.J *9 o ~!Jttcl:
7 './5' b.I<:5J"tf~O)-rtcl:1d: <, k@O)~A)O)? t:;, ii=tlE§fiO)Jli\.\~A:,,O)? 7
A5'~, ~j"- 5J0)~~~0ft~*9o
( .,t-';)(C:~Jhl_,""(\,\*9o
;:15 ~ tc ~, (])·,...@~foJ!Jt:f.>' < 0 )18, l.J, =t-:> t =t c:t \,'? 7 .A 5' t t~-:> td6*~1*
FF.l9 ~ tJ: c O) I;Kl'J{~,~ t tJ: 0 *9 o
137
32
~~~ ~~~m~L*H~ -~~. f~ - ~~~~J#~!*~oW ~ *·~ ~- ~
I: M~ 9"M"~l! C: Vt. fll~*HI:XtJ' ~.:: t~T--iHt:l.'~~:ln'·~o
~~~~~~0~0~0. ~-~0*~•~•s~~-0~t~m~*~o
~ ~ c-l-\-3 :r-~ 0~.x~e: ,a:, tc. e: ;ut~ :± 0JJ.!act:r- ~tJ~d5-=> tc.:t~J~0~~g
0,~., ~~0~~' ~~0,~ .... ... (: \,\-::> f;:_~-~ 0!~§~0 ~ C C'~o ""f
~~~t~T, ~:±.0~~t-~0~-~757~7D~ ~ ~k~0C'~o ~
0757~s~~~t. ~~t-~0~-~~. ~~s~~*~<~h~~-:;,
~~~*~<~~~-3~ffi~~~~d5~~-3~~~*~o ~~C'~0ffi~0~
[ti](<:@~'R~~I < ~ t~~~* ~ J: "5o ~0®:~'R(<:-i-h-t'h0 ,'i?.:~ rmt ~~tJ
~-3~-~~~t, ""f0~0~-3~~~~02*~07-~~1~0@·0~
~1*~0~-~t~T~tt~~-3~~0*~o -i-~T~01*~0~-~~
2~X~0 r§l~fi0~-J r&~0,~-J 0 ·~~~ 1 ~)Z~0 r~:t.JJ t \,\"3j:~~c-~
\,\T~}ta,EI ~ *9 o
X XXXX X
~~I;::
~(::l__,~t;
138
1 -:J El 0) ;>( 1) ''/ Hcl:, r;x]CO)PJlL \ J ~ @]~"""(' ~.@ c:: ~ "Z'9 0 ~Jml<=::i5 ;{_.@ ~
7-5 O)~j(Jt~lcl: 1H:t nli~ \,\ ll? tJ'7 - 5 O)~W:tJ{ ~ < biJ'.@ ~ ? lt::J!tbn
* 9tJ\ ~tiHll£~~ IC:: <f-l \,\ T lcl:~.'l(Jt~tJ'j;::~ 9 ~ .@~-8-lc::: c:: 0) r~j(]tO)Q.£1., \J ~
\,\"3 m~tJ{ Fp,~~ t~-::> T ~* 9 o ~j(JtO)Q}L\,\ ~lei:-§ -r\,\? ~ ' r~9 ~ .@lte
-1 / t-- "Z.' ~.J:t«.@ ~ D' ;t-::> T ~ \, \fJ'5:tiJ":":,t~ < td:.@ J C:: ~ "Z.' 65.@ ~ \,\ ;t * 9 o
2-:J §0);>( ') 'Y Hcl:, 7 -5 ~l±~l'~.@ t \,\"3 c:: t -r9 o j;::~t~ ~j(JtO)'T -
-i-O)J;? t~~j;::t~~O)'T - 5 lt::x'.t VC.'l(:J1;f!l!Ji!P1~ <IS C:: t~? C:: t ""Z', 9&~1<=tJ'tJ'
.@ ~t· fii~j;::~~ ~c:::i!P!ZS G d:: 'J !F- <~H\ttJ'1'r ;t.@ d::? lc::: t~ .@OJ""Z'9 o
60 50
80 40
139
-l
3--=' El 0) ;>( 1
) ';/ He!:, ro>J~~j[;O)'.T- 51f PJJ' t) ~9 L\ct? lt:PJt~1l::~~ ~ (::
L\-5 C:. (:: """C9 o $'[;13: c O)~J~L \;t_(;f, ~1=.0)JJX~'.T- 5 lt:lcl:§l~~~~ti.jl-0)
ftMO)'.T-5~~~c:.C:~G~ ? oC:.O)C:~r;::O)'.T-50)M·~~~~9~
~~8 !t!lo/.J • •
~!# ±t!ll~ • •• •
qr~JW:; ••
~~ 8*51: • • •
• ··~
4~~ t!!W5!:
• ••
• • • ••
ft;!# • •
•
140
~XJT;llJIJ))8t"Z'foJt.J~'"C' ~ ~ O)f.J''t:-:> l' -cfii!ln -c ~ * Ldc.t.J\ L. L. f.J' G ';t~.XJT;J!JIJ)J8t
O)=JO~t,ffWIDC G * 9o
~5T;~))8t~r~~~ - ~t,f~O)M~M~G~D J W*-z:~~~IDC~G*Gk
"'-r"
'--1-1- - - - - .
'li~~~~$1::• = r~r:~.@ iii~ 1n~'
IJI~<tJ.Q,m<w-tml HB~'
141
-~1l:;~
33 ilili~7 J~:j'IJ A'A
llil{t t 11, I 61> .Q ~d4 Clfi!J~~d4) (J)'f> t -c, 61> .Q 00~ ~It:*: C* f.: C1il'J') t: 9 .Q
M C:ftilM) ~>J(d).Q C:.c J 1:'"9o c:.c:.·rc:, :lil~{t(J)f.:d)(J)J7Jt-:::r•J.A' .4(J)1?T·
61> .Q ~f~ft.JJ7 w:r•J .A'-4 t-~t:M~G ·n ~~ *9 o
[..; i.J' [..;, ~l!fiH<:~~~~ lt:fllR~.Q bZ,9!.B'~ C tJ:.Q 7 1'-':::J 1) "A b. ~::t il5 .Q tc6f),
L. L. ~ [_; ? i.J' IJ (: tifl 6 X.~ l, \ 2' * [_; J; '3 0
=fll!l
142
ft L- ~ ?ld:-1 x- ~~t?JtJ'h:fJ~ t> t~~3i~H~-z:9tJ\ fMc t> OJ E3 m-t<= t> t.: <~
fu~a=;n -r \., \~OJ-z:9 o tc c. ~J;:f- ~<:: t;J:fu t<:JBL.\ L- L.\1J L> -7-1 A-~11=~ c.
*~~m
1.::/t,l:iA, 40 p:j X 4
l:i'\'>tJfl,I'EJ 30p:J X 3 8m""{"
1;i.9 30p:J X 2 1,000 p:J 10~
(l!iJJ*'-l~.H!j:) 1 @im~
~~ 150 p:J X 3 (:fi!J*'-l!lkf!t:)
1J[..,-JI,.- 1 QQp:J X 2
1J[..,-
- §~IMJ~
~0-*'G;:'!
B-A-C-E- 0 - 31JijPdJ3071
JL--1--2 : E- o - c - s-A - 41Jijrd'J1071
}J(d.l~m §~tuJ~
143
8 ~~~U::*U~€it.>tt!11~
- Wr/J'Ivtc.lv tJ:.15$Jj., -i-0)~3lM~rp~Jm"Z"~ .:Z? ~ 9 ""TO)MO)ifl§.#~:btt
~- G, -i-O)M-~6~DM~8<15$~9o ~0)1J$ ~*~~~~ ~h, ~
9':t-:> ~ :t J: ~_,,M1,i:1~~ ~ ~ ff·c·~ i:J:::9 o GiJ' UJ?.~~It::IJ:, §t~~?iiftJ~::k~
IJ t ~o'-:> tc. J:? it::;IJD~&:a'-.Hc:::m X. T ~o' ~ i:J::: 9 o H'Yit:: 1 Jlli IJ 0)~1'JfJ""Z" ~ ~ ::J
/~ ~-~~~h 6~~·Gk ·~ 5li~ ~h~ 2~~-:b~ ~-~ Wtl~
li*~ 760 7J.i=f:fJ'iJ'-:> T G i:J:::? ~ lo'? ~ t C'9 o ~ 0) J:? It::, ~11'9 ""~ Wf.O)m
# ~btttJ~tJo~&:~ It:: fi .:Z T lo' < ;: ~ 1,i: *Bh "€i b t!1i~ ~ lo' lo' * 9o
ifl§.#~:btt!!i§Mt:: J: IJ :i:~~"Z" IJ:~~fJ\-z."~ tJ:. ~o '~D1~ rp~Jm~M <tc.61J It::,
~* ¢'* lt::I~2"htc~D1~7 JL-::J" 1) .AbfJ"*~~h Tlo,i:J:::9 o ~ ~ "Z"Ii, f\;
*~tJ:.~i.i~H ~=!=5!0)lJ' ~ -:>C'd5~iAfiB'..l7 Jv :::l' 1J 7:.'b.1,i:~:1h'tc. G *9o
Jfi1ii~ 7 JL-::J' 1) .Ab ~ IJ:-i-0)~ 0)~ I), j:'if[JO)~itO) G < # ~flj jf.J G tc. 7 )[.,
~~.AbC'9o~~~..Z.h~hO)@~~ r e~-~2"h1J:~6r~~(ifl§.#•
X.) J r~~%t~J ~ < I) )1&9;: ~ "Z", 11.:i:~O)~{ii-TfJ\ J: IJ r$~J lt::Diit9 ~
J: ?~it GT \,\ ~ *9 0 3W1ii~ 7 JL- :::t 1) .Ab "Z"IJ: ~ 0) G (ilj.\C::t,J. 6 \,\, El~~
CD @ ®
144
CD.f7J Mi!!:1-\: 0) 1:JJJt
L. O)~]J~IW::fifl] O)i!!:{-\:0) 017- "Z'fr l- \a.: 9 o :f7JM1!!:1-\:"Z' '<t.~tf l- \ t.,i: l-\ t.: Y.>, ft!Jil\kl
~~~~~~ ~, ~~~~~Y~b"Z'*~GT@~~1:_RX; Ga.: 9o
4
®®f*O)WJ!ffilj ~
-t;-O)i!!:{-\:0)9A(TO)@'f*I<:X1 GTffffilj~ff\,\a.:9 o ~@~O)*i{Er~ §fj{J~ ~
"'1"
~
~I<:A1:J GT~~~fjt,\, -t;-O)~a~~WJ!ffiljf\IC: GT~2~Ga.:9o (])
7
)[,.
®E!f.~~)t
:::r
1)
@~O)WJZffiljm~&~, ~~~ff~T~O)i!!:~~~~~~H9@1*~~~~H
::x:
b.
a.:9 o L. O)ffi~"Z', 1E:{~'f*O)~{E~tJ~~ ~ ~tLt.:1lrPJ-"~1t G T \-\ <L. C: l<:td:
~ a.: 9 o ~)( /\( - ::/O)~-z'lifm~1t0) t.:::Y.>LiJ' SlllilH<:~fR G T \.\a.: 9tJ\ ~!lo/.10)
~~c(C: d=O \-\ T~3Vci:1~1*tc lttJ{JafE~~9!9 b lt-zo ';:tt.,i: \-\ ~ ~ ,<:, *i{Ei¥J 7 )[,
:J. 1) :X..'b "Z' =t ffffllj{@O) ~\- \)I)W'c:~tR9 ~ 0) "Z' (;;!:t.,i: ( , ~ Y :)7" b~~~ J\htc.:f-
5$-z"@~~)!tfR Ga.: 9 o -t;-O)fl*~ <ffl t,\ Sn~~tR.'f-5! C: G T let, r JL-- ~ ·y
t-- ~iRJ r ~ Y :t- Y -:f~iRJ r t-- - + ;;< Y t-- ~iRJ fd. c tJ{ if5 ~ 3.: 9 o
®~~ cmd7-~;t)
~~~~Snk@~~±O)~~~~~H if5.Ptt, Mkfd-~~~0)@~~~~
@~~~~
-t;-O)i!!:~0) 9A(TO)@~~X1 GT, - ~O) -·-z'~~-T O) -$~~Y~b~
]:~G3.:9o
145
iliine-'9? Jv ::1'1J "A'L>.
@JJJUJ1~ti'tO>~filt
l;t:l:/6f:> l;t., lfi!J f.:J~f!:t-1.:~?~ ?l.:ilffi=t'-{!:7 /"9' AI.:~:@Ud~-l$~~/i1\9 ~
l
®Eifi.\liHt .
lti~I'J:@-1$1/~<~~~~?,
~lj!fffijQ)ft\: l, \f~-j;l; ~)ij);t9 ~
90g
90g 90£
80g 80 g
70g 70 ,c!?-
60,c!?- 601!ii:
I I 50,c!?- c::::r::c~:::J so,c!?-
t
®~x
@I-I$1E.J±Q) Jr:!m-T~ t.l'l"t~:Pit,
~t.: I'J:iiHii-T~~"J@I-I$~~/i1\9 ~
{i~tJf@j-j;$ (;t:~Q)**
~9CC: 't> ili5 ~
2-"JQ)@-j;l;Q)~ffi=r~
7/"YA I .:.A.tl~;t~
146
s~
fve'l'<~f;:~~nt~9o .Z.trZ.=t:Jc'OJ~5~~
~~R-cR~LJ-c~~~$~0)~, .Z.LJ-ceOJ
~ 5 t<i.':T- :A cC'3~.li-:JOJ1J', ~f*e-'g~$f9U
;: ;: \:' 1;,1:, T -1 - 7 7 - .=.::.; ~i 0) {liPf:;: ~ tJ: [.., <J7. \:' il5 -t> I~ - t! 7' " [J ::.;
(.=. .::1- D :Y'E7' Jl.-) I<:-:)\,\ T~Ua:: 9 o J\-iz 7 1-- D :Y l;,l:$- 0) .=. .::1- D :Y
~ 'E7' Jt.-ft [.., tc. :t 0)-z:'ilt) t) , -t-O)tl@lj: t. T =t :_; :Y 7 Jl.- "'Z'9 o
-t-n-t' nO) .A:tJ 1;,1:, '"f~O)l!J \, \ ~EIJ"Z'5Ji: ~ n T \,\ -t> J:: -5 I<:, ~~ 0) J\.f.J l<::tl"lit
•
Xz
148
J \ - iz 7 1-- o:,; ~ .:C O)ftd<: :t -::dJ: tf-r 1-' <t, .Afl I! t t:!:t:b Jiii1 0) Fa~ tc: Ill! nil
~¥-i-:? tc .=. .:z. - 7 JL;* '/ 1'- '7 -7;/J{~~ *9 a .Afl~ t t±lfl~tcl:~~fm~~~
-@O)t<:MG, ~ni~H<l:~~fm~~~ 9, x*Jm
I'J r ~hJ Tl-'*9o """f~O).=..:z.-
7JL-;:f.•;; f-. '7-~(<l:, ~t1~ 1 ~1f::J:'!f:Jtc2~0)=.:t- 7 JL-f. ·;; l--'7-?~9a
fiJ%-z'ff-2" ntdf~:lJ't,r / - F, 9cE[J-z'ff-~ htc$5}t,r I'/~ t \, \\,' 9 o tJ:<t3, *
~O)~t,r~X.-@I!~H<l:, .Afl/11f:!lffi)i..G, r.I ·;; ~O)f. ·;;f-. '7-? t / - ~ (<:-:>
y,
y,
149
ili'ltftllUH: ~;t, .i\1J 1.f~J7.111t u tdD1,f~UOJ~tt:~:lf~~1t ~~J:\;0) <:. c -z-,
T1 - 7 7- =./7ic:::;Jst,\T~F'if!;lc::: ~~-z-9 o !.5ltHIJFF.I~n Tl-\~)3'1i.1t~~
,LJ
0.8
0.6
0.4
02
0
- slzl
g'(z)
1
g (z}= H e·z
J\1' J\ *IJ ·;;?9/:J:r/ 1'- (tanh)
0 :LJ
0
81
-0.5
.1
-~1 A.1J-a:0~1 (;:
~~
ez-e-z
g(z)= ez+e-z
-5 0 5 -5 0 5
150
5!1i.1t~~t.J<~I=*''Mf~~c!5 .Q ~E8 tct, ffl.~ O)-T-9 0) l;f t.lv c1J{~I=*~ff~~cl5 .Q
0.9 0.9
0.8 0.8 iii'Uii'ittfti!!IBl.'l;t
ISl~Mfti!IIBl.'l;t 11'.1'71-7'1;::
0.7 .P.!!'.r71 - :f(;:: 0.7 9gcm;~;r;::
0.6 vet, .a~ 0.6 f tl;::t.;:g
0.5 0.5
04
· o 0.1 0.20.30.40.50.60.70.80.9 1 0.40 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1
-=>0., ' .
000,1 56 GDl
0
·· 0-... ~
.0 - . 0
':?""-
'-o -f/ __ ,
o~ : -: :..
..._. "
https://playground.tensorflow.org/
151
L. L. *-z:>, mi±~bn \: \,\~ = .:l-5 JL-.f. 'Y t-- '7 -? 0) G <#~~l!'I.G \: ~
* G teo fit~: I<:= .:2- 5 JL-.f. 'Y t-- '7 - ? O)J!l5e. ~MPJ ~? -c OZf * G J: -5o L. n
*~O)=.:l - 5Jl-.f.'Y t-- '7 - ?;m:~lcl:, ~§;tw;$~ < IJ~GT~TL\*9o
= .:2 - 5 JL-.f. 'Y t-- '7 - ? 0)~* IJ lei: 1943if, :)!II~~~~~O)"X tJ D 'Y? t
-~~O)~~~ij~~=.:l-C~ ~~*GkL.t~9oL.O)~~=.:l-D ~~,
AFI3, O)ni2!11<:: <15 ~:)!II~,UIIJJ?:! (= .:2- D ~) ~ "E T' JL-fl:; G te :t 0)-z:> G t.:o f!ll~*l!l!l?J
I
~~1*
I
X1
!iiO'J.w,
!EO'i.w·
•* X2
X3
!EO'J.w·,
ID>Tfd:S 1
lltl.:~lllf.l"3.A1J::! tlt.::
ID~Tto:S 0
11ftit.l~mttl"{'l,l<
~~
152
l_; iJ' l_; D --!:?' :/ 7"7 'Y !-- O)§E*iJ' S ~a;:~ 1960if.ftO).fiHJi:": 7"- .Ld;:l:, ~jz5f;
I<::~~ vc:· ~\~a;: 9 o -tO))R}E:j:J C:: tJ: ·::deO) l;:l:, 1969 4, .A.I:'!:OrjgO).fiHJi:":='M
c-65~2:Y.A=t--C::J\J\ - I--I<::J:~nf}ri,Jc·9o -tnlcl:, Jl"l'f.J'1-::JO)J\-t7'1--
D :/ lcl:l\,'F.7B7.J'Ifl1FfPJ*§ (Section24 ~~) fd:Fp~lm >2 ~~ ~ttJ: ~ \ C:: ~ \ -3 t~Hri,JC"l.; teo
I1l1Ktffit¥Hc:: lcl:, m:f:EO) J: .:s 1c~ >21Pl I! 1c:: .:t ~n~ c. e:: e-m;~ c- ~ ~ rp~JmT65 ~ e::
PiJ'? Tl;:l:~\tc.:t:JO)O), D - i:?':/7"7 'Y 1-- O)§E*l.;te7 )~::J" 1) 7..'b C'lcl:ll"l'>2~ 5
ntcJ x: - t 7' r- o :y >2 -".¥-'~ ~ ii ~ <= e:: lcl:/!"'PJ"!l§tC:? tc 0) T9 o *6Jl§J, IJl~OYrl 7'
..,..
~IUJ: Fp~lm ~ m;~ 9 ~ 1<:: lcl:~~~ ~ \ C:: !fU~f.l L_; tc L. C:: c·, 197041-t I;:J: = _"l - 7 J~:f. 'Y I
/
I'-9 - ?~C?T~$0)~~(::fd:0*-9o 5
we < 1gso .1=f:1-t lcl:, IYl:fr 0) = .:z. - 7 J~ * 'Y r- 9 - ? 0) '¥' ~ ::r) ~ ::J. •) ::<..L.. e:: tJ:
I
t~ /\ ~
}iij I\ / Jjj[ ;:?-. ~
I ~ ~~ h
r.=t-
;- I • - :. ~k~A
/J I' ""--'
1- 'ft '7JJ.
~ · ~I=
~ ~ ~
(1969) (f) I
------------------------------------~-- 7---+
1960 1970 1980 )j,. 1990
153
19801f.rtlc:::~~):2!1:Z:iJllt-*O)PiJ'Z.c \;\-5)~t!.:V,,;td5 o a:: u tc.1A 19901f.f-lt:IJ'S
2ooo 1f.rtM¥ a::""{' l;t¥.J:rJ~;;(J)~f-~t~ ;mx. a:: 9 o fP1 Jj 1c::: t> m:f'd.tc. = .:1 - 7 ;"
*~ ~ 9-~C'~, ~~~iliM$~~~~ rffimJ~-53::<ffbh~(~~~
$\;:rP~m. Section39T'Wf.IDt) !':F~:IJ~ -5 a:: <~; \:IJ't~ ~; \ c 6 h -r 1- \fc.(J)C'9 o 6 s lc:: ,
lli~(J) ::J::..; 1::::" .:1-5 (J)~~fjgt.J C' i;t, J!0)5WI- \= .:1-7 J"* ·;; ~ 9 - ~ 0)~~
:a:ff-5 <:: c 't 12!Sl~C' l.; tcotO)r~,, +t!K- ~ ""- ~ ~ JV'?:;:; / t~ c =.:1-7 J" * '/
1-- 9 --:7 :a:~p~\;\~~~~O)-'f5-*tJ~:E 5JiEC:: t~ I)' = .:1-7 J"* '/ ~ 9 - ~ 0)
tc. 0) ,;;:, 2ooo~1-~t1tt-¥ T'9 o 2oo6~, ~-~1~~=MO) r::::..; ~::..; tJ\ ii!IHaZ: *' /
t- '7-? (DBN) c O!Jl-l;ftl,.@/j 0) ~ 1- \ ;f. ·;; ~ 9 - ~ li: ~ 1-\ -r, 5fJJ¥1¥Jt~~1§1 1J
5-*:a:1*~ Va:: l.; teo 6 S li: , iii~~?~ ;ffJv ';tv/ v :/ / (RBM) :a: ffl 1-\ tc:'f,¥~
~O)~~M~(J)~fjgttt>~uif:uko <::h <::t~~.-J - 77 - =/~(J)'f-¥~T'
ilb I)' ~il:f~il:f = .:1 - 7 J"* '/ ~ 9- ~ li: J:.@ @i~W2.~(J)jliil.il¥J~J!ii li: J t~
:IJ~-::> """'[ \; \ -::> tc. 0) T: 9 0
154
c
/ - I) /7 (C$@) lli:tJP.!:!
t:!:l~ :t!il~
1'1liiif (OS!iWHU'l)DeepCNN .f.::t :J 7=f- D YO)~~. AI~Illl'¥''ii:~OO;i;:'il:iil!iX;\1< .
2016, JSAI2016 ~. >/530@J~(;!l];i;:'il:(20 1 6) J: ') 181 1 {f~!l(ilt:fF181
155
35
rGoogleO)iQJ l:ft~<Ht .Q J::? 1: , t!trs, ..tl;t "7 1 - 7' 7 - .::. :...- ?. C: l.' ;t liiOO~~
~· C l.'? f:::.-1 ;( - :J tJf~(, '""t9tl.o ;:::: O)i!? ~ 3 /""('(;t, -t" 'b -t" 'b OO"iffd8~ C (;tfiiJ
f.I:O)tJ>~Iljj~l:9 .Q;: C ""(', J:: IJ ~JW~~d)""(l,'! *(. ,
J; -j 0
::J / c:· ~ - 5' ...tic: 3=3 ~t .Q@j{~O) 'T - 5' ~;:!:., c:? iz )[_, (:: \,\-3 ,¢.\ 0)~ * fJ l.'9 0
-tO) -3 ;t C', - -::>--::> 0) C:? iz Jt.. lcl:. [ *', ~, l!i ]=[30, 120, 80] C: \,\:de. J: -3 I<:
t91fMJZ\ G tc. :t 0) (:: G -c*~ tL* 9 o L. 0)1!*, @1{~7 - 5' It:: r{PJ:b{~? -c 1, \.Q:b'J
(::\,\-3m¥&1cl:.ff:ttGT\,\* iilva A rs~C'cl5tLit, <15-Q@i~~~tc.(::~ r c_O)ffiS
7tlci:.AJ r c. O)fiB7tl;:t:~J (:: \,\ ·::dc J: -3 1<:, @11~ ~mP.JG9 Q ::S-fi~7t:b{-t n-rn{PJ
I<: X;JJIC,\ G-r \,\ .Q 0) :b'~ll~Hc:&t(~liH.~, -t 0)·~¥~ ~-@;- ~ -c r:m.~J :b~P.JG fJ :rz-::> -r 1,\
156
@j~~~ C:: ,;:l:, ~ \.,\~}{.~ (:: r~~ ~ - / ~~J <:9 o L. L. <:O)J\5-/ (:: l;:l:,
tc C:: }{.(;f r~ <TA\.. \~?!)p.js: (;:l: fJ fv 2:'<:ll5 ~ J r~<:" <lfh O) ll5 ~!Jo/.Ji*l;:l:)$~<:116
~J c \..\ -;;tc. , ~pts:~@i{~ C::GT.5il.tc. C::~O) ~ W~ J:~Ga::9 o {ji{tt~~~<: l;:l: ,
~~7 -5 iJ' G L: -5 \.,\? tcJ\5 - / ~ .5il.I±Jit ~ J:: -5 wll** G, ~~ (;: 7-5 iJ'
}\? T~tc. C:: ~ IC: L:O)J\5 - /~ ~T I;:l:~~ L: C:: <:9;0tJg~~mGT\..\3':9 o t
0)~'*<:, lm]{~8,~~7 )[.,:J. 1) /(J.:,., (:: l.t T~~~~~~IJffl9 ~ L: C l;:l:~~ C \.,\}{. 5
~<:"GJ:: "5 o
7''
1
l.t iJ' G, ttL <: l;:l:id:if@ii~~~.~~lM~fltJ!~ O) ~;fflt~~<:" l;:l:tJ <, 7-1 -7'5- = /
I
· @~1,1
·J!!M;J-15
·I'Y'l~~
[ Afm "- 1
157
}JiU.!b'b1J'? te ~ L. 3 c\ 7-1 -77 - =>:7'1,f:;f1JJ'f.l G te@i~~m,y JL-:J' 1)
A'bOJ1~tl~/it~;og,G Tt,\2' 3:; G J:: ?o
3:;9~1*~1:1::fl'9o !WJ'i*~ti:J""<:'(;t, iffij{~O) r c LJ (C:: r~'LJ ;I)Hfp]%0)/it{~~J
"l'fftt G T t, '~ OJ1J' ~ t,'? te-m¥&1,f:~~-c:~ 3:;9 o -~-~1Hc:: :t, =J':J-$' JL-/J :1-
7 tJ: c-z:M~tl:l~~g1,f:m:-~ G T t-\.Q :t OJ1J'~ IJ a; G te1J\ t,\9:h:tt~ttlt~~1,f:
f ljff.l G tJ: \,\7 ) [, :J' 1) A b1J':I*ffl ~ tL "l \, \te tel!/.), ~~';j:i®.j <~I) 3:; tl: fv ""<:' G teo
!WJ'f*~t±:J7 JL-:J' 1J .A'b(C:=J' -1 -77-=:,t71,f:[email protected] L. ~ ""<:', J: I)~ ( O)f_l
MOJ!Wl'i*~~a:;~a;~~~T-c:~ti:J-c:~.QJ:-3~~?kOJ"l'9o~~, <:OJJ:
-3 tJ: iffii {~ 3;'2. ~ 'C:: ~ \,\ T :t ? ~ :t f iJ Ff.l ~ tL T \,\ .Q =.::J. - 7 )[, .:f:. 'Y f-. '7 - '/ ';j:
r CNN (Convolutional Neural Network) J -r: 91J\ CNN '<::-::> t, \ T (;t Section41 c·
mm G a:;9o
158
~m1*~t±J --c'd:imi1~r:j:lO)~mwz:· c. 0) 7-"'JL-:a:::ttt;Jw [_, --c l, \ *9tJ\ :r·--r-77 -
= "/ ?"'<:: J:: -8 @j{~9!1I! c f~Jzj!O) ElM§ ~9/13:!? )[., :::r 1
) /('b.~ *'El<Hi3-btl: .Q L. t
lf:l$., . Show and Tell: A Neural Image Caption Gener ator (https:jjarxiv.org/pdf / 141 1.4555.pdf)
r~'f* tJ~·fiii ~ (}) ;'}\ J t.: tt -r- ~ <, r-r :n 6 tJ~·iiiJ ~ ~ -r 1.' .Q (}) tJ' J
~ ~~~~9 .Q;: t ~ iijfm
159
7-'*f-77-=/?'c
36 f3~~~8~!!
IS ~ ~~~!!<:: C;t. , A. fi'ilH~19! "? 1'."1- 1 -Q~~( B*mi'\!>~m~ c.· ) !- :::J / 1::' ~ - 9 1:
~J!a~ ~ ~<::~~o ~~~ ~ , ~a ••~m~~ft~~~~~~~~-r , ~ ~ - ~
7 - = ;..- ''f <:: e~~mm!!!-*1lh 1it.>~t.:9 A? <::~m-91H: "?I-'1'."~~ t.., *~ o
tiU~~~ ~tmlll&R
'li\';±;~'3~ ~ro~H:i~
!$~g))'~ f~)(filit~!T
3(:~:7.)-~ §id.J~¥-J
160
8Mim~~~~.mm~~M~~-~~~~~~~~-~~fi5W~~~
<<J5f?*9o
ffiO)%ifa~ I~HFf e: ~i, 1.J'AJc/v (;: l \X. ~;f&b§PJ7J'm--c9 o x~~ ff~~~ (~ot
:$]'~~1~~<7)~~
161
§?,~~ 88:9i}Ej~;: -:J \,\ TO)~~~D~il~t 6-::> te t. L. 6 c\ 7 -1-77 - =>7
~ fljffl l.; te 13 ?!.'\ ~ 88:9£1J1I10) Jy "A? t.f il'fv te fv !<:Iii~ l.; T \,\ ~ 3:: l.; J: ? o
3::9~<!:, WMB;R~9 o :fJJlmO);j~1Mii£~m~<t, CD$~~ t ~.:~m 9 ~®Bm9G
O)X$1<=tiE-::> T~fl:'''-~ X.~ t. t,' ?~F:m1<:-*~tJ::9£1J1Ilt.f fr-:> T t,' 3:: L.; teo :t ~ 6
1v z::. 0) J: -s tJ: :9lki1I1 ~ l<t -s a:: <~,, ty<f, ::r'- ~y -a: m~,' tdff~tB".l~:ffltiTI m~<= tJJ IJ ~
b~ z::.t.~~IJ3::9o-*88~tO)ITim~ x$0)~ ~DX.~O) m~ -a:~~, ~~
162
: ~iS.*JlL', ~ f± ~O)JI.lfJ'Jm.Jill2'tlt:::o
.:.::. "3IA--:J ! ?-?cT..f'
_.,.,_=:r?Q)"),t:. '~~ '"
X lhol"'l<OG.Iei-MoiN .•t ~ "'"i'!"'!Ub~
~ • •r •"l"~tq'~•!l f~'v.rtd~
~llli2'tlt:::O) I ;I:, A~Bml:tt<t;~t±~ ·C.
f 1, =i;()t ... t;t.T.~( (tl t. L. J! I,., Kt.JI.t;.loii'\O<:II t lt hl~i'.J ! ·.t~
V ~ 1: J: ~ t C 1;1:, ~ t±O) CJ ·;~ 1J -L'IIHii '€:
:lilt t 7 t l., t::: ~ L' fit. t::: tl l: L' ~ ·· ....
5
:r
1
I
/
7
Google=m I
~~-t--~t:::'-11-
Amazon Echo
••
163
3 -:> 13 tJ\ X:t ii!i ~ A. 7- b. l' 9 o Apple (J) Siri t-' Google 7 ~ A -7 / 1--- ,
= ?-- ~ 3 ::_; ~11'? t.= tt -r:trJ. <, ~r"~ It: :Xi u -rJ.~11JtrJ.@l*:t :f'J\,' * 9 o c.. (J) J::
-5~ , ~~ ~ Xjl_,""(@]*~fi5~fi~~~Jit*C~~h*9o
T ~.,, *9 o ¥-¥,<:::, Google (J)~~ilJJJGt<:: 'b~A ¢' h T ~_,,~ WaveNet 'i ~ f!,\trJ.m
-~~IJJG9~L..c~S. ••~'b-:;,T~~AhSh*uko
~ ~M~~M~~ft~~tt~t~T-~e~M~-~~~mwA~
164
6!i!
7-<--:15-=/?'(])IHI~~Ifi·~JI~-:>l.'L'
t>1J'? 1tt: \:-3 ~' l, '~l, ,~~(])-:/0 12:At: :J
7tt~l~'?l.'L'MIHJ L'l.'i!~'J" o t:lctl.t;t.•
ft~~~~lf:llctBIJ\I!NI~ii~. ~ili~iJIJ~t:'=tJ
lfll,,ttlfZJJl~M~t:~?L'l.,~"J"(])~.
=j'-9"1f:J...1J
C.O)~"{flj\~ <9 .Qif!f¥~
t r~~J cll!Ji,s'·
-'ftt -f'tlO)J!Oij.H~~{I:; Gt.i:ltttlcft.i: s f,j:l, I
166
6~~i2Hifii~ (I\ ·;.t 7 /CII~T- ~ 3 /) lct:-t-O);g O)J.m f), =~ - 7 J[.,.f. 'Y
~ ?-70)~~~~*~-~~0)~(~~)~-3(~)0)/- ~ ~ffi·~~~
.Q ~ :bf.J' :dc.~-8-, -i-0) / -~I<:: ;!;) tt .Q ~~ (jiijFJi~~) lcl: 10-8=2 ~ tJ: f)* 9 o
~<:~.%]pJT~~~~Jj\~ < 9-Qfc_i\1)1<::, ~S!L:1-::>fiJO)/!O)t~~~/j\~< ~*9o
WJ~~I<::T, ~ .Q n:i'El 0)~1<:;1;) lt.Q 3 -::>0) / - ~f.J{!!)(.Q~~f@~ 4,4,2 ~~ .Q
T
~::1§- X.. it: u .~;-5o <= O)t~-8-, J!IW1:Z3:MI<:~ -::> T~tlf~ htd@:lct:3 ,3,2 ~~ .Q tc.61.>, 1'
I
~h-t"hO) / - ~ ~O).%JpJT~~~~ct: 1,1,0 ~ tJ; f) it:9 o ~XI<:, 9~-r 0) /- ~I<: 7
7
;Btt.Q.%Ji'JT~~~~mL'-r, ~:t.J ~ ~*7- ~0)~~ 0)fD~~.Qm~r,u~~-~ I
-
l_;, -i-O)[email protected]~Jj,~ <tJ;~ ~ -5 I<::~/ - ~ O)JlJf~~~~ .Q <: ~ <:', ~f)~ L\ /
'/'
(/)
=~ -"5J[.,.f.•y ~? - ? .:C~J [., ~'¥'-~t.J{~/v""{' L\~it:9 o fJ;;B, f~~~~~Jj\
7
~ <9 .Q~ ?i'J:mJJ.~gf-lf~ .Q1J$1ct:, Section38 I<::;BL\T*Bfru *~ o 0
t
:A
~~~ffimli~
C:
:::J
(n-1 )!IH3(7)~ (n+1lm§(l)Jri! 7
J')Z
llftmll!:.t IJ~•~ ttt:im /illj
~ ~ - =1 iE31J'S~~lJ"t"
0::(7)./ - ~(;::
*I>I)Stt"t"~'~i@:
·-----e/./ - =1 - =2
10
·-----
A tJ "/J' €> :±: tJ ~ t '!; f& f.1l'fi h ? t' L' <mUt f.1l'ffll fi~l, ~ "/J' q)
Ia'? t't~~~'J'~ < VtL' <(})f.)l'i!ll§~fim~~
167
=3.-?)L,*')I "'J-?0)
38 Bili~
---~~\'!' = .3. c:
- 7 }v* ·;; "'7-? (])~7 }v.~~~ ~ 1:t ~ .:. ~ r:~tlm11::9 ~ J <t c:
lllfV'~ 9 o !f*rr-H: 11 Section33(]):J'&~11::C: ~ l5 ·ll~t~-r·9f.l)'", .:. .:. "t'I1=E7 Jv(])ftJM
1tt:~.~ ~ ~ -r-r~I!Jl (.., ~ 9 0
~7'JtA7)tiim1tc la:m~~~(])fi!J\ft
iiJm1t:tira;, ~ E! tr-J~~:a=w* C* tdJ:fiJJ') tc::: 9 ~m CwJOO~~) :a=:>J<:61J ~c. C:J
c·t) ~ c \,\ '5 C. c tJ:, Section33l'~Bjj l_, a.: G tc.o l ' tJ: =E 7' } [., 0)~~ tt:: t3 \,\ T
wi001t: ~ n~ 13 ~ml~ c tJ:foJfJO)c G J: '5 fJ'o 9ctt::<t33M1E'fJ't, Vh a.:-tt fv
fJ\ =E 'T J [., O)~J001t:t<:<t3 tt-@ § I¥J~~tJ:, Section37 -r-fWm G tc. r~~~~1lili5!J
C'~~C'E'-@ r~*=~~J lt::t5t.:. t) *9 m*:~~O){~tJ:, =E'T)[.,O)tf:l)JtJ~lE
0
c{tm90)C'9o
.. I
\ ti~M~(])fl!t.Jf
'b?ctJ!JI~L'
li:O'i. · 1'11'7A'i!'
~-::>It .Q (])1.Jf~i~W:
168
~~ {f:; I<: lcl:, Xt~ C: t.,;:.@ rp,M I<: -c5 b i± T ~a;:~ a;: t.,;: ~$:1J'f¥1± L-a;: 9 o
Section33 -zom~ L- tc)S1~ak.J7 Jlt :J. ') 7: b. lcl:, ~I<: .t L'mc1;-~bi±~~9 .t -5
tJ:rp,HH (;mc1;.-8-bi±Jli~1l::) cfillg~~~ L-a;: 9 o <: <: ""Z'Icl:, 'E 'T Jl.t(7)~~1l::
-zom::tt:t? C: :t~IJFF.I ~tL -r L'.@~i!~I!!""F)!O)~:<$:®JI~~aF.I L- -r L' ~a:: 9 o
a;:~~~~k~1J:·~~-~~~a;:l.-~"5o ~.@ - ~O)·~~~?T , ~4
I<: f@::IJ'Jj' ~ <t.,;:.@ .t -5 t.,;:]~~~Bc 9 o B~ak.J I<: lcl: :t -50' l- *ffi:IJ'L ':1E~:IJ~~ 'J
a;: 9:1J\ -~t¥.H<:: <: (7) .t -5 t.,;:~~(7) Z: C: ~ 8~~ C: L' L' a;: 9 o tc tC. L- ~~~;: lcl:,
6
~•(7)m~~-r•~•~*~S h.@~~~ ~e:~~~'Ja::tt~om.@z:c~c
7'
-(
~.@(7)~, ~.@•~~h L-kc ~ (7)•~ ~~(7)~c, ~(7)•~~~.@00~~~
I
ili~ (1tJ ~ ) C'9o tcc~lt, 5.1~cJE ft l-:IJ'~~_t.,;:l,\ tl..J ~:!V:L'TL'T, ~L'.@ 7'
7
:ijj,pjf,t 'J{;r.!J:f.J\{~l,\~j'Jfl;:jlsl 'J t;:l, \ C l.- a::9o~(7),t "51J:~)J?,C'C'~.@ L C (;:!:, I
rJEft(7)~NC (1'1Ji:~) ~ ~ T~ 'J t&l<: t.,;: ? T L\.@:15~ l<::jlsl 'J T L' <J ;:: C: c L- ~
"5o 1yre!l1l~$C'Icl:a::~I<::IPJG~~1Jc, -~~-cL'-5 rtl..JJ (7)~NC~~.@
1J~I<:~'JT (~~) L\~a::9o ~~~li~Tit~'J.@Z:c (~~) ~< 'Jl/&l_; ,
~fte:IJ':Ifi 5 l<::t.,;:? tc C: ~, -t-(7):t~M:t.J':m.~~~(7)fi,N@:C'~ ~ C:~ ~ , JW~•
~· C: 9 ~ (7)-z"9 o t.,;:~~NC:IJ':Ifi 5 l<::t.,;: 'J, -t-hl;Z...t.O)~~{I::::IJ'~ 7 L- tc;:: C:
1;:1: rl&5R L- tc1 c ~ffl. L-a:: 9 o
169
19~1!1ff~~fiJJf.l9 .Q <: c ~' ::i.:-I*B"Jfci:~~O)%t.J{pt.J' s t.,i: \, \~)5L-r"=t ~J.OO
M~*~Sh~3~~.Qcb ~~* ~ko ~~~. ~k ~ T~~-~~~- 9
«T0)~55L-r"&:'9~JIM~~-:JttSh~O)~~ J: 3t.l'o tcc~tt~~O)~ 3 t:J.
~-~~~* ~ J:3o~~~O)~ft c~A t:J. ~ , W ~~8~~0)-Mt:J.~ft-r-
9o <:0)~3~WftO)W~8~~.Q~~O)<:c~. ~~~O)~~·~~~T,
~Jtl ~t.,i:\,\~=t~ ~ * 9 0
170
~Jj{t;'c::: E t., \ T~il!9"' ~ rp,mHc:::i;J:, I\5Jp.fi~JrjMi<:.1.JDX. T, JUZ5R(1);i ~ c ¥
~-(1)~~~~0*9o~:5RID -~c~~ID**~·-~' ~@ID-~~~:5R
9~~~M~*9o-~ID~-·~-~~m~9~cr··~E0~-~ID*
~~J ~9o -?P:f.J'!J,~9~~ct.,\"J*"Cf.::?T't~:5R-tt9, -~f.J'*~9~
T~~JrjM~DO~ ~ T~*5k~, ·-~~~9~~~~~0*9 o ~hS
IDrP,im~M);Ji:9 ~ t.::~ \<:, ~ h* -c~ * <! *tJ:~JI1t;:r J[.,:::f 1) A.b.. (Opt imizer)
n"'lffl~~n -r \,\*9 o 6
t! ~~·~tc:i: ~U~Ht:r Jv ::::I' IJ ;<:b :r·
1'
-?--:::>OJ"¥" ~7' -5' L'f~ Sh~~fl.~~~OJifE:t:J~i*WJ>!<::~tJ:-0;: C: I
/
~D i~ ffl L, 7' - 5'0Jm.iAh8 ~~~S5~¥b~~~-~$~ 7
(Wi~a"J~~-~$) iOOffl, Fc.l?JT~iOOM!<=JN:!R9 .OMf~~~~'f~. m~~~i'Cl~~ ~<::!J ~ I
~'• iHc"¥'~~OJ~5EtJ~~L <, l&:5Rt.J~li!~'•
RMSprop
~~cOJ.g-m-im!!&~li.J1JZ~ -rm-~9 ~ <: e: -r , J: 'J ~)[[0)~~~ 1:11:
:fJ'I.L tc. Adagrad OJ &&It&.
~~~(1)•~reu~~M~(1)~+re
171
=.:1-7 J[,-* ·;; i' '7 -7 ~~m'9 .QI!~H;: 11~£19!fidl5~~ Jfl'-' *9ti·, -t'O)II~H:::5:t
G 1Y~cO)izHI
Sect ion37-38 I: lcl:, .::. .:1. -7 )[;::f. "J r- '7 -? ~~®11::9 ~ tc.IY.J(J)1J51i.~~U
* G tc.o ~';: Sect ion38 \: lcl:, I&JI11:;(J) tc. IY.J I<: lcl:~~~1J¥HH.~ tdll (~rJC) t/
~,~-z-®~c::c:t~l'ht;:Gtco .::. .:J..-7)l--.::f.'Y r-'7-?l'lcl:, C::(J)~!lctJ{tl:l:tJ
t~UtJ' E> A.nmH<: 1E:b? -r ~, \ ~ *9 0 ~~~c~:~ ~~J®9 ~ tc.lf I<:~J®9 ~/!0)~
~0)~-~~~*9o9~b~, I!~ ~J®9~c~h*l'~b-::>T~k~~ ~
~ O)~ftetJ~ttlt f:>h ""[\;\~ *9 0
;fif~UO)~~ X :t? c;fif~UO)~rJc X :t? c :t? ctlf~U(J) ~rJc x ······ c \;\ ?~t- -1
-- ~~ r~~~
AtJ : ~j ··· Ea~~= ~n
~
I X
~~
~~
X
X
1y~ ~fti!:)fjfl::
1y~ ~m~fl::
1y~ X 1ij~ X 1y~ X 1y~ ~~Jifl::
1y~ X · ·· X 1yl£ X
-
~~ X 1y~ X ~l!c ~m:~fl::
172
~WCiJ{J1Htflb ~n~ <: c iJ{, $Jl!i~Wi~r.,,im0)1*12SJC'9 o = .l-':7 Jl.-.::Jz 'Y f-.
'7 -? ri/!tJ{~~., '';:t; c~~lttJ:¥-if~~ ~ J rt t±ltt ~ tci1J, !!tf~ < tJ: tJ tJ{ts C'9 0
tJ:? T L \a:; 9 o -i-0) fc./51), 53'ti{t~~1nc:::: [;i: y /y''t-1 ~ ~'i&C'i;i:.tJ: < )ffi;% ReLU
~'#9:tJ: c ~~-3 O)fJ\_=E)JiEC'9 (Section34*~1Vo
53111t~'I&J;,ZJI- C'5~~rP,~1!:~ <: tJ rc:: : < < 9 ~15$; C:: L- T (;t, 300-tll rc:: : (Xavier,
He O):'fJJ!!F.l1@1!:{:\e? T) md7-1itJJ,Jl1t1!: 9 ~ 15$;?, 7'- 5' 0) .A:tJ ~ J \ 'Y -T lE
f.lHt e:: IJlfl;~fn ~ 155nc·£J#!! L- --c J.:> < 155ntJ: c.· il'"Jb tJ * 9 0
- g(z)
0.8 g'(z) / 1ili£g'(z) ti
0.6 ~::k-z:·.:t o.2s C::,J,~L,
0.4
0.2 1
o_s _.... g(z)= 1+e-z
0 5
173
40
~~Q)t/1U3t~i!RT· I;I:, !'";( 1 / • 7 -9 • 9~?:fJ~Jtf.!:9ii *I;I:~IJ qi~:-~ 7JI.-~
11=-::> T~B'~11' ? &,~:fJ~ 5.> ~) * L, f.:: o L, t.P L,fi3~~~ fJl I.' 9 t, if.> 9 .:C7 Jv~~
f.!:9 9 ~? ~~~~I;:MfiJfJ!T· ~ *9 o
G._fii3~~ C. I~
~1*171J c V C JFJT!i;U~~t&i;O) ~[,:w; c Twitter 0) '/' -1 - 1-- ~ -1 x - :J L T <tc
~ \,\ o X~~7NITLT~3Jm~:fftlt:l:l9 ~=f:-TJ i,~fF=~ c LT, ~2$c '/'-1' - 1-- C'
(iX-1* 1<:::;1;:: ~ t.,:~\, \;!]~&;, ~ c:::. c ~;15 X.~ c, Jmm'(i, '>' -1- 1-- 0) t:
~2~~ tdi
56 iJ'Ii:~11::: L tc=f:-T )I,~ J.liJ..(z (;::: 1-F ~£,~;1]~361') .."f ·?"<:'9 o L.. O)fi-8-, ~ .)( -1
'./ c 7 - 5 ;i){ r ~c$c '/' -1- 1-- J c \,\-3IR711<: ci;)\,\T ~t.,: I') , 5 A.?;!]{ r~Ji§.
O)tdJt:l:lJ (;:ci;)\,\TFii.l utc c biJ' I'J ~9 c \,\"3 c:::. c li,
o ~c~~7NIT9 ~J: 71<::
I<:~~ ~tttc=f:7Ji,~f7JWH~c L.,, '/-1'·- 1-- ~5:HIT9 ~J: -3~~~1'J-3 tc(tc\
'/-{ - 1-- 0)7j-:tfrl<:~11::; L tc=f:-T )1,{!:1-FP.X:-z: 2' t1At~/¥~C'9 o L.. 0) J: -31<::, ~
i¥=f:7 J i,0)~5'e~lFJT=f:7 )I, I<:~ L T~~9 ~ 1J5.1iiJ'ti~~~ C'9 o
~~~~tf-3 *< \,\(fit, +7i'I<:~~0) 5~A.Jc=f:7Ji,-a:~f1Jfflc·~ ~tc?sl)~
~ l<:iJ'iJ'~ Bey ri397'J{)}O),j,' L.,, *a~ c L T~~~7B'-J O)=f:7' Ji,•!i~H>rPJL9 ~ L.. t
I<: t.,: I')* 9 o r~c~iJ' 6 '/ -1 - f-- J 0) J: -3 1<::, ~ x -1 './ ~ ~;t. T~~~~~ 1'J-3
/J$ 1i, 1'';( 1/il.~ t=bO'fltn~9o
lii:J$~~
!¥11#)1~1 •nAgt~.~:~'
tn~~~O) tnf~]tO)
r
7-9 1::
7"(J~#~~·
711\JI,
t
fi\~~0)
'ET'Ji,
!¥11i~hl1)~~'>:
fii3~1Hi
711\JI,
t
tn'f~]tO)
'ET'Ji,
7 - 91::
7"(J~#~'t.i:~ \
ti l 1
t t - mltllttlili#J:~·
L fii~~O)
7'-'9
tn~JtO)
7'- '9
~~ l~t.l'tJ'Q~Illl
174
~,;~~O)JJ)! (~mtmllit: 7 r1' /7-:1. -=/?~
· ~m~wl±l
~*ID•*~B~~- ~-~~5~B~~ffl~~-~~~~T. ~h~A~
T'- ~ t ~T l- \ 3:: ~ tc o ~ f.J' G ~ -1 - 7' 7- =:/ ?. c· ~;t, T'- ~ ( tc t X. ~tim]
1~IDim.i*) ~~ID**Ah~tctt~ • .LE~l-\ -j'>)~~*a~~~~~*9o L:ID~~.
7'' 1' - 7' = .:1. - 7 JL- .:f. 'Y 1-- '7 - ? IDi&i~IDJ!!\l~ (;t, 5:1'it~~<=~fflt.;:~Wm:IJ{{E
b -::J T l-\ ~ t :15' X. 5 h ~ tc ~, i&f~ ID /! ~ -lji'J IJ I1Y. -::J T, 1-t b 1J ~L: SVM fJ c 0)
~*ID·-~R~--~~~~T~ . ~*<~-~~*9o 6
7''
-{
. 77 -1':/7- ::J.-= ":/ ~'
I
@l{~~~.~~fj~ CNN ~L:;:!;)l,\T ~;t, i&*JJ IDJ!!\l~~J I 'Y ::Y'f.;: C'ID-m5ts~t.;:¥-JW: /
7
~t!:EX.. i&13tO)f!~t;t~ A?~<::: J: -::J T W,~ -::J td'ij.W:::>if:}.@X. T l- \~ L: t 1f~D 5h I
X., it!> l- \ t2 ®ffg~ (;t.Ej:-\-> if,_-\-> El t.;: c ID~f~!l:~ }.@X., i&f~O) !!~ ~J~~l*ID¥-f.W:
tJ ~A?~<::: J: -::J T :£:b ~ L: t ~Jt.;: \,\ tc ~. -/Jf_~ '§' :>if: ~ T ~*X. ti'fE}/Jt~'§'9
s::~x J
t;J]~)~__ _ _ !c:.~ ----,
tel
conv3
--[
'F~
l!'l ~
1E
softmax
fc2
: tel : conv2
11 tel
'"[
convl conv3
: conv3 J; '1!/<7)
: conv2 : G r.! conv2
' ' to: 1<1:
:___ _c_?_n_v_l___ ~ =j-'- '9 ~~ convl
1
=j-'- '9 =f'-'9
175
~~~~!;: l;t~Jm:t it!> f) a:; 9 o -f-O)- -::Jt.J'ft0)6n (negative transfer) -z;9 o
Jm'W;O)~~ J:: f) :ttt~~O) J:: \. \'E7'JLJ;rf'F~ l;t9t.J\ .&x-.tlc:tt~~O)~\, \'E7' JL- t.J'
~6hTG;3:;~~-~~mG;3:;9oti~~~ti~~O)~~?~-t-h~~~im~
T \. \fd: \.\ ~, ;: 0) J:: ~ fJ:*a~l;: fJ: ~ :t~Jri3-t.J'il5 ~ 0) -z;)i.~ G ;3:; G J: ~ o
~T, ~~~~~~~~-z;ti~~-~ff~~$~GT, ~?~3~0)CW-z;
l;j: ~ ~ ~ ~)jj-8-~il1f5k G ;3:; G tc.o J;(T -z;l;j:, ~ ~ ~ ~~-8-1;(7'}0)~~~~~~$
~*Bk G a:; 9 o ~~~~-0) :iE~WlJiM~£c· l;ttJ: \,\ tc. 61.>, <= n s 0)~5~1;t~~~~
O)~~~B~GT~~6n~~-8-~ ~ f);3:;9o
0) J:: ~ IC:, :i i> ~ J[.,~ 5!B~ ~it~<::~ -z;'E"T Jl.-tJ'-t-0) :i 1> ~ J[., lc:~{t G T \.\ <
0)~ lltJ'/!-::J-::J, aBO)··~~ JE G <~~9 ~ J:. ~ lc: G T \. \~ O)-z;9 o
A.1Jx
176
· '?JL-7~A?~~
-c:z )[.,7--'J A IJ "F~ (;:t, ~~(1)5' A IJ (<: "J l\T!i-TI8ey(;:"F~~6-:J T l\~ a;:9 o
L.;fL(t::x;J- G T~}i';'O.:J~~"F~Ii-&:¥-Jfi::(J) 5' A IJ 1<:-"J l'T O.:l'E-7' J[.,~"F!§l~
it, -T (J)".f'~ (J)*a~1t 1:.7J' G T{lliO.:J-5 A IJ I<:J;E;ffl G T l \~a;: 9 o
·On e-shot~~
One-shot".f'~l;:t, r-~ij;fjl\T+~*D-QJ ~~1J5't:T9 o 5:l'~Fo,lm~$5;Z. T
J-f-Q C:, ffl.~t!tWI<::fF?±9 -Q 9 rz--r (J)5J'~Jil<: "J l \ --r+5J'fJ:. 5/'\.J[.,fg~ 7' - 5' 1t:
Jmi X. -Q L. C: (j:/f'PJ~~c·9 o -TI]) tc (/) , iJ5 -Q 5 /'\.)[.,I<: "J l' T (J)~il**-T- 5 f.J'-"J
(<!5 -Q l\li::\t'~) G f.J'fJ:. <T =t:iE G l\t±:l1J7J'c·~ -Q J:: -5 fJ."F§l7J 5!7J'{VfJE~h 7'
T l \ a;:g-o ~ €:>!<:::, ~/E(J) 5/'\.Jl>f.J'"J l \fd)ll**7'- 5' f.J' f.¥:1± G fJ.l \t~r<:: -TO.:l -(
I
5 /'\.)[., 1t: t±:l1J T ~ -Q J:: -5 fJ., Zero-shot ".f'§l C: !Jl¥kftL -Q 7J5't:=t m~ ~ tL T l \a;: /
7
9o I
J_l: - 9 A 7 1 (f)tf:l:tJ
»- 9 A72 (f)tl:i:tJ
B __. 9A730)tl:i:tJ
177
~~-7~ -= Y7~~~<~~- 9~~~~T~k~. ~mm~~-9~~~~
~(1}nf];!t't.C":~I*T (""f~)o lt:IJ'lt, @I}..:IJ<~~ - ::17-=Y7~f:f?J!fjH<::\;l:,
:IJ'S~~~fJ?~tJ'J.li~lr.J""t"~~~~.g.tJ'~ '?*To tcLU:f. @i~~~m~~-9~ "J
~~ Vr1[::gid; lmageNet li 1.4007J:t51:~lm3t~ 256x256 t:"? ~ JL.-~@ii~n:fflii!X~tt.
1 00GBl;J....t~~-1J'~ '?*To ii~LAtJ' ~ ~ -7~-=Y7~fi'? ~ ~ 1<::\;1:, ~-9~
~Bl;J.ft~. ~~ ~ ~~~~?~~--~- 9~~~~7?YD-~T~~~~~~
J.li~lr.J""t"li~ 1J *ttA..o ~~tc~. 1[::g~ ~-9 ~ "J ~~~~)1fJ;.~~JL.-1J'T""t"l<::1
Y 9 -f. •:; ~ ...tl<::1}fm~ tL l: ~~*To ~ ~~? \<::1}!; ~ tL l: ~~~~B;1f#~~ JL.-~
~ ~ c:-&-~B~rr?~~~. ~<-•lr.J""t"To
ili.i:F""t"li. ~r!.\§~M-~0) 9 :J..? l<:: tci It ~-i-~B1Jt;i§ 2" tL n '* 9 o 2018.i:FI<::
BERT(Bidirectional Encoder Representations from Transformers) ~ lllJL 1<:1: tL ~ !3 ft.\~~~
tc~~;fLm~~Jt.-tJ'~~<!n. t.&•~a~m~~~ ~ ~ ""t"rgjm.§t~-'f;Jt~f.a~~~~~ ~
1J'""t"i! ~ ~? l<:tJ; '? * Lt teo £tc.. 1?t §~~~ -9 -e "J ~ ~Jf.l~ltc~B)}ifJ;.~~JL.-~
1}!; ~ttl: \,I£ 9 o 8:<$:~-c> l<l:. 8 :<$: ~Wiki ped i a ~ ~ - 9 ~ Jf.l\,ltc BERT ~~B~cf:i.
~~JL.-1J'1}m:J~tt l:\,'*9o
*!3?!.\§~M-!i~t<:.~ ~
I) ' ) - :J.. (JRiW~~)
*~~Y.:I!i>
* livedoor =
1\:J..
.:J. - :J.. :J -
ns
7~
c~l,~G~5o
~hi6h=:z. -7 JL,
41 *'Y "'7-? (CNN)
il.h ~h = ~ - 7Jt-;?- ·;; t-'7 - 7 (CNN) 11, = ~ - 7Jt-;?-·;; t-'7 - 70)!flT'bOOiM
t.t C'O)~Q;:5I;~~IJ 7 - 11 (11'~1J · 7/ '.J Jil) 1:~11:; L, f.: ~ 7 JilT if.> ~L i!j{jagi&it.t c:·
0)1}-JfTIA< ~t>tt -n,*9 o
L.O)~~~~O)·-~~~l_.,k~~~fi?L.C:lf~~~0)~9o~O)k~, ~
~'iii; G)
•
=~- 7J[,;j'.•;; I-'/ - ?
CNN llilll~fWdl
f~~;:!tl-6:>
t./?O@i{ft
180
CNN 1;:1: ± I<: • h iA h Jj (Convolution Layer) t / - 1
) /~iII (Pooling
Layer) , ~*a~ll (Full Connected Layer) OJ 3 -:>OJ/Itl' SffiJJJJZ~ h*9 o -
~~~~ N ~, ~ ~OJ~5~ =~ ~~• t7-~~7~~~li~m~~~k
~~' ~*SJ3-J'I~\,\( -:>i.J'~~tc.mJ.§: ~c IJ*9o iWOJf!B7J'-z>l;:l:, @i~OJ~W:~
~~ 9~~C~~I)~~*9o --~~"t:~-~~~- ~ ~~~9~~clf-z>
~*tt~~, ~-~~~~ T~~ ~k@i~~~~T~S~~G~-~ft5~t
t:, fl*to:¥¥·~~!5!9~~ c;/J{""(' ~*9 o ~~OJ'§l}5.tt:l;:l:, ~OJ ~i±l ~ntd~
~to:~W:~ ¥¥~~~ t ~ -r :t:& L, , .z- OJ*El.~-8-b tt -c·.:Y;~~ r->?J'm~fr.:;:, t L'-=> tc ~
<~t:9o ~OJ ~ ?to:CNN=E 7'' J [., ~flj ffl 9h l;f, tct~l;f-{ :X · .:f.:J · t: f--
0) 5 -s cnt.J'OJ@if~~/\t.J 9 ~ t .z-OJ '7 -"'JL-~ l±lt.J9 ~ ~.:;:, to:7 JL-:J" ') 7-.'b. ~ =;·
1
fJ=Jl)Z-z>~*9o I
-J
7
I
-(.X : 90%
;:?-::J : 6%
~ 1-- : 4%
:•O'J.il;O'J.I:
fl :/- 1)/7~
e: i£Foi3'!!
CNN OJ i.J'Ivfc ~to: 7 D t: A. t .mJ.§:~ !m-::> tc t ~ 3 --c', ;_x OJ r-.::- :Yi.J' S 1;:1:,
.z-n..z-nOJ/IOJ{~~~J ~ ~ IJ ~ ~ < ~~m ~ -cL\2' *9 0
181
G mh~h~(])~~
:Kh~hll--c-lcl:, 'ililf36ilf 7 1 Jt.-5 t IJlJLitn~, ®i1~9=JO)*¥:JEO)~~~c:&:r,t;
~~ ~ tttc. CNN ""C' <t!>nlt, :*:OJJl ~ EL :&: lt:&:iit9 ~ J: -3 tJ: 7 1 Jt.-5 t tJ: -:J
Ti.,' 1S t i.,' -3 L. t -c' 9 o L. L. It: WT L, <@i{~ ~A 1:J 9 ~ t , !J!I ilf 36 ilf 7 1 J[, 5 -c'
7 1 Jt.- 5 OJ~tc lt~IJX~ n~ tc.~, nfJ\ 1 ~OJ@i1~--c- i!5 -:J -r.:t f~ G n ~*¥~
Y 'Y /l;:l:fl~cfd: 'J *9o
~
•
.. §
X ~
lmt/lj\~~\
-ill G1J:~' ...
li'i'
"-d :Ef
f~:IJ~'*~~\
~
~ X l
-fil9.Q
182
7-~~~g~~ . ~~~~~~~~~~~~~-~~«T~W~~~T~
~f}? <= c -z:. 4x4~j1Jt0:: "":) tc.-T-~ tJ{2x2 ~7- ~ (<:Jia'J'2"tL. tJ\~~n.:e
(.-
-h~h~~~7~~~~m~eht~~-V77~~~~~
7"- IJ ~?.JI"f(;l:rJ ~ ~ ~·rj~JJ(: J: ~J 7'- ~ ~JI-~ ~
*~e~-r~~m•v~7~6~m•~~w~~~·~-~~
183
RNN~.~ - ~~~·~-~ ~T~~#fi~~~t#Mm~~o ~~~ ~ ~-~~
~~m•~~ -~ ~ ~•~~*•~~~~~~.RNN~~m~~~~#~ij*~o
ftlfrc·l;t. ~~~ ~~ - ~"-~LtffliJ'MI:lttA ~l. ' *~ o
l
@i{~~~~~'Z' ~cl:@i{~- -::J - -::J I<: 1.'R:s'I t_., -c tittJ ~ f'J ~ ' a:; 9t.J\ c ~I<: lei: -T- :$' 1,
-T- 52, -T-53 · · · · · ·c ~ \7 ;ftth0)*-JU -T- 5 (E§fF'T'- 5t->7:f.A 1---T- 5
t:i. c) 0)9 ~ l ~ A.f.J c l_., l t±:l f.J {;:: f'J~ \ f.:: ~ 1:1~13"-b (!51)* 9 tc c X.l;f~O) .:Y
0
5~U{f:~ X.~ 7 - .A -z>9 o rBJ=I B ~~ c t:" -7 .=. 'Y -7 I<:J O)f3t0)~~ rrr <J c .:Y5~U
9 ~I<: lei:. rafl B / ~~/ c / t:• -7 .=. 'Y -7/ I<:J c ~ ' 7 $~0)*~1J ~ IIIW.m:~ I) A
f.J 9 ~~~~t.J{ (!51) -i-7 'Z'9 o L. O) J: 7 fJ;T'- :$' ~ .=. .:J.. - 7 Jl-*- 'Y 1-- '7 --7 'Z'i&
71<: 1cl:, G)A.f.J -T- 50)~:f.J{5** -:J"l<!;) S9, <2)A.f.J9-@T'-5*91J f.J{~< "l
=t~!itPI~ -z>,@T' - 5 *9Jj 0)}11Ji.fi {f: 'i*}~ c~.@ J: 71<:: l_., 1d: <"llcl:fJ:.I) a::tt lvo
-t:- h ~ PI ~~~<:: 9.@ 0) tf :fli ~ ~ .=. .:J.. - 7 Jv * "J I' ? - 7 (Recurrent Neural
Network, RNN) -z>9 o
1\
@\'!Jii;:J:ft L, .::: '77
y t t t t
t ... ... ... ...
t t t t t t
t got angry. ~ L, .:::
X
J\tJ: T'- 5'*~J AtJ : T'- 5'*~J
:±ltJ: -7'- 5'-W-f:<l> :±ltJ : 7-5'*91J
184
:te~-v--n: ilb ~ riii~Hn:ti~ = .:1. - 7 JL-.f. ·y 1-- '7-? J 0)~ c, <:.. 0)~-:J
O)""f lt:cl5~ rR NNJ O)~~Yi.lt~T< tc <'! 'v'o RNN "CI;t, 7'-50)m~&~ 1~iH~
9 ~ tc. tsi) O) JL- - / tf~/Jo <'! n T "'' a: 9 tJ: <lB, JL-- 7-c --:J tJ: n'n T "''~.f. ·y r-
0
'7 - ? 0)§135:)'~ a;: C: t9) T ili~-1! Jl- C: Wf lf, ~~~t: J[;jJ{~:j=ey GT 'v' ~~;l;:!W,O) L. C:
~ I*JBB~~ C: 'v ''v' :3::9 o <:.. n~ ~ r~~::tJ(oJI;:~I*J9 ~ C:, ""f ~:t:JO) .t? lt:W!~Ic.:
*'f·~~X 1 ~ ~2~ G 3: 9 o L.O)P'J 'S5~/W h, ~ ~ C I<: y, fJ\~)~~ <'3 h:3::9 o ~ 5 1L., =j'
1
x2 f.l'~~~i:? JL-I<: A.:J:J <'! n, pq§!l~iia h2l;t h, ~~ I ~ *'lt~-:J-:J x2 O)Mi&~ ~2~ G, I
/
L.O)pq§!l~ S~~~c~~~~~<'!h3:9o <:..O)~h~ ~~ G?~X-cM~ 7
I
nt<C W'CJJ.L. t1 5 n~r.,~:mxt.J{.i\1:JXo, x, , x2, .. ., r.,~~x~ M'v ,TM*~n'{PJ~ -
/
~21i GT 'v' ~ ll'il'M ~i::: J[J O) pq:ef5~/W h0 , h, , h2 , ... , ~J .I.< C: ~ :b? T l.' < m* ?'
(/)
~O)m*~~iJ't:81:Jyo, y,, Y2• ... C: 'v ' ~ *9o 7
)[.,
::j'
I)
;;(
b..
~±W ~~~ ~~~
/\ /\ /\ 1\
t!:lt.J y, Yo Y1 Y2 y,
l l t l
0 l ~ffil~ml
ho
l
...... h.
l
...... hJ
1
r--+ ht
l
A.:h x. Xo X1 X2 Xt
RNN
185
LSTMC:GRU
~m~RNN~~~~~~~~E~~~~lf~~~~k~. ~~~~M lf5
a;; < l,\fJ\9'C::~1!§lfJ\~J;i. a;;"tt/vo L: h(C:: .,t ~
• J\.tJ -)7-{ ,=:: 'Y 1ffJ\9 -:J C fiJ~T'
-)7 ';:: ~ § Ld.:: 1±:\tJ fl\ f'J ;t tci: < id. ~ a;; 9 o <:: ~ n m
~R: 9 ~ ~~ ~ 1 'J j){ Long
Short Term Memory (LSTM) c IJP-'tn ~ffij@O)f. '1 1-- '7 - -? ~ffl \.,\~ L. C. l '
~ o LSTM O)~~~iz Jl, ';:'cl:, 'I~ ~O){zib f)~ ~~~~ .Q-7'- 1-- il'1il,\T \.,\ a;; ~ o
LSTM
.. _ I
,_______, -
x- - t -
- -+,
nh-+1+ -+ .......-.--~-
-t a'l"' ~- t
tanh
t l r+
o o tanh o
X ~~
I
X ~ 1i-"+ ~
~ ~ tanh
I ,J
Xt Xt
186
~ }JlJJioJ RNN C. Seq2Seq ~7 J[,
Jmm'O) RNN l<:ff:tt G -r \,\te~~;~~ O)fp,J~1Hd:, LSTM O)m~t<: J:-::> TM)R G
£ G teo LSTM tJ{ Long Short Term Memory (:Rml~!H!JI~c1'-) 0) RJt)'(~"""C' &> .Q <::
<start> love
187
~ Attention c Transformer
iWO)-"' - ::J-ri3::1r G teSeq2Seq 'E -T Jv-rii, *~*J"IJ~ -m:RNN (Encoder)
I<:A.t.J VC3t0)·~~~1Hf11Gte _t~, -i-O)£E*i11 L.Jd~~~ ~IJO) RNN (Decoder)
~~-=> T*~*JIJ(;:~ VCI.\a:; lAe o c:: -59~ L. C: 1:, B*~C:~~tJ:cO))C
)!t.J~~il;). vr ~. \tJ:\, \ ~ ~~±-c~-=> -r :t, ~ c:: t; tJ: ~. \~~~ ~c: ~re~ c. e: tJ: <m1
-:> '<:1±*111 G T G a:; -5 tettJ, Encoder C: Decoder O)Fs, 'L.'~~O)JK r- Jlt'*- "J -7 tJ'~
GT G *\,\ -a:;g- o ..z- L.l', *~*J"IJ ~ }\jJ G*1;Z -r \,\tJ:\,\~§~~!W:t? Decoder
'c:.A-JJ 9-@ 1J5!tJ'm~2' tL * G teo -i-tLtJ' Attention{~-1:9 o EncoderO)~
£~~~1t~-r~ § 9-"' ~ OOP:ff~~1~6 tttJ:tJ' G*~O)I:I:lt.J ~ fr-5 tettJ, lllllWU~m:~
J::Jf ~ L. C: tl'l' ~ 9 * 0
6 G ';: ftili l' IJ:, Transfomer C: liP 'itL-@ 'E -T J[., tl'a § ~ ~ t1J -r \.\-a:: 9 o
Transformer IL. li Encoder-Decoder 0) ~{* ~ ¥-i-:> tdl@ ~Attention li ~ b h T
\,\ * 9t.J\ RNN li~btL T \,\*it fvo Transformerli, Self-Attention C: I!PiitL
-@ G <ilf~¥-tt;-a;:9o Self-Attentionli r il5-@*~il~, )C~!fJ O)cO)*~C:~U
The The
animal animal
dldn' t dldn' t
cross aoss
the the
street street
<st art> love because
it
because
it
was was
too too
Encoder ( 8 ~) Decoder (~~ ) wide wide
188
[""(0ELMo C. BERT
RNN t-> Elf.~§ ~~!IIC:: ~3.19 ~ ~@: C: G T , ELMo, BERT~ D'fvt.::.fv (;: !{)(
fJ _Hf*9 o tJ:d';) , ELMot-' BERT O)::gWJO)ffi*I;J:? ::'- 1
) :t.JO)T-#trPHt:Ji.ill.§. r iz
-lf ~.Af-. 1)-f-- J (;:~tJB9~~1'7-75-7J'S*l"\.,\~C:§btLT t., \*9o -t
*
-5 '~' -:J C' j,' G ~liT li: ~ U 9 :td.o
\.,\;t *9o i1t*0) 5:J'IlY:*lJH;J:, !!!~~ C: H:-11 O)XjJIE;~tJ: GT\.,\* lA.:o 9fd: bt>, 7
XllJiH;:J::-:> TEfi~ O)~~O)-~f.J{~b-:> T ~, 7.t~*.ffl.~~X.~ 9«.;/J{;/J:\.,\f.:: -r·
1
~!;:, ~ ~ ~~ - 5 - l;l:)(JW!;: ,J:: ~1ji~0)-~0)~1t:~ilEX.~ L. C: l;l:--c'~ *tt I
/
fv --c' G t.:o G f.J' G, LSTM ~ l!;f-f:ltWi'lc:: if-:> t.: ELMo I;: cl:: fJ , X llliH<: J:: -:> T ))' '5
I
~-.ffl.~~jt~L.C:~~~~fJ:fJ*Gk o -
/
7'
(f)
· BERT(Bidirectional Encoder Representations from Transformers) )'
JL-
)fLJfl i§ ~8 -t 7 Jl.-0) BERn;J: , ELMo C: 1PJ G J:: -51i:!j!~0)5:J'~~UJ!~ t±l:t.J G T :1
<n *9 o BERT I<!: RNN c· I<!: tJ: <Transformer~ if-:> T <~';) fJ, - m~i¥J li: ELMo
1)
A
b.
c1:: fJ ~flntdJ'~£~JJi~1~StL*9o fint.:5:J'IlY:ft.ffl.t.J{~snnl<fi3~§~~
W0)5.A?O)ffl~~~~~k~, ~m ~l3~ § ~~!10)~*~*fd:5.A?--c
soTA(State of the Art, ~~7.1<~) O),qUJi~Jl>?.~T <~';) IJ, ~1tt0)53ffl:IJ')i§ ~ n
l"\.,\*9o
RNNU~~¥-~1®-~A~~~~t~~~ . fi~¥-~
·~~~~¥-~~t~~~~t~~~~
189
~m1~~~c
43 7'-1-77-=/?''
tt -n.' .Qa 1~n·-t o 2oH~t: 11, :r I;~.., ~~ut 1m
%11t~~t;t, :C:ili~I='M't: )i: EI ~
~ t:s1. 'T AlphaZero cl!fl!tt.Q 7·1:1 "/7 .b.ii;:: O)aliflj~ m1. ', ~~ILH'·Ard:l~ _tiEJ
.Qft~~mm~~;::c.u~a~~ij*~~ o
~ fji!J(])ffij~ (Q 1~)
~{t~M(C:: (;:1: 6 * ~ *t.J:~ ~ O) 7 JL-:J 1) A.b.tr'tb f') *97J\ t 7-'JI,;""- A c
tT'JL;J •J- (c:: :klliJ6 tL*9 0 'E-T JL-"" - A'cl:, r EI5J'7fii:7J' n -c L\ ~ ~r!!Hc::
c!BL \ Tfj'IJJ :a; JU(-::> t.: c 2', ~~1J' c 0) J: -5 (;: ~11:; lh c 0) J: -5 f.J:¥&!1ffl:a:f~ S tL
~lJ' J :t,r='.lg~tcl:.l'1::YiJJ:t,r)J<!::ri:: l_, *9 o -15, 'E'TJL- 7 1) - C'(cl:f31i±J% (;:~ \,\(""
~7J[,7 1 )- ~7J[,I'{-.A
i: i:
ffltii@:r<-.A + ~ + ~
J5m&~1t; Q~~ ~-T'J [, ~ ~-T'J[,I<J:
(J5mr<-.::zl (filli{@:r<-.A) ~~ ~~
~7J[,I'{-.A
~"cyG'"'m' ~ ~ ~ w~"-''
l
(1:J11!''i!~) DQN Alpha
~fJ:l, \ DDPG Zero
A2C/A3C C51 12A
TD3
PPO QR-DQN MBMF
SAC
TRPO HER MBVE
tl:l91! : https://splnningup.openai.com/en/latest/spinningup/ri_intro2.html
190
f( Q~~c!:: DQN
0 ~ij lcl:{iffif~r.:::- .AOY(J5~"C, r£15~~~1<::}.) \,\ T (16 ~~jti.J~l&~;:. t. tN:!.
n< S\,\J:\,\O)fJ'J t_\,\-':)~ji!JO){jffif~~'¥2~~T\,\~*9o 91d:b~, (~fi,ffi,
ffj}J) -+ff!JJ{jffif~O)M/itfi~t~~*i'~T\,\< <:.t.lt:tJ:i'J*9o ~O)~O)"Y.AO)
~~c1:~1m x ffi!JO)!/&~~ ~ tc:.. :t O)-c9tJ~, ~1m~qJ-i!JO)!/&tJ~~ ~tnlt"Y .AO)~
~ ~ ;t ~ tc It C" tJ. < , ~ iK <!'!' iK tJ. I 5I;:: tf tJ. ~ n T \,\ iK 9 o -"f 0) 1 -::J tf
Experience Replay -c9 o ~'Jlb, q=y!JJilfjj~O)~:*:!i\t $[Hit~~ ~c~ ~ T;}.) ~, -"f 0) 7''
1
~-~~M:tJ'¥2~~~~9Z:.C~C'~iK9o I
-:!
~~~~ - b~ooN~•m~tt~•a, ~-~~~~~-bO)~~~, fi 7
I
i!J~~- b·0)~0)~~~~~9~~MJit;~iJ:;9o iKk, f.yr-'7-~~~~ -
/
~O)wggftU<::~ntcCNN~:!*m ~ iK9 o ~~It:, Atari 2600t.ll¥1cfn~ ~~~-7' ?'
(J)
bO)-$-z>lct:, DON~ffl\,\fc~~-c A.rl39~~~ ~tc:...A :J 7~l&~;:. t.tJ~biJ'-::> 7
J[,
"""[\,\*9o :1
I)
7..'
Q~~H::=;:;_- 5Jv.:f.~ 1--'J-? L.
!..-~:-~···- -~;~~;;~l~if;~E~~~J
ti:~~IKD +1 +2 - 1 o
+2 0 +1 -2
::?-~
ti:ltll® -1 +1 0 -2 ·:;'[:
~- =
~~
'7:!.
-2 0 +1 +1 I I
?7 fjiJJ\3tO)t\:l!!i"\"'~Ml ~
1:' )[, c.
t> 1c:.., s~~ fJ'tJJ~
z ~'[:~ :I:J -c:'~~J:. ? fL. E -greedy
~ J\7;>{ - 9~i!1lli 5!t~c:~m
l,I""C~fi
,.. ... t,-:> td'Jth
f;t.J'tl"t"l. l~t\:l!!ii.Jf ~~~c:..~-:5
fj!IJ\3t1L. ~rdlt1.lf (,\""("~'JI!Jg
rrl1Ji3tlc~ft9 ~
~;tStl~ ~
191
Q ~~~ ,;:!:, r <: O)frmt.J=a: (:: ~ (:: c n < s \, \j[ffif~tJ~d5.@ O):fJ'J C: \, \-5 fJ'!h®if~
=a:~~ ul \, \~a:; 9 o T ul , fj-Jh.:£1* ( I - Y I / 1-- ) 'cf.:-rO)fj-mt.Jj[ffif~=a: ~ T,
fj-liJ =a: ~:tR u T \,\ ~ 3: 9 o <: 0) C: ~ 0) fj-mt.J~iR. 0) 15'$ C: u T , £ -greedy i~ N
f.J'id: \, \(f)(;:!:~~ C: ';:l: \,\;'{.a:: it lv.:ld.o t.:: 3: '<:: (;:J:ffifi1~t.J'~:k""{'tJ: \, \fj-ii.J=a: 7 $' 7 :;<
'<::~,3\~\~tJ'd5~, C \,\-'50)(;1:., L".O)~ .:SfJ:<: C: ~ 9 0
£ - greed y;~
£ 1.l~1c'!:! -r 'f:!~c
~~<7)~$1.J\j!!\ id:~ <
192
~~. fi~~~~m~~~Q~-~~R~~~~~~~~~ftG*~o~•
~~$~;:tf}ti.J~100:l' ~;:l::fd: <, <15 ~~1i1H<:: cf3 \,\ T r c 0) J: -5 fd:~'JtiJ~ c 0) < S \,\
O)lii¥l'~-"' ~tJ'J ~:>l<~*~o f}J}J~;:tlii¥!<::J:-::>T5R*~ (}il;l<::ii:i.~Gf'J!J.J~
~ ~b !tc·(;:tt.;:: \, \) 0)"7:, c -greedy):f~ .@lffl~ ~£,~1J~S I) *ii luo ~f00:-"'
~0)Q*B-c~.~l)-5~fi~O)-~~}ll;~3<~~~-5*<*W-c~*tt!uo
~~T.O*B~fi~~lii¥~~~~~~~~l'~*iiluo ~hSO)~m~M
5R~ ~ tc.~(;::~;:t , ~--«- ~0)1J'$.~ffl\,\*~ o 1J·-«- ~0):1J.1;JDG$0)/:il
}](;:!::, ~fi!:!J~f'J-:Jlii~l'~o ~jW;;/){_A}Jl', T-{-/= .l -"7} [;-f. •y 1--'7 -
? !;:t~fjtiJ~ 1'J -5lii¥~ lli1J~ ~~~I<:: id: I)*~ o ~-1\J~5:f0) 1-\;;~I¥JtJ? J[; 7
::J' 1
) .::Z:b REINFORCEL'l;:l::*9', ~'J!h~ < I)~ GT, t!\!K~ · 1'Jt1J · ~~O)T'- 7''
1
5 ~!&~ G *~ o 7 - :9 ~!&~ Gtc. S, ~\,\~Mj~{~~ ~~I<:: -::>t.;::1J'-::> td'JtiJ I
-;
O)Pi¥~J'iiiJ < G, ~\,\~~~f~~ ~ ~ (;:: -:>fd:1J'-::> tcfi~O)lii¥~1~< G""{'"\,\~ 7
* ~ o ~JII*lT' - :9 ~*:W G T \,\~FJJI;:I::tf:l1J~*1J'1'~~~;::fd: I) ~~\,\{)0)0),
I
-
/
~;E G tc.lli1J*"i5*~f~~ * 7:0)~F"'9l;t~§ <, -ttL1J'1Jm1;J!E5:fO)~pfT~ \, \~ * 7'
I])
~o-:1J, *W~3<0)T'-5' ~~~~~~~~~ffi"7:~o 7'
) [.,
:J'
i)
7.'
b.
~i~ ~
~lt!lt>~
;ijl.,\¥ft~l;::-::>f.j:1J{-::Jt:
;G:1t;9 .Q
~~L~(J)T'- 5'
l fi~(J)~~~~<.
ffl:\,\fifi~~H;::-::>f.!:t>f-::Jt.::
fi!tJ(J)~~ ~f!l:<9.Q
fOJ[Q]-t:,friJ.J{t< ~J~G""C.
~A. tcf'JII.JI])fli¥ c.: ~Mil {t ~x~9 .Q
fji!J(J)-T'-5'
llih~nt:
~~1;::
i.Jt:th-c
~=rl!l~JHtR
t¥ft~(J)-T'- 5'
193
Actor-Critic
Actor-Critic ,;t, flffif~ ""'--A(:: 1Jm""-- A O) =_F)!{f; *J3.Qij.-@lbii a:: 9 o tct: c!B,
Actor-Critic 'i= .:1. - 7 J'-'* 'Y 1-- '7- ? 'S: £\9u :f; ffl \,\ ~!B<~'i&i fJ *it lvtJ\
c:: c:: -z- 'i= .2 - 5 J'-'* 'Y r- '7 - ? {f; ffl\,\fc~J~mBfl u *9 o
1Jffi="".- A 0) Actor ~ ,;t, ~f!j'S: .A1:J (:: Vt ~1'J!/JO)~¥'S: tl:l:t.J 9 ~ = .:1. -
5 J'-' * 'Y f. '7 - ? {f;, flffi{il[ "". -A 0) Critic~ ';t ~;i\ !Jj {f; A1:J (:: Vt ~~{iffi{~ ( \, '
a:; -rO) ~;i\Jm lc::&i .QO)tJ\ cntc 't~:f'Utct:O)fl') {f;ti:l:t.J 9 J'-'* 'Y r- '7 -
.Q = .2 - 5
? 'S:ii.JJ-*9 o Critidi~!mflffif~{f;#t±:lu *9 o ActorO)rrltJI<:J:? -r ~X. t:.n
tdfHMt!(::, Criticfl~~t±:lut.::~~{iffi{@"O)•t~U&t,f;:f.J(::'<::, = .:L- 7 1'-'*'Y 1--'7-
? 0) 5 {f; ~ *ff L.. T \,\ 2' a:; 9 o A3C (asynchronous advantage Actor-
J \ 5 ;!.. -
Critic), A2C {advantage Actor-Critic) (:: U¥ l<!n ~ =F $ c li C:: 0) Actor-Critic 0) 7 J'-'
=r 1J /C.b 'S: :stt?IJ cWlfl'9 c:: ,~:::I<: J:? -r ~1§1JJJ¥{f; l'i'J !V)T ~.,\a:; 9 o
A2C/A3C(J)
-(;1. - :/
llti9U 91H!{!;~!Jl
(A2C lct/Ell'!ll A3C lct?FIEJ!'!Il)
194
<:. <:. *-c -i~i"J, ~9Ht~~(J)~*~"Fiv -c~ * LdctA !m~(J)il5-Q)dct.~9Ht
"F ~ (J) :; 2 :Ll_.,- :; 3 :.; ffl /7 'Y !-- 7 :>t -A rOpenAI GymJ '<::: 7 ? -tz .A v -r
J}. -@ t: J: \, \ -c [_; J:. -5 0 2} ~ ~ :f- .::z.. .)( :.; r- t [_; T ~ **
~ tJ: T .::z.. - r- 1
) 7 ) [_, tf:t~
~~ n T \, \-@ (7) ·-c:\ ~il*,<::I:!Jt.J' l._; T Jf~ t 5$1t~~(J)liD B ~ ;lyi d:: <bf.J' fJ *9 o
* tdi'i.J /7 'Y !-- 7 :>t - A'<::: ,ct., ~ ft "f'~ ~ Ff.l \,\ TB'~~ £i (J)ffl__t't::~ S ii-@
~ - A~S, 7 D ~?8L_;(J)J:-5~ ~-~-A~7~~9-Q<:.t~"C~ , .[_;
Ch-~t.J{SS$1t~W~1*~-c~ *9 o El ff(J)~ - .L..~f!=.Q <:. t: ~ PJIJgtJ:(J)"C, ~
~~fllvtc S, if lJ'2}~ ~ ::f .::z.. .)(:.; !-- tJ: c ~~~'t::fj~!fli l._; T Jf T <tc ~ \, \o
7
OpenA I Gym
=j'
Spacelnvader vO 1
I
"""1
7
I
-
/
'}'
(])
7
)[.,
:J
1)
:X
b.
195
44
:>t- 1- I / ::J - 5i (Autoencoder) !1, A.1J7- 9 C: :±:1J7'- 9 iiflil 15 t:t.t.Q J::? t:~
<
B~it.Q=~-7JL--*·;; t-'7-?~9 o ll!~t.l: l- ;.;.-r:·"tti, 7-90)iXj[;i1flj)~O)I~
;t- t- I / ::J- $'.,cl:, ~)Cgij)tJ: u~~0)= ~ -7 JL-*- 'Y 1--- '7 - ? l'9 o ;;t- 1---
I / ::J - -$7. 0)7\:~ fJ:W~ icl:, r.A:h G t.:T'--7 C: ~ L>r--7 t.J':±l:h ~ h.QJ C: \.. \
7 =~ -7 JL-f. ·y r- '7 - ? ~1'f.QO)t.J'§l~l'65-Q <:. e: l' 9 o ~m'l'65_n,t, A.
:7J G t.:::T' - -7 tJ'-t-0) a:; a:; :±l:h ~ n.Q ct -3 fJ:.::CT' J!, lcl:, tO) a:; a:;;fljffl G T t>fillif~
~65~a=;tt~~, ;;t-I--- I /::J - 7-c'~tO) r~~ ~ J ~~ §l Ga=;9o
;;t- !---I/ ::J --$7·0) = ~ - 7 J[.,f. 'Y !--- '7 -? ,cl:, A:±J:t.JJI ct ~ tJ ./ - ~ O)j>
tJ:\, \~r..,~ ~~-s *9 0 .J- ~ tJ'~dJ:\, \ e: ~., \-3 <:. e: 'c~:~m --r ~ .Q~~:S:tJ'1-'tJ:
\,\ (:: \.. \ -3 L. (:: 1:9 o i?JJ (:: G T, .A:±JtJ /! (:: 1/! 0) ~ rl3~/! f.J' G fd: .Q ;;t- 1--- I / ::J-
7~~ ;t.Q t:, T~O) ct -3 It: tJ: ~ 3::9 o <:. O)"ET' Jt,tJ'A.:h t: ~ G :±l:h ~9 .Q ct
-3 1<:: ~~ 9 .Q C ~!<:: lei:, L. O)r:j:lri3~J!t.J'i rit{ !---)[., f. 'Y -'/ J (:: fd: -:J T'~~~ tO) g:;
a:;{L;;t.Q L. (:: lcl:l'~ a=;tt ~ 0
:;t- I--IY:J-9'0)tle~
Atl/1 ~5ft (.I /:::J - ~)
x,
X2
X3
X4
Xs
X6
196
·~$& ~ t (J) a;; a;; 1~ ;t. ':?J hfJ: L\C. fJ: ~ C., r !:j:l r"m! 1.J{~!ji -c ~ ~ ·t~~iiiJ C. L\?
~J*-{Jt.J{j:: a:: n~ <::: c. 1c 1d: IJ a:: 9 o -t- (J)'i=l-c'E"T JL-Ii, ld: ~"" <t±:ltJ~ tc.A:t.Jji
(J)"T-::Ytffln~n~ J::-:;, I<='¥~~1'T L'*9 0 § L\~;t.nt<f, L\n't<=IPJ ~7'
::Y ~~'fJ:L\f~~--c~!Ji9 ~t.J,~'¥~9 ~O)-c9 o L. htci:~Jzn~U5Jilt (Section32
*~) ~=:1-5JL-*'>' f-.'7-?cfr?TL\~CL\;t.a;;9o -:>a;; I'), ;f-f-.I
::,; :J -::Y·tc~:~Jzn~U;mt(J) :r JL-:r IJ A.b. c. vctUffl9 ~ <::: ctJ{C'~ ~ (J)c9 0 <:: (J)
J:? 1<: GTf~ 6h~ ~f-. JL-:f. '>'? c (J):8- .J- ~ 0)7'- :$7 0) L. t ~, ;t:t±~li C.
QlJLU a;; 9 o ld:d'a J\tl I! n' 6 ~ f-. JL-:f. '>'?a;; -c (J)$)J\l' 1;:1::, .J- t-:' 1J'ifilt~' G T L\
<k~7' - ::Y~ff-~na::9o L. (J)$~ (J)~~O)L.c~,~~~( I/~-~) 7
t IJ!¥U a::9 o &J;J tclt{ f-. JL-* '>' ? D' .; t±:ltJI! a;; -r:O)fl'~)J\c tel:, ;gi£~!#)(1J' 6 7C =T
-1
(J)7'-::Y1J'~n~na::9o L.0)$5J\O)~~(J)<::t~, m~11:: (7-'~- t-:·) t!J!¥ I
/
lfa::9o L.(J)J::-:J~I/:J - ~C T:J- ~~~~~L.C:-c, 8~-r:fi~ld:I/ 7
I
:J- ~ /J$~ ~~ G T L\ <)f~H¥1.J\ .:t - f-. I / :J -:)7' ( 8 C.f'Ji5-1t;~) t L\? -
/
J7 )[,. :J•I) A_b_;g (J) ffi* -c9 o 7'
(J)
7
)~
-=~·
1)
:;z·
b.
'ta
f\1'5-{1:;~ (I / ::J-9')
197
~ -~ I~~-¥~ . ~~ ~•~~*~~ff 3 k ~~~*~* ~~a~ffb
:h,""(\,\*90
CAE (Convolutional Autoencoder) 1-J:. i®1~0)*~ I<:: )I utc ~ - ~I~~
$'.l'9o :::c77-J6c77-=.:z.- 5 J[., .f.'Y ~ '7 - ? (CN N) l;:l:i®1~0) ¥-j~~:fJE;{. ~ O)IC:::
~ l.J""( \,\ ~ <::: ~iJ {~S tL ""( \, \*gil\ ~- ~ I ~ ~ - $'. 1<:: dS\, \ T =t ~tL I;t [DJ G
:*.:~9~/! ) l'-/JX~tL""(\,\*9 0
DAE (Denoising Autoencoder) 1;:1:, J't O) 'T'- ?7 1<:: / -1 ~;( ~ JJD ;t t.:: =t 0) ~ J\
T.;~ L-. / -1 .:;z:- ~mz~ ~ ~td:iJ{67"- ?7~~!Ji.uT\,\ ~ * 9 o ~ * 0)~ - ~ I
1152 1152
7X7X64 ' '
+
3X3X128;
'
.......
.
10 \3X3X128
.....
i!~il\~1!! ~ : 7 ':1 7
~~il\~1! 2 ' : +f/7
, ! 'J /?"II
1 ;};::]t ~W:
7 "; 7
~~U1t tf!ltf:l +f / 7
') /?"Ie 7 •:;7
~ft« : https://link.springer.com/chapter/10.1007/978-3-319·70096.0_39 +f /7 ') /?"II!!
198
VAE (Variational Autoencoder)
~h*~~ftGk~-~I~~-7~. A~~-~~~G~-~~ili~~~
-~~.~E~~OO~~ffn~hkMW0~~~~~~-iliG*~· ~GT.
~0'¥~ ~ 5:1'-~~t!Jffl GT~Fs9/i0!ffTG l\¥-JW~ - ~ :'!f:1"F ~. *IT Gl\7- ~ 0
lli~~§m~0c~. k~~~. AM0~~~87-~:'!f:A~~~~ . $00/i
0)¥-JW ~ GT ~:ft.O)IJZ.t5} ~ ~:ft.01i'X: S ';f ~ ~ 15-tJ'~t±l ~ h-8 tc61J, ~n:'!f: :t ~
i<: ~ * cl5' *tJ:~:ft.0~1~~ili:l:r9 -8 ~ ~ tJ'c~ ~ . ~WM-~ ~ ~ btJ' ~ ~~\,\
~t>Gh"*ttlv.~~~~E:'if:~?T~~uk~-~~-8~. ~*~*~~m 7
1J' S Jil.tc/ffl0~{~0~~~;:ptr}J G T l \-8 ~ ~ fJ'bfJ' IJ *9. 7"
1"
I
VAE /
7
I
~'ij';O);;f - f' 1\
I/:J - 9' X z X /
7'
!])
7
)[,
::J
f.l ~ 1\
1)
VAE X z X :::Z'
o f b.
51~
(a lct.:iEUil::lct.t~iJiiiilll!iPt:Fs9}
~-~I~~-§~~~~-~fi~~t~T~~
VAE~~k~¥-~~~-~fi~~t~T~~
199
GAN (iil~~~f.il
45 *':I ~'7-?)
GAN~. ~~- ~~- =~ ~ff~-~~~~~~O~HT~<r~dJ~T~~t •
WE 1..-t.: . OOHf.Eltt:l ~7 Jv::j· 1J ;~:A T'9 o .l!!iH: t;t ~I. 'i!i~ ~1:.d l.d.: IJ . i!i1t ~p;]~
~ r .:EG51~ J Gf.:IJ'99.:tb"T~*'9 o
GAN (i'll!r:X;f~~-* ·;.t t-?- ?) 1<1:. ~~i!ii'J: V'1~~0)? JL- ::::i 1J .A' b.T9 o 7-
~~*~9~~tT.~~~~~~~ ~5 fJ:~·i'J:e0)7- ~~~~~~*9o
~ 0)~~1.J 1<1:. 1tt * :::J :Y 1::' .:1.- ~ 7f¥-it.::i'J: \,\ C: ~ n T ~ t.:: r~U.@tl:J l<::lli <. 3::
t.::)R.ffltt~~\,\t.:: 66. ~tiOC*~ · 71-77 -= :Y7~J\.0)~'!1T~5il3 ~m
61)'"[\,\~y Jl;:::J. 1
) AA \!9 0
GAN l;:l:"f ~O) J:: -'51<::. 2 "J 0) = .::t - 7 JL-* ·;; 1-- '7-? tf·"J tJ:.jJ{ -:J T \,\ ~ J:: -'5
tJ. ~ ~ ~ ~ T \,\ *9 o C: 0) 2 "J 1<1: ~ n ~ tL ~I£ fi (Generator) t. P.&l111J fi
(Discriminator) t.ll~HJtL*9 o GAN -JJ~ff:~ ~tJ.\,\7 - ~ ~~~9 ~:t:n*l<l: ~
~~~ra~~~~~~- J c. ra~~ ~- <~•J~kC:~StL*9o~~
•= ~JJX~I<l:~~'Hc::~- 7J'ntJ. l \J:: -'51<:: J:: fJ ~VJtJ.atL~ f'F 3 -'5 C: ~. 1Jg=
~5l iJ~I<l::$:~ 0)d'3 ;fLt.1f.HL~ 5 * <~MHt ~ J:: -'51<::~ 3::9 o Mil\.g.\,\~ < fJ ~
ttiJ. -~iH<l: ~~ f) tJ. <:$:~t1 1<::ilil \a;fL~ 1'F~T ~ ~ J:: -'51<:: tJ. -:J T \,\ ~ ~ ~ J::
-'So C: 0)~\, \.g.\, \IC:: ~t.:: ~ O)]f. GAN O)*~tJ.O)-z'9 o
I
GAN lcf:~@~ e ll~ ?
(ID
-T- 9-tz'/ t- *~Q)t:>lir
200
GAN:fJ{"_F~~~GT1'J7Tl-\~;:c[;:l:, $~0) r ~~~ J c rg;_l£ J C'il5~c
\..\X.*9a ;:;:c-O)t~~cl;:t , t.::cX.l~IT!l.J®.O)J:-:JtJ:~~O)T' - 5~, -ES-8- \..\
?!Bel,\ 7 tdffi~l¥lfd::r'-5 rc:::~tt.!!9 ~;: c c-9 a - ::t:Jc-:t/JXc r;:~:, tffi~f8tJ:
c r;:~: \.,\X., 1:/JX~t;:t1PJO) J\tJ :t tJ: G rc:-T-5 ~1:/JX-c- 2 ~ b rtc- r;:~:iJ5 0 *tt:
Iva tJ:if'fJ:S , 1:/JX~O)f;igRBI<::~1t:tJ'tJ:rtniJ:', ~7:J~n~7'- 5l<:::t~H.::~
1t:tJ{fJ: \.. \ t.:: 69 T'9 o G t.::tf 7 T, GAN 0)".)2~ ~ 11' -5 ~~, 1:/JX~[C::: [;:!: /-{ _;:{~ 7
J\tJ G *9 a ;:,n[;:t7 ::.;5"bfJ:1~~J\tJ9 ~;: c ""?.\ ~ * ~ *tJ:J\5 -YO)r'- T-'
1
5~1:/JX~tt:~k69C'9o *k , "j2~~~0)1;::/JX~C'~kfd::T'-5~j:/JXL.,k I
/
l, \:t~&rc::: r;:~:, / -1 ;;z:_--c, r;:~:tJ: <Ji:tt~~~ J\tJ 9 ~;: c :t c- 2 * 9 0 J\tJ 9 ~;! 7
I
:tt~~~m~9~c , :t!JX9~-T-50)pg~~il5~~mm~c-2'*9o -
/
:J'
(})
7
)[.,
=r
IJ
/.'
L_
201
• ~:(£ IJf.j:\,\ 7-$'0) ~.6.)4
GAN t: l;t ~:(:E ~ t,J.l- \ 7'- -7 t,r ±PX:t: 2' a:; 9 o tc. C. ;t (;fT 0)'\9U t: ,;~:, ~1£ ~
· 7-?'I!IE'i!tO);JiW
GAN t:(;J:~~ ~ tc. 7'--7 O)~tJ:t,EjE ~ 512' ~ -cWftc.t,J.=J'--7 t,f:~pj(;9 ~ ~
202
'----r--'
smiling
woman
-
'----r--'
neutral
woman
+
'----r--'
neutral
man
7
. )(Jl7'- $' O))t-'¥19 <: l, T
1'
GAN ,cl:, El~~~~:£!7 J[.., :J. 1) A.b. C:*J3.J7.-8'btt~ <: C: "\:', !J*)5(,1,t)<:~l' I
""1
~~~~~~ \:~h1,t~-~~Z: ~Z:(::~~~*~o kC:~~ -~~~-~ 7
I
~'ifX~\:m:iE~ ~ C: ~h,<=5B-:J tc~87,t 1:.P.)(;~ ~, C: ~,, -:J tc <: C: tJ{PJ~~-c~ a -
/
7'
(f)
<: ~ J:? ,;:: , GAN 'cl: ~ * ~ * t~7J'!ff\:jS'jt., \/\7 ;;t- 'X/ A 1,t~j:!l G * ~tJ\ 7
)[,
~m~~k~T~~~~~*~o ~~1~C:G T, •w~~~~m~~~~* ::r
I)
~ o GAN 'cl: 2 ~~ .=. .2 - 7 J[..,.::?- 'Y 1'-. '7 - -7 jJ{Ii_t.,\~~ ~1,i: f.lE G Tl,\~ C: l,\?11 :;:,·
.1.:..
~_t, ~~J\'7-J\7 / AtJ{~~C: f.t.?.JtcttJ\:~ o c t5 6tJ'~1"t~gtJ{f~1lz:J®2
~~-8'~1:.~M~MB~~~-~~P.)(;Gk~, ~B~~~tt~J:~T~~P.)(;~
h~7 - $7tJ{{,jibTG*? (~- FNifii) t~-8-f.J{~~*~ o <:?t.,,~ tct~ -8',
~tL~h~.=. .2-5 )[..,.::?- •;; r- '7--7 ~J\7 ..)( -$71,t7 .2 -.=./"/. [.;, J\ 7 /A
~~tlJ'<=~ ~~~~tJ{~ ~ *~0
203
46
i!if~HDI:jlt:fiiitJ\':!j:? -r~., 7.l n·~~~9 7.lajlf:j~~1*~:±: t ~~-' *9 o ;::. ;::. -z>(;t~1*
~:±:7 Jvj.l) :.K .L.Q))tt1f;Q))jtt:f1. t fifJi0)7 Jt-j'l) :::<' .l...Q)~~t: '"?l- '"trutBA 1_, *9 o
l
~i*~l::l:l t lei:, @i{~O)~iJ,S'M';E0)4~f;js:0)'51'\.) ~ ~-rO) {iL~~~~ tl:l9 .Q L. t
~9o -~fl'%:1cl:, @j~O)~(<:"f~O)J:?tJ r,{rJ/7'1' / ?' ;t-'·_;,?.7- J (::\,\
? ~%0)~-w.J 0 ~~~JX u, -r O)"P t<=a-*n.Q~~'f*0)-'71'\.JL-~ tl:lt.J9 .Q, t ~., \ ?
5'.A?~fj'l,\*go ·
204
~i*~tiH~~O)i1!~CD (sliding windowmethod+HOG ~fl&:)
-~-~~~.r~~~~ § ~~~J£*~~~~~-~~~~~. ~-~5
~J~~~milu~ ~ 2 -;J(J)/y .::z.? £r=r-s£,~1.J{d51J *~ o --tn.:rn. ~a*~~ a::
1! a:: tJ. 7 J[.,::f 1) A'b1.l'~~ ~ n -r d31J. 1-t~iHl'9tJ. =t (f)£~ ~ tc:?~Hf-:Y-:Y, JitiJ':
0) iMn £ ~1HJr.u T \..'~a=;~ o
HOG~ata+SVM
i!ID~(J)~~j~j~{;:~ L., l
~*~' aotJ:-tt1 .A'(J)
?1/~?t.f:A. 7 1~~1i.
-=f(J)$ I;:~-!*:IJ~'65 ~ D' :a:!¥1J:iE
205
~f*~~~f,fljO)~~@ (region proposal method + CNN)
· region proposal method + CNN
region proposal method~;!:, sliding window method l'~;Jf~;lf~::*:: ~L. t.i. ::>
T t_, * ·:dc&:~ n'S, &> Sn' G~ rtii11*7J~d5 f) -t-? J tJ:~~ (region) 'if 7 Jl.- ::1
1
) ;(ld<=m~ (propose) ~ tt~ 7 JL- ::1 1) ;(b. t t_, T~~ L., * L., teo ti111*7J~d5
tc, 7~J[.,'if:JiJ!U9 ~ 7 JL- ::1 1) ;(b. :t, 'T 1 -77-= Y77 J[.,::f 1) ;(b,O) -
li'"Z' 65 ~~Jj.~Jf = .::1- 7 J[., .:?- 'Y f-. '7- -:7 (CNN) ;/Jq<IJFf.l ~ h ~ J:: ·':.dL. tJ: fJ ,
'tiiJ{;t~t±:l~~ ~cl::;k~ <rP:JJ:.[_, *I_, teo
L., n' L., Fp~m~ :t 65 f)* L., teo -t- :t -t- :t r 'ti~Jj/.js:;/J{il1) IJ -t- -3 J 1J' c? 1J'~ -'FIJI!JT9
~ *~ ~ ;/J{ t L: *'"Z' iij <tJ: \; \ <:: t '"Z' 9 o *te, region proposal method J§ll* :t \; \
*~-t-nf.i.fJO)~•~'if~~t u, m~9 ~ ~amc.u-c ~•~ n~<=t~t.i.
IJ a:; 9 o f-'e3lH!kJfJ: 7 )[., ::::J. 1) ;(b. t 1_, T , R-CNN, Fast R-CNN t.i. c ;/J{if5 IJ *9 o
CNN
206
• end-to-end
~ffi<::M~9 ~ O) lcJ: end-to-end --c' 9 o Jli~(J)!jo/.Jf*~tl:l? Jt...:::J'') .Ab.lcl:, 51.
EJm~~:lE e: 7/\\. J t...:H£5~~0) 5' .:::z? ~ 1 -=> 0) -= ~ - 7 ; t...~ '/' "'7 -? --c~=r-3 :s 0)
1f.:Ej]jtc t.J.? -c \,' * 9 o ~* --c' lcl:@l~ 1 -::> I<: :X1 G -c tc. <~ /vO)VJ I) tB:~ ~ ~'f\, ,,
..Z. O)f~l<:: 7 « J t...t!E5~~~ l_, -c \,' * G tc. tJ\ <::._ 0) 7 Jt.. :::J' ') A. b. l' lcl:i@~ ~ 1 -::> J....7J
9 ~tUfl'~i?Jf*~tf:ltJ<PJ~~ C: t.J,I) * G tc. o L_ tl,lcl:, -* 1<= 2 -::>0)? J[.,:::J' 1) .Ab.1f·
1J t<::J.i,? fc. fc tf --c' tcJ: it!> IJ * i± fvo )i. § ~Ji±~),R:li:: C 7 1"\.J [., :jf:E;,~~ ~ lJ' C-::> f.J, fJ\ I)
0);'([1~ c l_, -c-= ~ -7 )[., ~ '/' "'7 - ? --c'~J00:1t 9 ~ ;: t tJ'l' ~ ~ tc.tstJ, J: I)~
Jil' ~'l'i~~tJ: !Io/.J1*~tl:l ~ ~!Jl9 Q;: c tic·~ Q O) --c'9 o 1-t~~t.J.? Jt...:::J' ') 7..'b. 7
c l_, T , Faster R-CNN, YOLO, SSD t.J, c tJ'i:t!> I) 9 o * T-'
1
I
/
z:._ z: *--c~tlf*~tl:l? Jt.. :::J''J ;;z: b. O) J.i:?P:0)5Jitn~*-Bfl' u-c ~ * u tc.tJ\ ~~9 7
I
~~l<::lcJ: cO)? Jt...::f ') .A b.~fiJ ffl 9~ tJ,~5.R:iE9~~'~tJ<i:t!> I) *9o @end-
to-end fJ':t? c :tiT l_, <, *tc.~ <0)5' .:::Z -7 1<::: <!;)\,' T~ \, \1'ifjg~~t!l!9 ~ c ~
X.~ tc. (Sf), ~:<f;:BkJ I<:: lcl: end-to-end It: ~9 ~? )[., ::f 1) .A b. ~f1Jffl9 ~ c J: \, \ --c'
ud:'3o
..Z.O) l~tJ\ end-to-end O)f-t~~ ld:? Jt... ::f ').A b. c l_, -c, ~~0) 3 -=>tJ'i:t!> I) a::
9o -~~<::~tlf*~ tl:lt<::d;)tt~~$17JIJ~J.tc ;'([1~Jii.ttcl: 1-- [.... - t-:;t70)~H'd<::i:t!>~
tc.tstJ , )}<tstJ-c 1, ' ~'l'i~§fJ' S ? Jt...:::J' ') .A b. ~JH:JR9 ~;: *
c fJ'~ u 1., ' c §§ .:t a:: 9 o
207
~'l*~t±:l7 Jta·'J .:;(.L.\0)~1!\i'lc::::f!Jffl9 ~T'-5-t ·;; t-- I;J:, 1o/Jfi.ti:0)5""-J~Ic::::1.Jo
;t <: J '\ ') / T'-( /?'It{ •;;? .A O)m¥&tJ'&:'~ C:: fJ: ~f.:: (\f), @lf§t~fi~itd: c C:: ..i:t""- <:
T'-5 iz 'Y 1-- f'F.IJX0) ~1'iiJtJ~;k~ \,\ C \, \jt *9 o ~_q fci:::iE*t-'Brffi.ti:tJ 1 6~P-f~tf:l
(c:::::t.tr,t u t.:: 7-5 -t ·;; t-- tJ'~ml <:! n -c \, '~ t.::6fJ, :r J~ :::r 'J .:;(.b.0) 111m~~.,c i;J:
liD a-z- ·:>tJ: :s 0) ;;r fU mu -r 017- ~ e: J:: ~, \ -r u J; :so
:t :YjJiE; G T <IS IJ, ~~~1-\:0)~{;f~ t±:l 7 J~ :f 'J .:;(h. It:: :t f !J ffl C' ~ *9o T~:tt:
• Cityscapes Dataset
~J~-t7.::z. · ""-/"J~0)7.5 / r:-c·1'f~td: r:-1'Y0)5.-1 h.5 -6i<::J:: 0m1~
<:! n -c \, \~ §itJJ~,~FF.J0)7 -5 -~z ·;; r- -r9 0 ~~ l<=oo9=11r !j[-r;;E IJ mz.1~ <:! nt.::
7-5-r, <::!i6:Siz7~/~ - ~ :3 / ~.::Z.? Ic:::::t.t!iEiu<:t,\*9 o T ~:tJ(;J: ,
208
8!i!
*G~3o~~~:tD~5~Y~ ~ ~~S7
1.1- b. r:J-?, *r.:~~~t~::J:::; 1::: .:z. -'90)J\-
0
'YO)::Z~'Y?*c~~mG*9o
AI~ft~7o ?'? ~ /?''(~
47 ~~t~±~~~g
~o ~ ~~ ~~~m u. A~Y ~ ~~~ - ~~M~~ •~~ s ~~~ ~~ ~~T~o
A~ ~ •~ Y~• · ~~~~~~w~~~~~= - ~ o ~ ~ ~ ~ ~~~ ~ * ~· ~ c
~ ~ .b.~Ei fl':l.l!Jf'J:JJtlC· t t:W~ fJ * ~.
7-1:/7 1
) t I;:J:, 70 7 7 ~ :/7~9~~~~(;::fiJ F!'l9~::J - r:t.J~/~';1
A.Im!m7-1:/ Q"-~:/72" :h. -~ ~-t 6 -:>"C~~~ r311~mJ <7)J::?1d:'t<7)l' 9 . 7
7 1) O)JE~fjt -( :/7 1.J~fJ:~ \ t £·~1d: 70 ?"71di:-tJ·6~1.J·fJ:(t:hl<l:1d:G 9. 1'1=~
1)
210
~...tO)mJ.?: ~ Rl!i* x_ t.:..t -r- a; 9IUI. fJ _H:f ~ 0) l<l:, Python -r-9 o Python l<l:,
f~~~t1!ff.J0)/ 0 ~·7 ~ /?'~§g(: GT~f;jljfiJf~?J'!1-c"~ <fiJff.l~ h T\,1~ ~
~-c-9 o ~c!5 ~ 7o ~·7 ~ /~·~§BO) r:\=l <:'.:t, <:: nt.: t-tm"F~n{a:rmc::~f~9
~ IC::J@ G t.:~*~ ~ <~-:J ~ §~H<l: la:il' I<:: c!5 fJ a; it Iv a ~ 0)¥-J~ C: G T l<l:~~O) ,9,
n~:~:!Hf s n *9 o
. AI~fjg71' 7'7 1
) O);'f~
~t•m 7-17.7 •) tJ{fFilX ~ n T <~B fJ , J...I?;o~Jg7 -17" 7 ') .:t * tc.:!E~ G T ~,'
a:;9o
8
· ~/:1Jt,t.i:3t;t-e~U~9\.'
Python lcl:, ~ ~9 <:,_, / /J[..,tJ:. ~§g~ ElmG Tim~~ na:; G teo :J- f.: 0)
~~~~ <, a:;kr-1/~/ ~ Je:~~n~~$-~~~9~ffl9 ~ki'!),
• ::J.::.:1=7'-1'ti~:k~\,'
m:t:E, Python l<l:t!tW ""C' .:t? C: .:t ~ \, \0) c!5 ~ ~ ~ C: IJ!fltn ~ Ia: cit\ 'Y ~ tJ:. ~
·~~~t.i:~6~fi~~~71'&I7-~C'~~
Python l<l:, :J / H-1 Jl.t C~c~ G tc 7o 77 .b.~ :J / 1:::' ~ -5'1J{~rr G~9~,,
~~~-~-;{_~~~)~~~C:Ga:;ttfvo <::h~r-1/5'7~5'~i§BJ
)[..,~ [..,t,J. <T .:t ~ \,1,9-l<l:, 1--7-1 & I 7 --r'~~~~/'/.)~? ;t -c":;*\:~ tJfiJ F.i(
(: t,J. fJ *9 0
211
R"A!IH;t, ~~ · 7"-5~N!T 1<=~1~ L.d.::7 D 77~ :Y7~~l'9o ~:fJ.H;t:;k:
· feit~AI9ll!ffi71':17'J 0):1t;\;
R § ~l;:tt!!:,W.~ (J)*le~ · Aimflli~~l'fiJ.Ff.l ~ n T ~_, \-@ tc. ~, ;fVC~ • Aim
~~~c:::~{~ Gtc 7 -17'7 1J fJ'~j, <ffl~~n T\.,'*9 o a::tc, 7"-57.J"~fTl'l;t-T-
5 (J)PJ:f5e1~tJ{ :~It~lc:::tJ.I) a:: 9fJ\ R § ~l'ili5 nit, r.~JJJfiJ:?"7 7~\U~-a::.; :Y 7
)~tJ.~2~l'1'J X.~ 7-177 1
) fJ{:fHE l_; *9 0
·7-~~1'I~r~~~O)~-i~
212
Java Ia:, t!tW.(]) 2" * c5 *fd-A%. /D ?.5 ~ / 7~~5 / =\'=- / 7-z"ffi: S <_t
1.\LI<::::fHE G~ltT \.\ ~ ~ ~""Z"9 o OS ;/J' S Web -tt- t: A* "C', 05 S ~~ffi~"C'
Java (j:f1Jffl2" tL T \,\ *9 o ¥-JW:C: L., T la:~X(]) J~;/J{~.iHfStL* 9 o
• ~11\I.,~IH:O):::J7it{v-~ 3 /
Java (j: OS, Web -tt - t: A, 7 - .b. t,;. c mit:\,\ 5:J'!Y l' fiJ ffl2" tL T \,' ~ tc ttJ,
<:tLS I<: Javal'.ffi~2"n T\.'~~~t,;.AI~f4g5175 1
) :ta::*licilf~J:J., 2" *
c5*fd.~/~/~1ii::~~9~<:C:~l'~*9o
· :::J~.::~.=7-1'b':=":~l.'
Java (j: <: n *l'mit: \, \)J'!fC'fiJ.ffi 2" n T ~ t.:: t.:: ttJ, :fJJ~ffrti:Ht (])~~A f-.
:1i!;-{/~-*~f--"\?~~~C'~@~A~9~Z:(::~C'~*9o
213
-~~~m71'7'71J c
7'v-.b.r:J-?
-~~~T-11-~~t: f7-$rO)Jil!.f~J ..... fiW~~J ..... n~~~~J tl-'?f.::~llliP~:iah
:~: 9 0 /o 7·7 ~ :.-- 7·1: J:: .Q ~~t:sl- '""C 11, -t tt ·fn t:tt t- -r m
• n -rl,'
~ .Q ~
:1: ~:I: fJ:71.f7 1J ~~~ffl G, ~*IY-Jfl :::J -71 :.--~/~~'Tl-':1: G J: ? o
1
t~lHiit~ ~O)~~-r(cJ:, tete. 7 JG :::1' 'J 7..'b.OJJJ.~ :J -7-1::,.; ?·9td;t: J: 1- \b ~t
~~~ ~*~ ~oT'-7·~~M~~0)~~7 ~ ~~ ~~"t'9oT'- 7·~~
M~~OJ~~7~~~T' - ~%~~ab~~~w~~O)~~mG*9o
· OpenCV
• matplotlib
ilifl ·Pillow scikit-learn
• seaborn
• scikit -image
)tiil -
· mecab
• NLTK
· genism
· scikit-learn
I
214
Python -z-:t -:J C: :t*IJm~:n T ~,,~~.ffl£~~7-1 77 1) ~cl: , sclklt-leam-z-9 o
scikit-learn ,;:1::, r ~~~i!li!D '::> ~~ (@] ~) J r ~~ifji!D '::> ~~ (7.)'~) J r~~ilitJ t_, ~~ (?
7 .A ~ 1) / ? ') J r~.X:l(; ~U ),rpj,J 0) ~ * ~ a::tJ :P Jl.- :J' 1) ;(J..,.~fillj ;Z T ;t;l '::>, %!H ~
-z'*Bfl' t_, tdlf:$:8kl tJtl.ffl£~~7 JL- :J" 1) ;( b ,;:1::, ~a: C: lu C.<= 0) scikit-learn l'~~
1:- J (https://scikit-learn.org/stable/tutorial/machine_learning_map/index.html) :t
~~~n T;t;l '::> , Fp~Jm't:::~bttT ~tR~~J!!!.-:J T l,\ ( C: JI Gt.-:7 Jl.-:J' 1) A'btJ'
b fJ' '::> 3:: 9 o
scikit-lea rn
8
https://scikit-learn.org/stable/
215
NumPy fi, :fi;~X:Jt;llc11J ~:f& -5 tc.~ (J) 6 * ~- * td:{5sUbJ'J\ 'Y 7 - :J'6 htc. 7
~77~~~0 k~Y-~~m~~~~~~~~<, Y- ~~M~~~~ft~
t-' 7 - ') I ~t}~, tl~1:.R!U:: \,\·:dc~~S\Jfd:~l:!f-t 11' ~ * ~ o Python fi, fit.
*(J)H~~t~:td: cc·f1Jffl6n -r 2' tc. c ~~td: c (J) ~§i§=J: iJ ;~•J.f&tl'~"'' c ~
t>n -r "'' *~t.J\ Num Pyc·rJ: <= (J)3~m~m5R:~ ~tdh t<::~~(J)~t~t.J'C ~ ~
~~11'6 h c&3 i) , -t:h1J' rpython (J) / D ?'7 .:::_ / ?'(J) l_; ?~ 6 J c rc ~~
(J)~JJB11J ~jj!l]:lz:6"\i'T\,\*~o
~cl5 i), tc. c .:~.-'J:'Microsoft Excel (J) d:: -5 td:, ~\HI~n(J)T''- ~ t<::M~ ~ 6* ~ *
fd:~W~-!f;j{ - 1--uT'v'*~o CSVt-'Excel~itfd:c'(J)7 :r~ Jl.-1J'G7'- ~~
7,t ~~ ~ 2' ~ 7 ~ 7' 7 ') T~o Python 1;(.:7}(<:: -t C++ t-' Java fd: c (J){iJ3 ~ §gc·fiJ
ffl6h T &3 i), C: -r -t A~/$'"- ~ fd: 7 -1 7" 7 ') c· cJ5 ~ C: "''~* ~ o @i{j.(J)(£
h' l_; t-' = {~{~, 7 L.-- A 7 - )t, f<:::tlliJ\:~;J ,, @]$.lifd: t' (J) £;tt~ll'd'\=ti -t ~ 3 /v,
@l®~(J)I~ Y ~Dm~~ I~ Y~~?L A 1--77b(J)~ - ~c, --~ R?
}[,:J' ') :;Z'bt<:: A.fr9 ~tc. (:;f)f<::£,§gfd:JW~W ~ *~H l_; T 'v\it~ o
216
OpenCV
f 7'-90)0J~JHtl~ rmatplotlibJ
8
t~.IH~~~'c:::;tat,q:·, Il:H~ Ldc7-51-t-'-TJ~U · 5:J'~0)*5~~1ii~~9~tc~'c:::,
~ -t-'9<7 -51 ~ ~5f-: c ~ ~ L. C. 'J:~~l'9 Python l' ';:!:7-51 O)PJ:f~11::'<::
o
matplotlib
i~t'~~!~.~~~
{J~~;~;J\]
tll!A!: https://matplotlib.org/gallery/index.html
217
7 -r-7·7 - =::...-?·0)-liO)ft~~ - :fJ'f:> ::~- r:·c:tt~l' ~., ·n, <O)C;t~ ~ ~c: m•
-r-·9ti, 7 v-A'7 - '7 ~~;tCifm~f t -r~ 3;9 o 1-t~IY-.lt.t: 7 v - A '7-'7 t vr
11, TensorFiow 0)(~ :fJ> Keras '(!> PyTorch t.t: E :fJf"5> ~) 3; 9 o
/. + ~
60
51.55
40
c 4
22.72
20 17.1 5
12.02
8.37 4.89 3.65 2.71 1.18 1.06
0
Tensor
Flow Keras PyTorch Caffe Theano MXNet CNTK DL4 Caffe2 Chainer fast.ai
218
~ T ensorFlow
TensorFiow ~;:: ~;J::, T ensorBoard ~ JllF(;fh~ PJ:f5?.1t 'J 7 1---? :r: ?!'J'M~ GT
cf31J, ~t~ -:7·~ 7 ~*~~ ~ :Q ~J:t.J' , !'JI'~!'J\ c ~ J; ?lt::.lifu c·L \ -::J tc.OJf.J'Pi.J'
IJ "'\-> 9 <PJ:f5?.it c· ~ *9 o 2" S ~;::, TensorFiow Serving ~ J; ~;_f'h ~ G <JJ- :t ~ IJ ,
TensorFiow ~~~;Jj'JJ-'E-T'J[.,~ i.J'fu tcfu ~;::-f) - J \- -.t <:"0-00 · '§'I]Il_9 ~ ~ ~ :t
PJ~~C'9o
8
TensorFiow ~~RPJTI;l::, 1g l---"'Jl.-~ 7 L---b. '7--:/ L"il6 :Q tc.t!J ~<:: ::J - ~ f.J'1.WW
l<::t&: IJ !'J'-ts t&:L. ~ ~9 o * tc. Defi ne-and-Run? 70-7-~tiUf.l G T L\~ tc.t!J,
*-f}Z/J:~H~:f- 'Y 1--- '7-? ~tl~f.J\~ G <, 70 -:7"~ b.f.J\:f~~!H<::t&:~ ~ ~ :t ~ ~
1
) ''.! 1--- c:· G J: -3 o 1JJ !'1'11§- 0) t~i;-, TensorFiow <:" l;l:: t&: <, -t ~ ~ 'Y J \ - ~ Keras
(P 221 ~~) ~1se -::J tda: -3 f.J\ J; L\ i.J'B Gh *tt fuo t&: ;!;), TensorFiow 2.0 c:· l;l::
Define-by-Run 770 - 7-t./~ ~ Y ~c::~:Q~Jj G ~<15 ~ tc.t!J, <: c: rc::_ttf'tc.X.
,~:tm;~2"hTL\< ~JG!,bh*9 o
TensorBoard
---
melt10d· - - tfOSSolnlff)py
,.
0
N ~~m• Smoother:! V•h.Je Step Tim~ Rd!!tllto
e ~ .-.J oo~~,.t oo:'s~o 1100 "'"Sei•12.1Sil0.\l b
• lroUI 00).1~1 0013!>7 Uo6n M""~"'Jlla,l~40~0 I•
219
~ PyTorch
PyTorch ~d:Facebooktfi*J~ l.; --c ;1;3 I), TensorFiow c JJI.~~ fJ:9 7 L-- b '7 -
? c \,\ .:Z-@ l' l.; J: -5o PyTorch ~d:7'7 ::t J[.; 1--l' Define-by-Run 7 7' D- 7-il'I!R S
n, liltl%:~~?"7 7 ~~nlZ u--c \,\ <tc(Y), *'-VJ:~~~fr.:Z3::9 ~0)~3:il' o
O):Btpff c u--c td:, ~il'ntc ~ - ~ 0)~ I) t<::1~~ ~t~ u--ct.,\< tc(Y), ~- ~ 0)~
~7J~~.:Z .Q ]'HQtJ't~~flk.J'J' ~ \, \,~ , pdb fJ: C. 0)7" J\ 'Y ?"'Y - J[.;~j~ "J T@:~
B"J ~<:: "T'J \ 'Y ?'~ f]' ;Z .Q ,~tJ C fJ\(!51) 3::9 a !; fJ:J;;. (<::, ~ -"T' -1 / IJ' O)~~~~d:
il£ l.; \,\ ]lli'l_ 1<::, TensorFiow > PyTorch > Keras c tJ: "J --c \,\ 3:: 9 o l.; tc tJ' "J --c ,
Keras --c td:'t?afE I) tJ \,\ ttn c.~mtJ: TensorFiow 0) ~- ~ ~ \,\ u I) tc <tJ \, \ , c
\,\ "J tc1J(z::;!;39961) U 3::9 a
PyTorch _ttz:: ~d:W.ffiO)PJ:f5W:: 'J 7 1-- ') .r 7 td:1i~ u --c ;1;3 S 9\ PJm1t u tc \,\
~ td: Face book tJ' ~ lffll.; --c \,\ .Q PyTorch c Numpy (<:: M IZi u --c \,\ .Q Visdom t->,
PyTorch c· TensorBoard ~1~ -5 tc(Y) 0) tensorboardX c \,\ "J tc J\.fl'B 'Y - ) [.; ~1~ -5
L. uz:: tJ: I) *9 0
td: a:: tUJ: <, ~* u --c :t '*~ ~c: tJ: .Q ~2.$tJ'::!dJ:iJ' "J tc o, I 7 - O)m;R.15;'!tJ'
t±\T L.fJiJ' "J tc I) l.; 3::9a tete uJlii¥, L. -5 \,\ "J tcfp~;mtd:Y .r 70)~llDC C 'b
tz::m;~ V::>--:>cl51) 3::9o
~~?''770) [
x = t f.Var i able(0 .)
y = t f. Variable (l. )
for _ in range( 100): m~ add • x . ass i gn(x + y )
X = X + y (Define) di v = y . a ss i gn(y 1 2)
y • y I 2 init • tf .global_vari ab le _i n i tializ er()
l
init . r un()
~~0)~1'J for _ i n r ange( 100) :
~~7'7/ 0)~IIJ~Ij:
(Run) sess . run( add)
~1'JC:13.1 ~ sess. run( di v)
(Define-by-Run) print(x. eval())
220
f< Keras
~~~~~k~5~ ThM~R~~ • w••0~m~~~. ~-~0~~~
~Ji*fJ:tc66fJJI[,,:gic (;;I::[P] ~ 3; tt lvo ..7f L. ~d'd~~ 66fJ:01J{ Keras ~~ o Keras
l'li~Fm' I<= D'lvtclvfJ: ~- ~ l '-'E T' Jl- ~ il#~~ ~ ~'J 5 <:. C:: "/J{~ 2' 3; ~tJ'. ..7f
0~~ ElP-fi;;I::TensorFiowtJ{rrL\ a;~ o -:J a; f) Keras C:: I;;I:: TensorFiow ~{12'~~
~ .:t 0~1;;1::t,J: <. ~UD-c' Keras tJ\ ~ l ' TensorFiowtJ{!JJL' -r L~~ C:: 1 ;>( -::/' ~
-r <tc ~ L'o TensorFiow ~ • 2!, Jf ';6/v ""Z' L' ~ " tc 66. Keras I;;I:: TensorFiow 0 7 "/
~ ~-l' il5 ~ C:: ~? tc f) • ...t{li:$:7i''id§. ~ ~ ~ <:. C:: D' 5. Keras 1;;1::~ L.- «J~ API
""Z' if.>~ C:: ~ ? tc f) =t ~ a;~ o fJ: dB. Keras 1;;1::, TensorFiow 1.:.( ~ IC =t Theano-\->
CNTK t L \? tc 7 L.- -b '7-? ~~ c·lhtJ'~ L. C:: =t PJ~~-c'~ o
KerastJ<:t.J"Jit ~ -r L~~ * "J 1-- '7 - ? 0)~1~1;;1::1J 1 fJ: f)~<, ~;$:~tc~:+ "J 1-- '7-
8
? 01fil~~ if.> n li~1'J-z> Ji)( 3; ~ L. C:: =t il5 f) 3; ~ (TensorFiow ~ l<t~+ f'J~ <~~
~1J{il5 ~ D':I:J ~ n3;tt lv)o Keras 0~ J;~I;;I::, ~0 TensorFiow lett~~ C:: 'ET'
J i.--~O)*~'r:I:1J{fcj:l, \;: (:: ""Z'~tJ{, L. 0~,'i$..i;;l::ll5;mtc~: ~ - ~ ~~(:: 0)"[._.,- ~
::t 7 ~if.>~ C:: =t l,\~~ ""Z' ~ J: 5o Keras ~7"-{ - 7 5 - =/70 ~ 'Y ~100/vtC.
6, Keras 1;;1::~· ~. ~O) TensorFiowl' 'E T'J t.- tJti!ilt ~ ~ 51<=1d: ~0"/J{~-$'-
1J''t ~n3;ttlvo
Keras
TensorFlow
de{ ~rr,>e1Qht_¥ar:hbte(•h•pt):
.-.odel • Sequential()
...odet.add(Conv20(l2, (l, 3) , padding•' strot' ,
input_shape•X_trd.n. s~pe(1:]))
_j
intt hl • t:C. t runcated_nomal(sNpt, stddev•8.1) IIOdel.add(Ac:tivationt'_~J{nf
return tf.VuUble(1n1thl) ....t'.•~ConV!0(32,-(' '
.odel.o~.dd(Activ&tton( 'relu' ))
dd bhs_vulablt(shape) :
Jnit.h.l • t! .coru.tant(l.l, sh.ape• shape) 1 :=i:::=~~~~~~rol_sh.-(2. 2)))
return ct.VuUble(1n1tbl) I
def convld(x, W):
reto:m tf.m.conv2d(x, W, str1dts•[l,1,1,1), ~dding • 'SAtt E ')
221
• ONNX(Open Neural Network Exchange)
7 L-- - b '7 - ? It: ~ {~'dci: <~ ~ =c 7' JL- ~ * ml' ~ .Q 7 ;;t - ~ "J t-- l',
Microsoft C:: Facebook It: J:? T9B*~h"* G t.:o ONNX 7 ;;t -~ 'Y t-- ~ffl \,\h
(;:!:, PyTorch l'~~ 2"itt.:::'E 7' JL-~ TensorFiow_Ll'fse-'5 tJ c, 7 L-- - b. '7-?
~~;ttd1Jffl;IJ'PJ1jgl'9 o * t.::, Caffe, Caffe2 Python, C++, MATLAB tJ C. It: J:?
· Theano
7' 1 - 7' 7 - =/ 7 ffl C:: G T lj: -B ? C:: -B "i!i \,\ Python 7 L-- - b '7 - ? l' 9 o
=c / t-- 1) :;;t- )[., -;k.~;/]{ 2007 if: D's rw.l9B G T \, \ *
9 0 2017 if: I<: ~~-i) " ' - t--
;/]{~p? t.:t.::l:/), ~Jltl'lj:(5 *I) fsebn T \,\*it lvo
• MXNet
Amazon tJ' Amazon Web Service (AWS) ffl It: :J:i~ 9 ~ 7 L.-- b '7- ? l' 9 o
~~~X;Jjif;;tJ{~~l', Python, C++O)I~tJ'I<:=tR, MATLAB, PerltJ:cO)~~
1<: =tx-J}if;; G T \,\ * 9 o M!~IJ~~~ fJ? t.:::~-8-0) A 1::- f.: ;/J{I~tJ'O) 7 l-- - b
'7 - ?I<:Jt«TJ.i< fJ:~ (A-7-Jl-9~) O);/]{~~l'9 o
·Sonnet
TensorFiow I<: <IB It .Q =t -5 - -::J 0) 7 'Y J\ - l ' 9 o Keras C:: IPJ G J: ? 1<:,
TensorFiow 0)1.\U!EtJ: :::J - f.:~ f.:l;m1t G T ~ < L. C:: tJ{l' ~ * 9 o ±. 1<: Google
O)r~t±l'~.Q DeepMind1±0)iJf~lffl9BI<:i5e:bh TL\ *9 o
222
• DL4J(Deeplearning4J)
Java c ScalaO)t.:::61J O)T' -1 -7 7-= ':./ 1f7 L--- b '7 -? "Z'9 a :7\JJH~~ A
=r b.~;: <IS l,' T, Hadoop t-> Apache Spark ~~~ t.::: )J\1&~~ ~ 1~ ~ c G *9 a
• Chainer
B2js;: JE 0) 7 L-- -b. '7 - ? "Z', AI A 5' - 1-- 7 'Y 7 "Z' <fb ~ Preferred Networks 1;:
J: I) m.lJEtHrb n T l,\2t9 a PyTorch ~<l:Chainer~ =b c t<:fF S:h T l,\~t.:::61J,
1~H'F~<l: PyTorch c 1~® ~ T l,' a=: 9 a Define-by-Run O)}GJJ'~ -t PyTorch c ~~t:'
8
9a
import chainer
import chainer.functions as F
import chainer.links as L
class MLP(chainer.Chain):
def __ init __ (self, n_units, n_out) :
super(MLP , se lf). __ i nit __ ()
wi th self .init_scope():
self.ll = L.Linear(None, n_units)
self.l2 = L.Linear(None, n_units)
self.l3 = L.Li near(None, n_out)
• fast.ai
PyTorch 0) '5 "J J\ - t:9 a TensorFiow I<: <IS tt ~ Keras 0) J::? t;: , PyTorch ~ti.J
tr9t.::: 61JO) -:J - 7' -1 ':..1?"1.J~.I:t~~1.J'Ivt.:::lv "Z'9 a
223
GPU7o?'7 ~ /?'t:.
50 ~)111:;
-~·B~ ~ ~~~~~~~~~~~#.fi•• ~~ ~ m~~o ~ ~ ~ ~-~ ~~
~~? ~-ff~~ ~ ~ ?~ ~~~ ~~~~~~~ ~ t ~•ij* ~o ~~~~ . ~ ~
r.,,Jm ~ G~I:'~ ~~GPU (Graphics Processing Unit) ~c·I:'?I.' T IVfmt G*~o
tili~O) t.:: lsi)O)J '\ - 'Y 1: u t.::o GPU 1;1::- -:> - -:> O)~JmEl f/.$;1;1:: CPU l<:.t:~"" T ~ (
l;l:fJ:\., \0)1:9fJ\ slftJ"Ij~JmfJ{J±{ilJ I¥.H<: ~ ( 1'J ;{.~O)fJ{¥}~1:9 o ::fdiiO)T'- 5
~-~~c:~~-r~ ~ J::-? 1<=. GPu § f*l<= ::f\::@1!0).>< -t 1) ~m~ ~._, T l,\ a:::9 0
~i;\¥:~~1!Wf.J{7"-b. 'c:t.,;:~ t., sl:U:J!J~J:f 0)1~ ~ fJ:GPU 1.J{)i§ ~~IIi)~ J:: -3 ' <::fJ:
I) , I~tt-r 'cl:~~~'f& ~<:: dB\.,\ T ';J: 13:1£&;,~0)1 \- 'Y t. t.,;:-::> T \., \ -g::: 9 o 2" S IC: ~
Jli-r l;t, TPU (tensor proc ess ing unit) t. J:: lih ~T' 1 - 7'7 - = / ?"WfflO)
J\-1" './I 7 =t§:~ G T \- \ a:::9 o
G~ ~~-3~ ~Mt.~-3/D?" 7 b.~·<~-~~l)-g:::~~o8~~-
7 ~ - b. '7 - ? IC:dBl.\T, GPU l<: ~~~ ~ t.:l.\ t. ~ lcl: 1 frf¥/.t0)/0 ?"7 b.~
M lt:bOX.~ tc 'tl:OK-r9 o t.::tc u , J:: I) GPU 0)8fm~:6:~{~ u t.:: \- \~-8-tJ: c
~. =t?~G.J:~if~~~l:u~?o
~ttMO)G~~#M~~m-r • .><-t~O)&ma:::-r~~9t.1oo~~~mx.
~ =t O)=t ~I) a:::9 o -f <: -r~~G t.:: \.,\O)if;;f /7-1/ _t-r~3t.~f&J~U~~l:,
..
~r ~RiiJ~RI;t<5 ~ =t 0)0)1m*3t -z:~x. ~ =t 0) :t <5 IJ a::: 9 o :ij':g c.: 31: 1;1:: Google
Colaboratory t., Kaggle O)Kernel ~1U~1:9o ~t.,;:or;.lc:<:tLSO){&J!\IJii~c·
224
~bhT\,\~NVIDIA Tesla K80 ict, NVI DIA;/J{~),R~l.JT\,\~G PU O)i:j:lc:tJ:
m?5~c~0, ~h~-~c~~ ~O)~* ~~-~c~o *k,MM~Bc
iSe-3 51' /5 1
) '\!>7 [...,-b. '7-? ii -1'::,.; ~ 1-- -J[.,)fol~ c~~t.:::61.>, §J5J'c~~
··~l.J~(T)foltO):tW~«~~~-c~*~~~~~l--cl.J~-3o
225
fl!Ulil~~:a- ~~~gl: f!J ffl9 .Q f.: eli) I: I;!:_ ::k :itO)~B7- -9 O)J&~~st l'J ~)Jl!f.t C' l: ~~
~ ~ ;k ~f.t~ ~ ~~~~ij*9 o ~ 0)~. ~~~~~ - ~ ~ :a- ~~ ~. 9 ~ ~~~
/lO)~* H~E> :h *9o ;: ;: "Z'I;I: ~pq~~O)~~~B ~ - r::·~ :a- J! Tl- ' ~ * lJ J: ? o
9-z' l<::. !ii~G T ~ tcJ::. -3 1<::., #.\Hiii:~ ~~L. I;:J:-'E7' J [;O)~)E'\!l J\ -1 J~ - J ~5 ;;J,-
f.JD;Z -c , -'E T' J [; '\!'~~9 ~ 7'- $' flril~ ~ 1- ' tel: c~t~~ fiijiJ{~ 1- '~~ ~;: IJ., ~t~
·-'t ~~C~'J*9o ~h6~~~~~~'\!l ~ ~ ~ ~~-9~k~~~fflG
tci-\O)tJ\ il::~tJ'm1#t; G -cl-,~tlf-~~-t.t- t: ~ t:9 o ttiH~~~-tt - ~~ t:IJ..
il::~iJ{pJT~ G TI-\~ ~ WZ&OZf.O)~~~ ~'tT' J L- ~fiJ ffll'~ * 9 o tc:J:3'3#.\Hiil:~~
-tt- ~~ ~~~0)$' -{/ ~~~. ~ - ~- ~~~7'- $'~~ffl~ G T~~'\!lm
;ffu~ 9 ""-c-tt- ~ ~ tr: tttt ~ $' -1-:1 :t <5 'J * 9tJ'. ~ ;:: -c1a: M~';: -:J ~,,-em~
G*9o
~m. M;tii1:~~7 D 75b~*~9 ~C:~~~7- $'0)~·~6ttMO)~~
* c:.', \,' <-:J iJ'O) / Dt ~ ~~t;- &;,~iJ{<I5 'J * 9 (Section12 ~~) o -t-0)~-c:.'
~ ifj: f1Jffl9 ~ tc 6fJ lr: l;:l: ~O) r-'ET' J[; 1<::. J::. ~ ti;J!UJ O)tf~5J'c:.'-13-il::*iJ' 6 m11# ~ h
T \, \~AP i ifj:~ \, \ -tt - l::::" ~ ifj:lllJilJ I±l G a:;9 o lllJiU I±l ~ ntc-+t- r::· ~ l;:t.:z. - ~ -
226
tUIJ =f'- 9 (])
m~ 111111
:J.-tf-
~ 1& ~<::, t11Hiit ~ ~ -17- 1:::' A (7) ~ f?JJ 1,f ~ fl' L.; -n,' ~ * 9 o tV& 8'9 fJ: 0) li
Google, Amazon, Microsoft, IBM O)~tii£~~-17 - 1:::' A -z'9 o L. h S O)ii:JilUi
:;*;:& (7)-T-5 e:=~fJ: ~t~Jil:~1f:¥-.f? T\-\~tct:;t), ~t\JUc:i:=E-TJ~(7)7-{ '../? 'Y
/tJ{~ 1'J, ~11~g-z:~~ t \,\;ta=:9 o -.1J-z'E3:*:i1:3t¥Hi, ;mj}:t£~0)~~# "1'~
~ B :;$:~1<:: ~9 ~ API1f: !fl,i)tc::mi# L.; T \,\ * 9 o 1:?-Z T O)~tc: B :$:l£~ (7) Yahoo!
t goo 0)-lf-1:::' A;}.) J: u;mj}:t£~(7)-lf-t:• A 1,f ~ fl' l_; *9 0 1i~gtJI s *~~1**
a=:"1'~n~nft~~~t:;t), J:<~W L.; T~fflL.;*L.;~5o
227
Co mputer Vision (iffii ~
Cloud Video :51-l!f)
iffii Intelligence Amazon Face (M:5tl!f)
Visual Recognition
~ API (iiJ@i:5tl!i') Rekognition (iffii Video Indexer (fh[iljj:5J'
(@ii~~~)
* Cloud Vision
API ([iljjf~:5ttlf)
~ . J}j OOi :5Tl!f) l!f)
Cont ent Moderator ( :::J
-:..; r-:..;"J71 JL-5' 1J -:..;-7")
~)
~)
228
m~~-~~-~~~~-&~ r ~s~Aim~7-bJ~~U . ~~-~
~i"AA9 0&ffi~iJ!:Iet'i&~ < fitt G *9 o ~~t, *te, L.~ r~s~xAI~.:ofjg 7"-bJ
let-~9 0 ~~X. T l,\*9 o tete G L.~-~ ~let rf!Jitl~h~ < tJ:.0 L. ~J T'
let~<. J.t:<t±i'l2\C:~~90L.~Ic:J:IJ r~teiJ''E>fi~GtJ:.l,\f.J'~d::-51<:, ~
229
'A.I);[]~I::,iAl0.'€ !!(~. f,lljj>), <l' !iO %Z(:;if), ii'iiE ~ !Jil ('it) , ~ 0 l!l!-gB(\!1), f'l:f!l; J!i(~). lffil ;~- (:oi'), ;3iffi ~ (~),
i'fl/Si i=(~). litiE;)i;BJl(li!'), itll..til\'ii0(~). WD i%'JZ (iM), WI II OZ:(li'), ~llH\l('it), .A.IJl1im"F~ ( !£@l (2016)
1-1 7 A 1- -z'"¥,3< AIJll ~~tiHitiJ 'i!'Dll:.:J;: (~) ~l!lit± (201 4)
l l,l!:;i;l:/v"\"~(., \, I,A_I]llJiet"::J;)<A(I)fl.;lj;: AI ·ll'!f.liOF'g(I)>JOlil!ft ( '1.1 !:;1;1:/v"\"~ (., \,l~;lj;:J =;;j;!Jtl!i'l (~) , J;t:!ij!.@: (~)-(
;_,/[.,A (2017)
·THands-On Machine Learning wi1h Scikit-Learn and TensorFiowJ Aurnlien Geron (1!11) O'Reilly Media (2017)
r ? 7 A 9 ') :..-7 (: 1..- :::J.>( / 7' - ;., ~ /l'!~4J !!lEil >$!'!' (ht1ps://www.slideshare.neVssuserb5817c/ss- 70472536)
<
' "C? ~ / 07' '} 7::Z9 ') /70)JEJ!ly Jta • r; )Cb 'K-means;tiJ ~ t: V :J.J'5-17GTJi.t::.J
(ltttp://tech.nitoyon.com!jalblog/2009/04/09/kmeans-visualise/)
r~z'T Y'Y J~Y 'J ::1 - ;., 3 :--7J!bt~f± 7'-< - 77-=. ::--71J<i!< : ;~ il"llil<JL'f'lll'J
(https//wv.w.toshiba-sol.ca.jpltech/saVcase/1804_1.htm)
1Gym classic controiJ (https://gym.openai.com/ envs/liclassic_contml)
230
'i\*;!;1'1J,l< 7- ?-tt1.:r::..-T.,- A f-0):10?' 'I'!C~'i':l::l!U';Oi!IO)llf.~,, l;l:~ 'HIIGt~S.il!.~ 'OlfJ'J
(hllpsJ/tjo.hatenablog .comlenlly/2015109/17/1 !XXXXJ)
' IEEE SPECTRUM Pittsburgh's AI TraffiC Signals W~ Make Driving Less 13oflngJ (httpsJ/spectrum.ieee.org/cars-that-thtnkl
roboticslartificial-inteligencelpittsburgh-smart-tmffic-signals-will-make-drMng-loss-boring)
r pR TIMES ' ScibkisJ (AI(tl!ii!<'/'1!\') ~ ffi~' rc :r l v :f 'J :;(bi.:J; ~ DSPJ:Z;'ilrEIIIJill!lllm~it Y ') • -~ 3 ~) 0)1::1.+-1~- f. 7-
~:t t [., c7 f' 7 l.- ·y-? A !Pt - t: A !IJIH!Il~~~ (hllps://prtimes.Jp/mainlhtmVrdlp/000000029.000016900.html)
' tTY 'J ;,_-~ 3 :..-<.!: [Jlll~] ::J l.-1 '!l<"t'~l.l'~Jv- IG'<-Atlll!~~BJ
(tlttps:llblogs.ltmedia.co.jpfrtsoluUonjuku/201611Olpost_308.html)
•iillo"1'~!1.l~l!tllt$g'l,-f!M -~(~). <PtiJ •C,:t:('i'), i!!i# iJ: (ti) 71'51 'J - V'\'1~:..- (2018)
'keywatker WebA? v1 ~/?' 1: I;I.J (hllps://Www.keywalker.c:o.ptweb-<:raW1er/web-scraping.hlml)
231
'Deep Learning BaslcSJ (https:/!www.dropbox.com/slc0g3sc1 shi63x3q/doep_leaming_baslcs.pdfldi;Q)
(https://towardsdatasclence.corn/generatlve-adversarial-networks·gans-a-beginners-guide-Sb38eceece24)
'llOBE Index for July 2019 Jtiy Headline: Peri is one of the victims of Python's hype, (nttps:/!www.tlobe.com/liobe-index/)
'lowards Data Science And here's the pretty chart again showing the final power sccxes.J (https:/ltowardsdatascience.com/
deep-learning-frameworl<-power-scores-2018-23607ddf297a)
'Medium Breaking down Neural Networl<s: An Intuitive approach to Backp ropagation Computational graph for the example f=
(a+b) (b+c) with a= - 1, b = 3 and c = 4.J (nttps://medium.com/spldern~reaking-down-noural-networks-an-intuijlve
approach-to-bad<propagation-3b211958794c)
c
'Microsoft Azure ONNX Azure Machine Learning:ML '!: 7 J~QJ('l'lil< ll!ll!ftJ c
(https://docs.mlcrosoft.comlja-jp/azure/machine-learnlng/service/concept-onnx)
232
'goo7;r. APIJ (https:/~abs.goo.ne.jp/api!)
r Analytlcs Vidhya This can be verif"'d by looking at too plots generated for 6 rnodelsl This woold generate th€ following plot A
(https://www.analyticsvidhya.c om/blog/2016/01 /complete-tutorial-ridge-lasso-regression-python/)
e"Support Vector Machir1es for Classification These instances are called the support vectors. The distance between the edges uf
-the street' is c alled marg1n./ It 1s quite sensitive to outliers.J (https://mubaris.corn/posts!svrn/)
I ResearchGate Predicting Top-of-Atmosphere Thermal Rad iance Using MERRA-2 Atmospheric Data w ith Deep Learni ng,
(https ://www.researchgate.neVpublicat ion/320916953_Predicting_Top-of-Atmosplhere_Thermai_Radiance_Using_ MER RA- 2_
Atmospheric _Data._with_Deep_Learning/]gures?lo~1Figure 5)
f ::J ::..-<tWl'T'- -$'174 I /7'1 A 1-- One class SVM I~J: -Mtn l!l.i~JOI<:c:>L' -cU: ~tc. hktech
(http:/Jnktech .hatenablog.com/entry/ 2018/10/11 /235312)
rouora What is the interpretation and intuitive explanation of Gini impurity in decision trees?.L
(https://vwvw.quora.comiVVhat-is-the-lnterpretation-and-i ntuitive-explanation-of-Gini-impurity-in-decision-trees)
r ;p :.-<t ::,; 7' JV'l'-'ll' (Ensembkl learning) 1::; ICJ.. 'T •y 1-- ;tilT (basket ana,.sis) J @nirP"'rm
(https:/ /qiita.c om/nirP"'rmlitems/318d7e21 0c069373f8d2)
rMedium So i1 we train a Random Forest Classifier on these predictions of LR,SVM,KNN we get better resui!S.J
(https://medium .com/@gurucharan_33981/stacking -a -su per-learning-t echnique-dbed06b1 156d)
• Restncted Bolt zmann Machine (RBM) , Deep Belief Network (Hinton, 2006) J
(http//www."slon.is.tohoktl.ac.jp/~ les/93 1 3/6601 /7876/CVIM_tut orial_deep_learnlng .pdf)
f FAST AND ACCURATE DEEP NETWORK LEARNING BY EXPONENTIAL LINEAR UNITS (ELLIS) Figure I J
(https://arxlv.org!pdf/1511 .07289.pdf)
rTesorFiowJ (https://playgrourid.tensorflow.org/)
233
~5 1 In dex
8c~ 7JL-7rl'l(·;~ 1'- Long Short Term Memory (LSTM) ..... 186
t -greedy$ ....................................... 192 MAE ( .sp:i$J*f!!X<J~ji) ............................ 82
Attention ............................................. 188 matplotlib ............................................ 217
CAE (Convolutional Autoencoder) .... 198 mecab ................................................. 216
Census ................................................. 63 Membership Query Synthesis .............. 92
Chainer ............................................... 223 Min-Max .A-T - 1) / 'f ......................... 68
Changing Anything Changes Everything Momentum SGD ................................. 171
......................................................... 098 MXNet ................................................. 222
Cityscapes Dataset ............................ 208 NLTK ................................................... 216
CNTK (Microsoft Cognitive Toolkit) ... 222 NumPy ................................................ 215
CPU .................................................... 224 NVIDIA Tesla K80 ............................... 225
DAE (Denoising Autoencoder) .......... 198 One-Class SVM .................................. 111
Define-and-Run .................................. 218 One-Hot I / :J -7 1 / 1' .................. 66
Define-by-Run .................................... 218 One-s hot ~~ ..................................... 177
DL4J (DeepLearning4J) .................... 223 ONNX (Open Neural Network Exchange)
DSP (Demand-Side Platform) ............. 56 ........................................................ 222
Elastic Netl91~ ................................... 107 OpenAI Gym ....................................... 195
end-to-end ......................................... 207 OpenCV .............................................. 216
e-Stat .................................................... 63 Open Images Dataset ......................... 208
Experience Replay .............................. 191 pandas ................................................ 215
False Negative : il%~11 ....................... 83 Pool-Based Sam ping ........................... 92
False Positive : ~!l;tt ........................ 83 Python ................................................ 211
fast.ai ......................................... ......... 223 PyTorch ............................................... 220
F fift (f-score) ........................................ 85 Q~N ....................................... .......... 191
GAN (~X<J-8(]~Ji.lt ;?. ·:; I- '7- ?) ........ 200 Qfii ........................................... .. .. .. ...... 39
Gated Recurrent Unit (GRU) ............. 186 R2 (;1c:lE:i~~) ............................ .. .. ....... 82
GPU .................................................... 224 RANSAC (Random Sample Consensus)
Java .................................................... 213 ...... ................................................... 105
Kaggle .................................................. 33 region proposal method ................ ..... 206
Keras ....................................... ........... 221 REINFORCE ....................................... 193
kil:if~;* .............................................. 134 REP (reduced error pruning) ............. 11 5
K- 71~3.::ii~U RMSE (-¥n-¥i$J ::.~~:ii) .................. 82
(K-fold ? [J .Ar\ 1) 7 - :/3 /) ........ 78 RMSprop ............................................ 171
k-¥i$J$ .............................................. 136 R~~ ................................................. 212
L1 :iUIHt ............................................ 107 SAMME .............................................. 11 9
L21U IHt ............................................ 107 Scibids .................................................. 56
Leave-one-out 3t:ii .............................. 79 scikit-learn .......................................... 215
234
~51 Index
235
frl!l ...................................................... 39 .A'T - 1J / 1
/ ...................... .................. 68
~i!fi:~""f)! .......................................... 169 .A~ ·:~ '\'- / 'f ...................................... 121
~re;111~rp,n ...................................... 173 iEM$ (Accuracy) ............................... 84
1il~:7'-.A71 /'} ........................... 122 .iEm71til ............................................... 41
~~i2'!{~tl$ (I~'/ 7 7" 0 1~-T-::,. 3 / ) ~JOCn (Generator) ............................ 200
......................................................... 167 .iEJ!IHt&'J'=•$ ............................... 106
: :] * 7 ::,. 3 =-.A' J.. ................................. 23 ffi!J~-:>~#Jt.- ';1"/":// (RBM) .... 154
)~.g-fi?IJ ............................................... 83 U:ff~71- ............................................. 109
~*6-g-JI (Full Connected Layer) ...... 181
~fj ~'!±:at~ ..................................... 197, 201
jij1j~ =. .:2. -7 Jt.- ;?-. ·:~ 1- '7- 7 (RNN) ~~~* ................................................. 144
..................................... .. .................. 184 91f:lt (;tlj.lj I) ) ............ .. ...... .. ........ ....... 115
jij~lfHz Jt.- ......................... .. .................. 185 *§1*1~1if- ............................................... 94
jijl~$ (Recall) .................................... 84 5l.l!15rPJ RNN (Bidirectional RNN) ........ 187
ijj;Jji_::J!~:$ .......................................... 102 './ 7 1- ::J / 1::".:2.- 7 1 / 'f .................. 27
Jii;Jm{t ................................................. 142 './ 7 1- " - :/ / SVM .......................... 109
iiir:tfftlE: ................. .. .. .. .. .. .................. 126 til~~*!~ ............................ ................. 167
-if"#- t-«7 ~ -"::,. / .................... 108
-if"#- t-«7 1-Jt.-lf!)')i (SVR) ............ 111 1tfi
zlf*1~JH ............................................... 28 ')[- 1- " .A ~ni .................................... 23
~~IJn (Discriminator) ....................... 200 ~1 /XJ...I1iiJ~g:i-J.. .......................... 25
:/~/-Tf ""~~ .................................. 173 ~2/XJ... I 1iiJ~gj'-J.. .......................... 26
Pil~?IJ~HIT .......................................... 130 ~3/XJ...I1illliE7· - J.. .......................... 27
;.~j[;l!jlj)~ ....................................... 37, 138 :k~liii®M .......................................... 170
*J[;O)n}(.~' .......................................... 139 M~:3£fft! ............................................... 68
El c!EJ~ (AR) .................................... 132 M~'li :/ .A 7 J.. ...................................... 164
El c !EJ9if~l!J.!j!.:l$J (ARMA) ................ 132 ~J}'t<t!EJ~; ....... ................................... 104
13 c!EJ9if071~1JJ.!j!.t.$.J (ARIMA) ........ 132 ~11;J:HJ~1i .......................................... 103
El cffiP-11 ............................................. 131 ~~;~ ................................................. 11 7
E1 ~~~~H/11! ...................................... 160 :l:,i~j.}6,i~j.=..:~.-7Jt.-;?.·:~ 1- '7-'7 (CNN)
::E/OC71MIT ...................................... .... 141 .............. ..................................... ...... 180
)i'j{~:jl ...................................... ..... ... ... 166 .!jl.lf!)!)i ................................................. 102
t.UIHI~il .......................................... 141 %i~'J...I1illlm ........................................ 13
::,. / ~.:!. 7 IJ T 1 ................................. 13 =-
71 - :1 .:1. -7 Jt.- ;?-. ·:~ 1- '7- 7 ...... 149
J...I9illliE ............................................... 12 71 -7"7- =./'f ............................. 20
J...I9ill~E 7 1 ·f7 1J ........................... 210 :O::~J1l: ................................................. 148
~111s~ ;?-. ·:~ 1- '7 - 7 (DBN) ........... 154 )i.g-$ (Precision) ............................... 85
fftiE:~ ii (Validation Loss) .................. 87 ~l~~~ ....................................... ...... 174
.A ?l...-f t::' / 'f ( 7 CJ- IJ /-~;1") .......... 64 *1t:ilt .................................... .. .. .. ............ 40
236
~51 Index
............................................. 175
~i\'r.R~IIltl:l 1tiiH'H J!. ............................................. 161
~i\'~? ·:; / .......................................... 182 3Z::Iit~f.J ...................... .. ..................... 162
~i\'r.R.ii: ············································· 20, 45 )t~ft ................. .... .. ............................... 18
~i\'~-~~t ............................................ 45 :lj!f.;J .................................................... 11 7
~i\'1 t!M A.I ~O~~ .................................... 14 :lj!f.;)= * ~f£ ......... ...... ......................... 32
I'" j. 1 /)~ ~ ...................................... 176 «1 ;z'~ ili .......................................... 126
I'" j. 1 ;....)M-&!J ...................... ................ 174 «1 ;z'1i);JM1t ............ ...... ...................... 89
~· Q ·:; /7 rJ r- .................................. 149 /'( 1 ;z'tt:lE .......................................... 126
« 1 ;z'(J):lf:!f ...................................... 127
~rr JJ'#f .......................... .... ........................ 39
.=.l - 7 Jv.::f..·:; t- '7-? .............. 20,1 49 1J'#f1!lllC'Ji. .......................................... 192
;f.. ::t :::J ? .= I- D / ............ .... ............... 155 ;t- Jv 1"7 '7 ~- ~~iE ........ ..................... 78
jtgjj)~ ~ ....... ... ....... .............. .......... ...... 90
./-!'" ............................. .... ........ 14 9, 166 *rr · '('.>fr · srr
""'<' ·:; ? A 7' - 1) ;.... ? (Max Po oling) ... 183
r;;rr "Jv79 :;;z ?~'g' ............................... 177
I ~ - 'E 7 ' f- Q / ........ .... .. . ....... ............ 148 *~~ .......... . ....................... ... ............. 86
l\ 1 1~-l 't 7;t.-9 ....................... 61, 86 ~.=1'1 ·:; 7 ............................................ 75
r\ rJ ;.... 7 1 ;.... ~hf ·:; ? :;;z .................... 204 'E- l"iili:tl .................................... ...... 203
1\=¥;...-'f ............................................. 118 El l'l'iJ!l.!l~ ............................................. 168
iill!Ulli (iU Ht:rli) ...... ...... .................. 106 'E 7 Jv .... ............................... .......... 17,70
1\ ·:; 7 ~~ .......... ...... .. .......................... 74 99~ 'AI~ fiE ........... .. .. ......................... 13
/ ~ 7 j. - 9 ...................... ...................... 16 7 ·:; './@J1i .......................................... 107
.'J'Im1J1!f (oracle) ........ ...... ...................... 92 5«Jvi /:::J-71/'/ ...................... 66
5RfflA.I~ IiE ........................................ 14 5r( J v i-:t~7-9 ................................. 30
~~= mMI'l'iJ? 7 :;;z 9 IJ ;.... 'f ...................... 36 5 ;.... "/ .L. -if- 7 .......... .... ...................... 89
1:::'·:;?7- 9 ........................................ 16 5 ;.... -'j' J.,. 7 ::t 1/ :;;z r- ........................... 120
~~= ~~:X ............................................. 170 Mft1t ................................................... 68
+l~1t ........ ... .. .... ... ............................... 68 ~~1~ ............ .. ..................................... 31
77 1 /7.l-.=;....? ........................ 175 I) •:; :J@Ji; .......................................... 107
7 1 - I" 1\ ·:; ? Jv- / .......................... 99 D V'A7-1·:;?@]~ ........................... 124
·:f- A-7- 1 ;.... ? (boosting) ................ 11 9 Q V' AT 1 ·:; ?~tlt ( :/ 1'-'E 1 ~·~~ )
7· - I- A I- 7 ·:; /'$. ........................... 11 8 ......................... ..... ........................... 124
7' -IJ /1'JI( Pooling l ayer) ........... 181 Q I "i :;;l. I- (iilifi.t) @l ~j ......................... 105
~.J5-1 t (7 :::1 - I") .............................. 197
1<!-J5-1t (.I/:::J - I'") .......................... 197
4mit~tl:l ............................................. 158
1i11.(J)*iil~ (negative transfer) .............. 176
7 1/ -].,.'7 - ? .................................. 2 18
237
L.lJ D i¥~ (-¥> il:: ¢ "5 tc? ~ )
l*:It~1± 7 1' 7" ~ - I / :Y =. 7 o Aidemy Premium Plan 'c: t-3 \,\ -r:, ~
-~~~~~-~~~--~~7D75~/7IDmM~6, -~~
~--~~~~ ~biD•= *~~7~D -7~7~~.
-}:;_~ ~ (;J: =t f::" 1) ~ -1 ID El ltl ~ *i:~fil\i'~ :WI51: l.J -r: \,' tc t, (J) ID, 1~~
238
1ou~-rtt1cVJ6tt
ro +t- ~
.../ l§i{il]t,J:~~-~~<1:~\~t,J: ~.
\, \-:J-c'B C L -c'B~~!m~o
-
.../ ~1JIJ~~tJ~::t:~l'.
:::J- j--:~~2'f.J:tJ~S~-"'~ o
r.l'\ GOOD DESIGN
https://aidemy.net '-"'/ AWARD 2018
~ \:"\,\ *~ 0
https://aidemy-premium.net https://business.aidemy.net
239
• <!Brcj l 11'Strtt!~ ? \,1 T
· c 'l'i fJl l <t*~I<::;;G~ <3"t1. T \- l~ f"l l'\'l~ ll\1 ~ ~'b O)I<:: i!N:;l: <!-ttTc't<:
t;C;'J ;t<t, :<$: W O) f':J ~c /lijf7., QJ tJ: c l c:i[ fc)I<: I;J: -i;lJ;JB *X. " &it
it/uO)" , i!> Stl' G6':> Z: tif<.< t.: <O l l,
· 'iti ~ " <n <:: :!Uc1 l<l: - IJJ:\'!:l:t i~ Wet.; 'J ;J;-ttfum-c\ FAX il':tcl;t'O!fflij
!<: C:: T x ro, ~, ,.g. b tt9i:;J; l'N itl'J<tt 2c l , 'ifJc , c:l'l: rc1 <n ~ lc:
!<tii1<. <:~~ ~ - o;, >zi;;9t oa: f\'J F.G ~_, -c <t;: " \,1 ;);9 ~ -'> Js.!liW -
, ,tLG * " ·
N )tS'J])'!cltc C:'I'ifc, !L i;J:, l' &~W'Jilli£:!<:: io i5' :t 1:'83~ -)!g:i:J
~tLG C::N 'J>t<J~ S 5 :t <J 3 ;J; l' ~- ~if ~~~ ~ & ~c ~
cl it 9 . 'J'. tc, @'@' O)J!Il 8 '< <:: i1l 7E l ' tc tC:l ,td~& l' t>, c: :ii;fi'.
~ NZ~ l'8~ t ~ ~ 'J;'I' tt/u 0 " . M S~ G 6':>27 ~<t.:a c~
<:: K ~ m ~ ~~ • a n.tc®A ~ffi ~ c:• ~~ O) ~ •~nm § ~ ~
l<l: ~ /!3 G ;t tt lu . 'J'.tc , @'@' W: I<t~ -'P!J'I<::f/§.~ cl tc G a: ·; ,