'HW7HNQLVN1DWXUYLGHQVNDEHOLJH )DNXOWHWYHG$DOERUJ8QLYHUVLWHW
(QHYDOXHULQJ
'$10$5.6 (9$/8(5,1*6,167,787
'HW7HNQLVN 1DWXUYLGHQVNDEHOLJH )DNXOWHWYHG$DOERUJ 8QLYHUVLWHW
'DQPDUNV (YDOXHULQJVLQVWLWXW 7U\NWKRV9HVWHU.RSL
(IWHUWU\NPHG NLOGHDQJLYHOVHHUWLOODGW
%HVWLOOHVKRV
GDQPDUNGN 7
+ZZZQHWERJKDQGHOGN
.ULQNOPRPV
,6%1
,QGKROG
)RURUG
,QGOHGQLQJ
)RUPnO
3URMHNWRUJDQLVDWLRQ
3UVHQWDWLRQDIIDNXOWHWHW
0HWRGHRJGRNXPHQWDWLRQVPDWHULDOH
)DNXOWHWHWVVHOYHYDOXHULQJ
,QVWLWXWLRQVEHVJSnIDNXOWHWHW
5HJLVWHUEDVHUHGHXQGHUVJHOVHU
1RWDWSnEDJJUXQGDIGLPLWWHQGXQGHUVJHOVH
5DSSRUWHQVRSE\JQLQJ
5HVXPp
&HQWUDOHDQEHIDOLQJHU
2PDQEHIDOLQJHUQH
5HVXOWDWHU
)DNXOWHWHWVVXFFHVKLVWRULHU
8GGDQQHOVH
)RUVNQLQJ
)DNXOWHWHWVUHVXOWDWHU
8GGDQQHOVH
D )DNXOWHWHWVXGGDQQHOVHVPRGHO
E $QWDOGLPLWWHQGHURJVWXGLHHIIHNWLYLWHW F 8GYLNOLQJDIQ\HXGGDQQHOVHURJQGULQJDIHNVLVWHUHQGH
G ,QWHUQDWLRQDOLVHULQJ
H ,QJHQLUGLPLWWHQGHUVYXUGHULQJDIGHUHVXGGDQQHOVH I 'LPLWWHQGHUQHVEHVNIWLJHOVHVVLWXDWLRQ
J (IWHURJYLGHUHXGGDQQHOVH
$QDO\VHURJYXUGHULQJHU
)RUVNQLQJ
D )DNXOWHWHWVIRUVNQLQJVPLOMHU
E )RUVNQLQJVNYDOLWHW
F )RUVNHUXGGDQQHOVH
G 6DPDUEHMGHPHGYLUNVRPKHGHURJRUJDQLVDWLRQHU
$QDO\VHURJYXUGHULQJHU
6WUXNWXUHURJSURFHVVHU
0nOVWQLQJHURJVWUDWHJL
$QDO\VHURJYXUGHULQJHU
2UJDQLVDWLRQ
5HODWLRQHQPHOOHPIDNXOWHWRJXQLYHUVLWHW
D $QDO\VHURJYXUGHULQJHU
2UJDQLVDWLRQVVWUXNWXU
D $QDO\VHURJYXUGHULQJHU
)DNXOWHWHWVOHGHOVH
/HGHOVHVSULQFLSSHU
D ,QWHUQHIRUGHOLQJVSULQFLSSHU
E )RUGHOLQJDIIRUVNQLQJVnUVYUN
$QDO\VHURJYXUGHULQJHU
.YDOLWHWVVLNULQJ
D 8GGDQQHOVH
E )RUVNHUXGGDQQHOVH
F )RUVNQLQJ
$QDO\VHURJYXUGHULQJHU
5HVVRXUFHU
NRQRPL
6DPILQDQVLHULQJ
$QDO\VHURJYXUGHULQJHU
6WXGHUHQGH
3HUVRQDOH
$QDO\VHURJYXUGHULQJHU
)\VLVNHUHVVRXUFHU
$SSHQGLNV
$SSHQGLNV$3UVHQWDWLRQDIHYDOXHULQJVJUXSSHQ
$SSHQGLNV%2YHUVLJWRYHULQVWLWXWWHUXGGDQQHOVHURJFHQWUH
$SSHQGLNV&)RUWHJQHOVHRYHUDQYHQGWPDWHULDOH
5DSSRUWHUIUD(9$
)RURUG
'HQQHUDSSRUWLQGHKROGHUHQHYDOXHULQJDI'HW7HNQLVN1DWXUYLGHQVNDEHOLJH)DNXOWHWYHG$DOERUJ 8QLYHUVLWHW(YDOXHULQJHQHUJHQQHPIUWLHWVDPDUEHMGHPHOOHPHYDOXHULQJVJUXSSHQIDNXOWHWHWRJ 'DQPDUNV(YDOXHULQJVLQVWLWXW(9$(YDOXHULQJHQLQGJnUVRPHQGHODI(9$ªVKDQGOLQJVSODQIRUnU RJHUJHQQHPIUWLSHULRGHQDXJXVWWLOVHSWHPEHU
'DQPDUNV(YDOXHULQJVLQVWLWXWHUHQVHOYVWQGLJLQVWLWXWLRQXQGHU8QGHUYLVQLQJVPLQLVWHULHW'HWHU LQVWLWXWWHWVIRUPnODWPHGYLUNHWLODWVLNUHRJXGYLNOHNYDOLWHWHQDIXGGDQQHOVHRJXQGHUYLVQLQJSn DOOHQLYHDXHUL'DQPDUN
(YDOXHULQJHQDI'HW7HNQLVN1DWXUYLGHQVNDEHOLJH)DNXOWHWHU(9$ªVIUVWHIDNXOWHWVHYDOXHULQJRJHU GHUIRUJHQQHPIUWVRPHQSLORWHYDOXHULQJ6RPRSIOJQLQJSnHYDOXHULQJHQXGDUEHMGHU(9$PHG LQGGUDJHOVHDIHYDOXHULQJVJUXSSHQRJIDNXOWHWHWHWPHWRGHKIWHRPIDNXOWHWVHYDOXHULQJHU
'HWHU(9$ªVIRUYHQWQLQJDWUDSSRUWHQYLOGDQQHJUXQGODJIRU'HW7HNQLVN1DWXUYLGHQVNDEHOLJH )DNXOWHWVIRUWVDWWHDUEHMGHPHGDWNYDOLWHWVXGYLNOHVLQRUJDQLVDWLRQRJYLUNVRPKHGRJDWGHQ GHUXGRYHUYLOLQVSLUHUHDQGUHIDNXOWHWHURJXQLYHUVLWHWHUWLOHQGLVNXVVLRQRPRUJDQLVDWLRQRJ OHGHOVHDIIDNXOWHWHU
*HUW%HFKOXQG &KULVWLDQ7KXQH
)RUPDQGIRUHYDOXHULQJVJUXSSHQ 'LUHNWU
,QGOHGQLQJ
(YDOXHULQJHQDI'HW7HNQLVN1DWXUYLGHQVNDEHOLJH)DNXOWHWYHG$DOERUJ8QLYHUVLWHWEOHYLJDQJVDW VRPHQGHODI(9$ªVKDQGOLQJVSODQIRU'HWHUIUVWHJDQJGHUL'DQPDUNJHQQHPIUHVHQ HYDOXHULQJDIHWIDNXOWHW'HUIRUHUHYDOXHULQJHQJHQQHPIUWVRPHWSLORWSURMHNW
)RUPnO
)RUPnOHWPHGHYDOXHULQJHQHUDWYXUGHUHKYRUGDQ'HW7HNQLVN1DWXUYLGHQVNDEHOLJH)DNXOWHW KHUHIWHUIDNXOWHWHWOVHUVLQRSJDYHVRPRYHURUGQHWDQVYDUOLJIRUGHWHNQLVNQDWXUYLGHQVNDEHOLJH LQVWLWXWWHUVRJVWXGLHQYQVIRUVNQLQJRJXGGDQQHOVHUVDPWIRUPLGOLQJMIXQLYHUVLWHWVORYHQ
VWN'HWHUVnOHGHVIRUPnOHWGHOVDWYXUGHUHIDNXOWHWHWVHYQHWLODWRSE\JJHRJXGYLNOHUDPPHU IRUVLQRUJDQLVDWLRQRJYLUNVRPKHGGHOVDWYXUGHUHHQNHOWHGHOHDIIDNXOWHWHWVYLUNVRPKHG¥
SULPUWXGGDQQHOVHRJIRUVNQLQJ
,HYDOXHULQJHQLQGJnUGHUIRUVnYHOHQYXUGHULQJDIIDNXOWHWHWLVLQKHOKHGVRPDIHQNHOWGHOHQH UHSUVHQWHUHWYHGXGYDOJWHLQVWLWXWWHUVWXGLHQYQPY.YDOLWHWHQDIHQNHOWGHOHQHVNDOVHVL IRUKROGWLOGHUHVSODFHULQJRJUROOHLIDNXOWHWHWVKHOKHG(YDOXHULQJHQIRNXVHUHUVnOHGHVLNNHSn HQNHOWIRUVNHUHOOHUHQNHOWXGGDQQHOVHVQLYHDX
3URMHNWRUJDQLVDWLRQ
(9$KDUQHGVDWHQHYDOXHULQJVJUXSSHGHUKDUDQVYDUHWIRUHYDOXHULQJHQVDQDO\VHUYXUGHULQJHURJ DQEHIDOLQJHU(YDOXHULQJVJUXSSHQKDUIOJHQGHVDPPHQVWQLQJ
• 8QLYHUVLWHWVGLUHNWU*HUW%HFKOXQG+DQGHOVKMVNROHQL.EHQKDYQIRUPDQG
• 5HNWRUSURIHVVRU$QGHUV)ORGVWU|P.XQJOLJD7HNQLVND+|JVNRODQ
• 3URIHVVRU6XVDQ-DJQHU&KDOPHUVWHNQLVNDK|JVNROD
• 'RFHQW9HUQHU&3HWHUVHQ+DQGHOVKMVNROHQLcUKXV
• 'LUHNWU$OODQ)LVFKHU0DGVHQ6,7,&20*URXS)LVFKHU /RUHQ]$6XGWUnGWDIJUXSSHQPDUWV
'HVXGHQHUGHUQHGVDWHQSURMHNWJUXSSHVRPKDUGHWSUDNWLVNHDQVYDUIRUHYDOXHULQJHQV
JHQQHPIUHOVHKHUXQGHUDQVYDUHWIRUDWVW\UHGRNXPHQWDWLRQVPDWHULDOHWVXGDUEHMGHOVHRJIRUDW YDUHWDJHNRQWDNWHQPHOOHPHYDOXHULQJVJUXSSHQRJIDNXOWHWHW3URMHNWJUXSSHQKDUWLOOLJHGHW PHWRGHPVVLJHDQVYDULSURFHVVHQRJJUXSSHQKDUIRUHVWnHWXGDUEHMGHOVHQDI
HYDOXHULQJVUDSSRUWHQ3URMHNWJUXSSHQEHVWnUDIHYDOXHULQJVNRQVXOHQWHUQH$QQH.DWKULQH0DQGUXS RJ7RELDV/LQGHEHUJVDPWHYDOXHULQJVPHGDUEHMGHU7LQH.U\JHU%URH
3UVHQWDWLRQDIIDNXOWHWHW
)DNXOWHWHWEOHYRSUHWWHWLVRPHQGHODI$DOERUJ8QLYHUVLWHWLQGWLO$DOERUJ 8QLYHUVLWHWVFHQWHURJIXVLRQHUHGHLPHG,QJHQLUKMVNROHQ(VEMHUJ$DOERUJ8QLYHUVLWHW (VEMHUJKXVHUQX,QVWLWXWIRU.HPLRJ$QYHQGW,QJHQLUYLGHQVNDEVRPHQGHODIIDNXOWHWHW
2UJDQLVDWRULVNHU$$8RSGHOWLWUHIDNXOWHWHUpWKXPDQLVWLVNpWVDPIXQGVYLGHQVNDEHOLJWRJpW WHNQLVNQDWXUYLGHQVNDEHOLJWHWXQLYHUVLWHWVELEOLRWHNVDPWHQFHQWUDODGPLQLVWUDWLRQGHUEODQGW DQGHWRPIDWWHUIDNXOWHWVDGPLQLVWUDWLRQHUQHRJHQUNNHDQGUHIXQNWLRQHUKHUXQGHUHW QHWYUNVFHQWHURJHWLQWHUQDWLRQDOWNRQWRU
8GGDQQHOVHVPVVLJWHU$$8NHQGHWHJQHWYHGSUREOHPRULHQWHULQJSURMHNWRUJDQLVHULQJRJ JUXSSHDUEHMGH'RJHUGHUIRUVNHOOHIDNXOWHWHUQHLPHOOHPPHGKHQV\QWLOWLOUHWWHOJJHOVHQDI XGGDQQHOVHUQHRJXGPQWQLQJHQDIXGGDQQHOVHVPRGHOOHQ'HVXGHQOJJHVGHUYJWSnWW NRQWDNWPHGGHWRPJLYHQGHVDPIXQG6WXGHUHQGHYHGIDNXOWHWHWNDQYOJHDWOVHWLO
GLSORPLQJHQLUQDWXUYLGHQVNDEHOLJEDFKHORU%6FQDWXUYLGHQVNDEHOLJNDQGLGDWFDQGVFLHQW FLYLOLQJHQLUFDQGSRO\WHOOHUODQGLQVSHNWUFDQGJHRP)RUHQVDPOHWIRUWHJQHOVHRYHU XGGDQQHOVHUVHDSSHQGLNV%
)DNXOWHWHWEHGULYHUIRUVNQLQJLQGHQIRUHQODQJUNNHWHNQLVNRJQDWXUYLGHQVNDEHOLJH
IDJRPUnGHU)RUVNQLQJHQHURUJDQLVHUHWLLQVWLWXWWHURJHWDQWDOIRUVNQLQJVFHQWUH)DNXOWHWHW GNNHUDOOHGHWUDGLWLRQHOOHWHNQLVNYLGHQVNDEHOLJHIDJRPUnGHURJHQUNNHQDWXUYLGHQVNDEHOLJH IDJRPUnGHU
)DNXOWHWHWKDUKDIWHQVWLJQLQJLRSWDJHWDIVWXGHUHQGHIUDRSWDJQHLWLOL'HW VYDUHUWLOHQVWLJQLQJSn
,SHULRGHQIUDWLOHUGHUVNHWHQVWLJQLQJLDQWDOOHWDIYLGHQVNDEHOLJWSHUVRQDOH
DGMXQNWHUOHNWRUHURJSURIHVVRUHUIUDWLO'HWVYDUHUWLOHQVWLJQLQJSn9NVWHQHU VNHWLQGHQIRUDGMXQNWRJSURIHVVRUJUXSSHQPHQVDQWDOOHWDIOHNWRUHUKDUYUHWUHODWLYWVWDELOW
2JVnIDNXOWHWHWVEHYLOOLQJHUHUVWHJHW,SHULRGHQIUDWLOHUEHYLOOLQJHUQHVWHJHWIUD PLOOLRQHUNUWLOPLOOLRQHUNUVYDUHQGHWLOHQVWLJQLQJSn
0HWRGHRJGRNXPHQWDWLRQVPDWHULDOH
(YDOXHULQJHQHUJHQQHPIUWVRPHWSLORWSURMHNW'HWKDUEODQGWDQGHWEHW\GHWDW(9$LQYLWHUHGH DOOHGDQVNHIDNXOWHWHUWLODWGHOWDJH3nGHQQHEDJJUXQGPHOGWH'HW7HNQLVN1DWXUYLGHQVNDEHOLJH )DNXOWHWVLJIULYLOOLJWWLOHYDOXHULQJHQ
(IWHUPDQJHnUVHUIDULQJPHGXGGDQQHOVHVHYDOXHULQJHURJGHUPHGHYDOXHULQJDIHQNHOWGHOHYDUGHW (9$ªVQVNHDWHYDOXHUHHQVDPOHWRUJDQLVDWRULVNHQKHG)DNXOWHWVQLYHDXHWEOHYYDOJWXGIUDHQ EHWUDJWQLQJRPDWHQVnGDQHYDOXHULQJYLOOHJLYHPXOLJKHGIRUDWHYDOXHUHVnYHOGHRUJDQLVDWRULVNH UDPPHUIRUIRUVNQLQJRJXGGDQQHOVHVRPGHQVDPOHGHIDJOLJHSURILORJDNWLYLWHW,QWHUQDWLRQDOWHU GHUNXQEHJUQVHGHHUIDULQJHUPHGHNVWHUQWLQLWLHUHGHIDNXOWHWVHYDOXHULQJHU6RPUHJHOHUHQ HYDOXHULQJGHULQGGUDJHUGHRUJDQLVDWRULVNHRJOHGHOVHVPVVLJHUDPPHUJHQQHPIUWVRPHQ HYDOXHULQJDIKHOHLQVWLWXWLRQHQ
(YDOXHULQJHQHUJHQQHPIUWLRYHUHQVVWHPPHOVHPHGGHQPRGHOIRUHYDOXHULQJGHUHURSQnHW HQLJKHGRPSnHXURSLVNSODQJHQQHP(14$(XURSHDQ1HWZRUNIRU4XDOLW\$VVXUDQFH
0RGHOOHQLQNOXGHUHUHQXDIKQJLJHYDOXHULQJVJUXSSHNUDYRPVHOYHYDOXHULQJRJLQVWLWXWLRQVEHVJ VDPWHQRIIHQWOLJUDSSRUWRJHUVnOHGHVLRYHUHQVVWHPPHOVHPHG(9$ªVORYJUXQGODJ
(YDOXHULQJHQVSULPUHGRNXPHQWDWLRQVPDWHULDOHRPIDWWHU
• )DNXOWHWHWVVHOYHYDOXHULQJ
• ,QVWLWXWLRQVEHVJSnIDNXOWHWHW
• 5HJLVWHUEDVHUHGHXQGHUVJHOVHUDIKHQKROGVYLVWRVWXGHQWHURJGLPLWWHQGnUJDQJHIUDIDNXOWHWHW
• 1RWDWSnEDJJUXQGDIGLPLWWHQGXQGHUVJHOVHJHQQHPIUWDI,QJHQLUIRUHQLQJHQL'DQPDUN
'HUXGRYHUKDUIDNXOWHWHWVWLOOHWHWEHW\GHOLJWELODJVPDWHULDOHWLOUnGLJKHGIRUHYDOXHULQJVJUXSSHQV DUEHMGHVHDSSHQGLNV&(QGYLGHUHKROGWHYDOXHULQJVJUXSSHQIRUXGIRULQVWLWXWLRQVEHVJHWPGH PHGUHSUVHQWDQWHUIRU7HNQLVN8GGDQQHOVHVUnG7851DWXUYLGHQVNDEHOLJW8GGDQQHOVHVUnG185 RJ6WDWHQV7HNQLVN9LGHQVNDEHOLJH)RUVNQLQJVUnG679)(QGHOLJKDU)RUVNQLQJVXGGDQQHOVHVUnGHWV VHNUHWDULDWOHYHUHWRSO\VQLQJHURPGHQXGGDQQHOVHVPVVLJHEDJJUXQGIRUGHSKGVWXGHUHQGH GHUEOHYLQGVNUHYHWYHGIDNXOWHWHWLSHULRGHQ¥
)DNXOWHWHWVVHOYHYDOXHULQJ
)DNXOWHWHWKDUJHQQHPIUWHQVHOYHYDOXHULQJVRPOHGLHYDOXHULQJHQ6HOYHYDOXHULQJHQEHVWnUDIHQ FHQWUDORJHQGHFHQWUDOGHO8GDUEHMGHOVHQDIGHQFHQWUDOHGHOKDUYUHWIRUDQNUHWLGHNDQDWHWRJ IDNXOWHWVNRQWRUHWPHQVGHQGHFHQWUDOHGHOEHVWnUDIELGUDJIUDRWWHIRUVNHOOLJHGHFHQWUDOH HQKHGHU,QVWLWXWIRU'DWDORJL,QVWLWXWIRU(QHUJLWHNQLN,QVWLWXWIRU9DQG-RUGRJ0LOMWHNQLN 6WXGLHQYQIRU(OHNWURQLNRJ,QIRUPDWLRQVWHNQRORJL6WXGLHQYQIRU/DQGLQVSHNWURJ
3ODQOJQLQJ6WXGLHQYQIRU$UNLWHNWXURJ'HVLJQ&HQWHUIRU6DQVH0RWRULVN,QWHUDNWLRQRJ7KH ,QWHUQDWLRQDO'RFWRUDO6FKRRORI7HFKQRORJ\DQG6FLHQFH'HRWWHHQKHGHUEOHYXGYDOJWDI IDNXOWHWHWLVDPDUEHMGHPHG(9$'HWHUWLOVWUEWDWGHRWWHHQKHGHUVDPOHWDIVSHMOHUIDNXOWHWHWV DNWLYLWHWHURJSURILO
(YDOXHULQJVJUXSSHQRJ(9$KDUXGDUEHMGHWHQYHMOHGQLQJWLOVHOYHYDOXHULQJGHUKDUGDQQHW JUXQGODJIRUVHOYHYDOXHULQJHQ9HMOHGQLQJHQLQGHKROGWIOJHQGHWHPDHUUHVXOWDWHUPnOVWQLQJHU RJIDJOLJSURILOUHVVRXUFHURUJDQLVDWLRQRJOHGHOVHVDPDUEHMGHNHUQH\GHOVHURJHQVDPOHW YXUGHULQJ,YHMOHGQLQJHQHUGHWDQIUWKYLONHVSUJVPnOGHUQVNHVEHVYDUHWDIGHWFHQWUDOH IDNXOWHWVQLYHDXRJGHGHFHQWUDOHHQKHGHU8GJDQJVSXQNWHWIRUGHQQHRSGHOLQJHUDWGHWFHQWUDOH IDNXOWHWVQLYHDXKDUVNXOOHEHVYDUHVSUJVPnORPIRUKROGGHUYHGUUHUKHOHIDNXOWHWHWRJGH GHFHQWUDOHHQKHGHUVSUJVPnOGHUHUNQ\WWHWWLOKHQKROGVYLVIRUVNQLQJRJXGGDQQHOVH
)DNXOWHWHWYDOJWHDWXGDUEHMGHVHOYHYDOXHULQJHQGHOYLVWHIWHUHWWLOIRUPnOHWRSVWLOOHWPnOPLGGHO KLHUDUNLRJGHOYLVWHIWHUYHMOHGQLQJHQWLOVHOYHYDOXHULQJ'HWWHKDUJMRUWGHWYDQVNHOLJHUHDWILQGH EHVYDUHOVHUQHSnHYDOXHULQJVJUXSSHQVVSUJVPnOLVHOYHYDOXHULQJVUDSSRUWHQ6DPWLGLJHUGHW HYDOXHULQJVJUXSSHQVRSIDWWHOVHDWXGYLNOLQJHQDIPnOPLGGHOKLHUDUNLHWVDWWH\GHUOLJHUHSUHVSnHQL IRUYHMHQVWUDPWLGVSODQIRUVHOYHYDOXHULQJHQKYLONHWEODQGWDQGHWILNGHQEHW\GQLQJDWGHOHDI VHOYHYDOXHULQJVUDSSRUWHQHUVNUHYHWDIHQNHOWSHUVRQHUXGHQLQGGUDJHOVHDIUHOHYDQWHJUXSSHU3n WURGVDIGHWWHHUGHWYXUGHULQJHQDWVHOYHYDOXHULQJHQVDPOHWVHWHUHWYVHQWOLJWELGUDJWLO
HYDOXHULQJHQVGRNXPHQWDWLRQVPDWHULDOH'HWVN\OGHVLNNHPLQGVWDWGHIRUVNHOOLJHV\QVYLQNOHULGHW FHQWUDOHRJGHGHFHQWUDOHELGUDJJLYHUHQJRGLQGVLJWLIDNXOWHWHWVIRUVNQLQJXGGDQQHOVHRJ RUJDQLVHULQJ
,QVWLWXWLRQVEHVJSnIDNXOWHWHW
(YDOXHULQJVJUXSSHQRJSURMHNWJUXSSHQJHQQHPIUWHHWWUHGDJHVLQVWLWXWLRQVEHVJSnIDNXOWHWHW )RUPnOHWPHGEHVJHWYDUDWXGG\EHRJYDOLGHUHGHWYULJHGRNXPHQWDWLRQVPDWHULDOH3nEHVJHW EOHYGHUKROGWPGHUPHGEODQGWDQGHWIDNXOWHWHWVOHGHOVHXQLYHUVLWHWHWVOHGHOVHVWXGLHOHGHUH LQVWLWXWOHGHUHIRUVNHUHVWXGHUHQGHSKGVWXGHUHQGHWHNQLVNDGPLQLVWUDWLYWSHUVRQDOHRJ HNVWHUQHVDPDUEHMGVSDUWHU%HVJHWRPIDWWHGHGHVXGHQHQUXQGWXUSnIDNXOWHWHW
,QVWLWXWLRQVEHVJHWKDUYUHWYVHQWOLJWIRUDWJLYHLQGEOLNLIRUVNHOOLJHJUXSSHUVRSIDWWHOVHDI IRUKROGHQHYHGIDNXOWHWHW
5HJLVWHUEDVHUHGHXQGHUVJHOVHU
3nEDJJUXQGDIVUNUVOHUIUD'DQPDUNV6WDWLVWLNKDU(9$ªVGDWDHQKHGXGDUEHMGHWHQ XQGHUVJHOVHDIGHVWXGHUHQGHYHGIDNXOWHWHWRJHQXQGHUVJHOVHDIGLPLWWHQGHUQHV DUEHMGVPDUNHGVIRUKROG
6WXGHQWHUXQGHUVJHOVHQLQGGUDJHURSO\VQLQJHURPVWXGLHVNLIWDIEUXGRJJHQQHPIUHOVHIRUGH VWXGHUHQGHLPPDWULNXOHUHWSnIDNXOWHWHWLRJ2SO\VQLQJHUQHHUVDPPHQKROGWPHG NQDOGHUXGGDQQHOVHVEDJJUXQGRJERSOWRnUIUVWXGLHVWDUW6WXGLHVWDWXVHUIRUEHJJH nUJDQJHRSJMRUWLnU
'LPLWWHQGXQGHUVJHOVHQEHVNULYHUEHVNIWLJHOVHVRJOQIRUKROGIRUGLPLWWHQGHUIUDRJ )RUEHJJHnUJDQJHHUGHVHQHVWHRSO\VQLQJHURSJMRUWLLGHW'DQPDUNV6WDWLVWLNV UHJLVWUHLNNHUnGHURYHUQ\HUHWDO8QGHUVJHOVHQLQGGUDJHURSO\VQLQJHURPVRFLRNRQRPLVNVWDWXV OHGLJKHGVJUDGDQVWWHOVHVRPUnGHEUDQFKHWLONQ\WQLQJJHRJUDILVNSODFHULQJDIDUEHMGVVWHGRJ EUXWWRLQGNRPVW5DSSRUWHQLQGHKROGHUGHVXGHQHQEHVNULYHOVHDIEHVNIWLJHOVHVVLWXDWLRQHQRJ OQIRUKROGIRUSKGHUGLPLWWHUHWLRJ
'HWHUHYDOXHULQJVJUXSSHQVRSIDWWHOVHDWGHUHJLVWHUEDVHUHGHXQGHUVJHOVHUKDUEHO\VWFHQWUDOH NYDQWLILFHUEDUHSUREOHPVWLOOLQJHU
1RWDWSnEDJJUXQGDIGLPLWWHQGXQGHUVJHOVH
6RPOHGLXGDUEHMGHOVHQDIHYDOXHULQJHQVGRNXPHQWDWLRQVPDWHULDOHKDU(9$XGIUGLJHWHWQRWDW SnEDJJUXQGDIHQVSUJHVNHPDXQGHUVJHOVHIRUHWDJHWDI3/65DPEOOIRU,QJHQLUIRUHQLQJHQL 'DQPDUN,'$(9$KDUPHGWLOODGHOVHIUD,'$RJ$$8KDIWDGJDQJWLOGHOHDIXQGHUVJHOVHQV WDEHOPDWHULDOHPHGVYDUIUDGHQVDPOHGHSRSXODWLRQRJIUDGLPLWWHQGHUIUD$$8'LPLWWHQGHUQHIUD
$$8HUIRUGHOWSnGLSORPLQJHQLUHURJFLYLOLQJHQLUHU7DEHOPDWHULDOHWKDUDOHQHYUHW WLOJQJHOLJWLSDSLUIRUP
5DSSRUWHQVRSE\JQLQJ
8GRYHUGHWWHLQGOHGQLQJVNDSLWHOLQGHKROGHUUDSSRUWHQILUHNDSLWOHU.DSLWHOUXPPHUHWUHVXPpDI UDSSRUWHQ,GHHIWHUIOJHQGHWUHNDSLWOHUEHVNULYHVDQDO\VHUHVRJYXUGHUHVIDNXOWHWHWVRUJDQLVDWLRQ RJYLUNVRPKHG,NDSLWHOEHKDQGOHVIDNXOWHWHWVUHVXOWDWHUPHGDIVWLIDNXOWHWHWVVXFFHVKLVWRULHU 'HUHIWHUEHKDQGOHVGHVWUXNWXUHURJSURFHVVHUGHUOLJJHUWLOJUXQGIRUUHVXOWDWHUQHLNDSLWHO .DSLWOHWHUGHOWRSLILUHXQGHUDIVQLWRPKHQKROGVYLVPnOVWQLQJHURJVWUDWHJLRUJDQLVDWLRQOHGHOVH
RJNYDOLWHWVVLNULQJ(QGHOLJEHKDQGOHVLNDSLWHOGHUHVVRXUFHUIDNXOWHWHWUnGHURYHULIRUPDI
NRQRPLVNHUHVVRXUFHUVWXGHUHQGHSHUVRQDOHRJI\VLVNHIDFLOLWHWHU
0HGGHQQHVWUXNWXUHUGHWKHQVLJWHQDWWDJHDIVWLIDNXOWHWHWVUHVXOWDWHUIRUGHUHIWHUDW
XQGHUVJHJUXQGODJHWIRUDWIUHPEULQJHGLVVHUHVXOWDWHU(YDOXHULQJVJUXSSHQKDUVUOLJWQVNHWDW WDJHWDIVWLVXFFHVKLVWRULHUQHIRUGLGLVVHHUHQYLJWLJNLOGHWLODWIRUVWnKYRUGDQIDNXOWHWHW
IXQJHUHU*UXQGODJHWIRUDWIUHPEULQJHUHVXOWDWHUQHDQDO\VHUHVGHOVYHGDWEHO\VHIDNXOWHWHWV RUJDQLVDWRULVNHDSSDUDWLIRUPDIGHVWUXNWXUHURJSURFHVVHUIDNXOWHWHWDQYHQGHULIRUELQGHOVHPHG IUHPEULQJHOVHQDIUHVXOWDWHUQHGHOVYHGDWVHSnGHUHVVRXUFHUIDNXOWHWHWUnGHURYHU
5DSSRUWHQVDIVQLWHUVWUXNWXUHUHWVnOHGHVDWGHUIUVWHUHWGHODIVQLWKYRUIDNXOWHWVSUVHQWDWLRQ JHQJLYHVOR\DOWPRGVHOYHYDOXHULQJHQ'HUHIWHUIOJHUHWGHODIVQLWKYRUHYDOXHULQJVJUXSSHQV DQDO\VHUYXUGHULQJHURJDQEHIDOLQJHUIUHPOJJHV
5DSSRUWHQLQGHKROGHUGHVXGHQDSSHQGLNVHU
5HVXPp
)RUPnOHWPHGHYDOXHULQJHQDI'HW7HNQLVN1DWXUYLGHQVNDEHOLJH)DNXOWHWYHG$DOERUJ8QLYHUVLWHWHU DWYXUGHUHKYRUGDQIDNXOWHWHWOVHUVLQRSJDYHVRPRYHURUGQHWDQVYDUOLJIRUGHWHNQLVN
QDWXUYLGHQVNDEHOLJHLQVWLWXWWHUVRJVWXGLHQYQVIRUVNQLQJXGGDQQHOVHRJIRUPLGOLQJ'HWHU VnOHGHVIRUPnOHWGHOVDWYXUGHUHIDNXOWHWHWVHYQHWLODWRSE\JJHRJXGYLNOHKHQVLJWVPVVLJH UDPPHUIRUVLQRUJDQLVDWLRQRJYLUNVRPKHGGHOVDWYXUGHUHHQNHOWHGHOHDIIDNXOWHWHWVYLUNVRPKHG
¥SULPUWXGGDQQHOVHRJIRUVNQLQJ
(YDOXHULQJHQE\JJHUEODQGWDQGHWSnIDNXOWHWHWVVHOYHYDOXHULQJHWEHVJSnIDNXOWHWHWDIWUHGDJHV YDULJKHGVDPWUHJLVWHUEDVHUHGHXQGHUVJHOVHUDIVWXGLHHIIHNWLYLWHWRJGLPLWWHQGHUQHV
EHVNIWLJHOVH(YDOXHULQJVJUXSSHQKDUYDOJWDWEUXJHIDNXOWHWHWVVUOLJWJRGHUHVXOWDWHUHOOHU VXFFHVKLVWRULHUVRPDIVWIRUWLOUHWWHOJJHOVHQDIHYDOXHULQJHQ
'HW7HNQLVN1DWXUYLGHQVNDEHOLJH)DNXOWHWKDURYHURUGQHWVHWHQYHOIXQJHUHQGHOHGHOVHRJKDU RSQnHWJRGHUHVXOWDWHULVUSnXGGDQQHOVHVRPUnGHW6nOHGHVNDQGHUSnXGGDQQHOVHVRPUnGHW LGHQWLILFHUHVVUOLJYHOGRNXPHQWHUHGHUHVXOWDWHUHOOHUVXFFHVKLVWRULHU3nIRUVNQLQJVRPUnGHWHUGHU VXFFHVSnQRJOHRPUnGHUPHQIRUVNQLQJHQIUHPVWnULNNHVRPHQVXFFHVKLVWRULHLVDPPHJUDGVRP XGGDQQHOVHVRPUnGHW
)DNXOWHWHWVRUJDQLVDWLRQRJYLUNVRPKHGHURYHURUGQHWNHQGHWHJQHWYHG
• HQOHGHOVHGHUHUDNWLYRJLQLWLDWLYVNDEHQGHRJVRPQ\GHUEUHGRSEDNQLQJLRUJDQLVDWLRQHQ
• HQUHVVRXUFHDOORNHULQJVPRGHOGHUPHGHQKMJUDGDIDXWRPDWLNIRUGHOHUPLGOHUSnEDJJUXQGDI DNWLYLWHW
• EUHGRSEDNQLQJEODQGWVnYHOXQGHUYLVHUHVRPVWXGHUHQGHWLOGHQSUREOHPRULHQWHUHGH
SURMHNWRUJDQLVHUHGHVWXGLHIRUPRJWLOGHQRULHQWHULQJPRGRPYHUGHQHQGHUSUJHUIDNXOWHWHW
• KMVWXGLHHIIHNWLYLWHWKMEHVNIWLJHOVHVJUDGRJWLOIUHGVHGLPLWWHQGHU
• HQEHW\GHOLJGHOHJDWLRQDINRPSHWHQFHWLOVWXGLHQYQRJLQVWLWXWWHU
'HUVHVVDPWLGLJXGYLNOLQJVPXOLJKHGHUSnHQUNNHRPUnGHUVRPGHWEODQGWDQGHWIUHPJnUDI DQEHIDOLQJHUQHQHGHQIRU
&HQWUDOHDQEHIDOLQJHU
)DNXOWHWHWKDUXGYLNOHWHQXGGDQQHOVHVPRGHOGHUJUXQGOJJHQGHHUIRUPnOVWMHQOLJVHWLIRUKROGWLO IDNXOWHWHWVSURILO,NNHPLQGVWHUGHURSQnHWHWYHOIXQJHUHQGHVDPVSLOPHOOHPXGGDQQHOVHURJ HUKYHUYVOLYHW3nIDNXOWHWHWHUEnGHXQGHUYLVHUHRJVWXGHUHQGHNRPPHWPHGIRUVODJWLOWLOSDVQLQJHU DIXGGDQQHOVHVPRGHOOHQ5DSSRUWHQDQEHIDOHUDWIDNXOWHWHWEUXJHUHYDOXHULQJHQVRPHQDQOHGQLQJ WLOHQV\VWHPDWLVNJHQQHPJDQJDIXGGDQQHOVHVPRGHOOHQPHGKHQEOLNSnDWYLGHUHXGYLNOHGHQ
0HGKHQV\QWLOIRUVNQLQJHQHUGHWYLJWLJWIRUIDNXOWHWHWVIRUWVDWWHXGYLNOLQJDWJHIRUVWnHOVHQIRU nUVDJHUWLORJYLONnUIRUGHQIRUVNQLQJVPVVLJHVXFFHV%nGHQnUGHWJOGHUIRUVNQLQJRJQnUGHW JOGHUXGGDQQHOVHKDUIDNXOWHWHWYDOJWHQVWUDWHJLGHUDIYLJHUIUDHQWUDGLWLRQHOWLOJDQJSn XQLYHUVLWHWVRPUnGHW3nXGGDQQHOVHVRPUnGHWHUGHUHWKMWEHYLGVWKHGVQLYHDXLIRUKROGWLO XGGDQQHOVHVPRGHOOHQVVW\UNHU'HQQHIRUVWnHOVHHNVLVWHUHULNNHLVDPPHRPIDQJSn
IRUVNQLQJVRPUnGHW'HUIRUDQEHIDOHUUDSSRUWHQDWIDNXOWHWHWDUEHMGHUDNWLYWSnDWRSQnHQJHW IRUVWnHOVHDIGHWVUHJQHYHGIRUVNQLQJVPLOMHWSnIDNXOWHWHWKHUXQGHUKYLONHQPnGHGHWWHKDU PHGYLUNHWWLOGHVXFFHVHUIDNXOWHWHWKDUNXQQHIUHPYLVHSnRPUnGHW
'HUIRUHJnUHQYLJWLJXIRUPHOVWUDWHJLSURFHVSnIDNXOWHWHWVRPHUDIJUHQGHIRUDWIDNXOWHWHWNDQ IXQJHUHVnG\QDPLVNVRPGHWHUWLOIOGHW)DNXOWHWHWDUEHMGHUWLOJHQJOGNXQLEHJUQVHWRPIDQJ PHGHQPHUHV\VWHPDWLVHUHWVWUDWHJLSURFHVI[LIRUPDIEHVNULYHOVHUDIRPYHUGHQHQ5DSSRUWHQ DQEHIDOHUIDNXOWHWHWDWJLYHSODGVWLOnEQHGLVNXVVLRQHURPKYRUIDNXOWHWHWEHYJHUVLJKHQ'HW VN\OGHVLNNHPLQGVWDWIDNXOWHWHWLGHNRPPHQGHnUWLOV\QHODGHQGHVWLOOHVRYHUIRUHQUNNH DIJUHQGHYDOJPHGKHQV\QWLOGHQYLGHUHXGYLNOLQJDIGHQIDJOLJHSURILO
'HQLQWHUQHPRGHOIRUIRUGHOLQJDIUHVVRXUFHUKDUNDUDNWHUDIHQSUVWDWLRQVPRGHOGHUNQ\WWHU EHYLOOLQJHUVDPPHQPHGDNWLYLWHWHU0RGHOOHQHULVLJVHOYHWOHGHOVHVLQVWUXPHQWVRPHUDI DIJUHQGHEHW\GQLQJIRUGHQEHW\GHOLJHG\QDPLNGHUHUSnIDNXOWHWHW3nIRUVNQLQJVRPUnGHW NREOHVLQVWLWXWWHUQHVEHYLOOLQJHUWLORPIDQJHWRJNYDOLWHWHQDIGHUHVIRUVNQLQJ,QGIUHOVHQDI EHYLOOLQJVPRGHOOHQKDUSnGHQHQHVLGHELGUDJHWWLODWVW\UNHGHQLQGLYLGXHOOHIRUVNQLQJVLQGVDWVYHG IDNXOWHWHWJHQQHPDWVWWHIRNXVSnHNVWHUQSXEOLFHULQJLDQHUNHQGWHWLGVVNULIWHU3nGHQDQGHQ VLGHHUGHUHQULVLNRIRUDWPRGHOOHQSnVLJWPRGDUEHMGHUIDNXOWHWHWVVUOLJHSURILOI[LIRUKROGWLO PXOLJKHGHQIRUDWRSG\UNHUHODWLRQHUWLOHUKYHUYVOLYHWGHULNNHQGYHQGLJYLVJLYHUPXOLJKHGIRU LQWHUQDWLRQDOSXEOLFHULQJ'HUOLJJHULNNHQGYHQGLJYLVHQPRGVWQLQJLGHWWHPHQIDNXOWHWHW DQEHIDOHVDOOLJHYHODWDQDO\VHUHGHODQJVLJWHGHLPSOLNDWLRQHUDIPRGHOOHQ
)DNXOWHWHWKDUWDJHWNYDOLWHWVVLNULQJVRSJDYHQDOYRUOLJWEnGHSnXGGDQQHOVHVRJSn
IRUVNQLQJVRPUnGHW'RJHUGHUIRUVNHOSnKYRUVHULVWGHHQNHOWHVWXGLHQYQRJLQVWLWXWWHU DUEHMGHUPHGVnYHONYDOLWHWVVLNULQJVRPRSIOJQLQJ'HUHUGHUIRUEHKRYIRUHQDNWLYLQGVDWVEnGH
IUDIDNXOWHWVOHGHOVHQVVLGHRJSnLQVWLWXWRJVWXGLHQLYHDXLIRUKROGWLONYDOLWHWVVLNULQJVDUEHMGHW 5DSSRUWHQDQEHIDOHUDWIDNXOWHWHWRSVWLOOHURYHURUGQHGHUDPPHUIRUNYDOLWHWVVLNULQJDIIDNXOWHWHWV XGGDQQHOVHUSnOLQMHPHGGHUDPPHUGHUHUIDVWVDWIRUIRUVNQLQJVHYDOXHULQJHUQH'HUXGRYHU DQEHIDOHVIDNXOWHWHWDWXQGHUVWWWHOULQJPHOOHPLQVWLWXWWHURJVWXGLHUYHGDWV\QOLJJUHIRUVNHOOH RJJRGSUDNVLVRJWDJHLQLWLDWLYWLOGLDORJRPKYLONHHUIDULQJHUGHUNDQRYHUIUHVPHOOHP
HQKHGHUQH
2PDQEHIDOLQJHUQH
5DSSRUWHQVDQDO\VHUYXUGHULQJHURJDQEHIDOLQJHUHUIRUHWDJHWDIHQHYDOXHULQJVJUXSSHEHVWnHQGH DIIDJOLJHHNVSHUWHU5DSSRUWHQHUXGDUEHMGHWSnEDJJUXQGDIGHQGRNXPHQWDWLRQGHUHULQGVDPOHW LIRUELQGHOVHPHGHYDOXHULQJHQ$QEHIDOLQJHUQHHUWQNWVRPHWUHGVNDEWLOYLGHUHXGYLNOLQJDI IDNXOWHWHWPHQHULNNHGHHQHVWHGHUNDQXGGUDJHVDIGRNXPHQWDWLRQVPDWHULDOHW'HQUHVWHUHQGH GHODIUDSSRUWHQHURSE\JJHWVnOHGHVDWDIVQLWGHUSUVHQWHUHUIDNXOWHWHWVHJHQIRUVWnHOVHVRPGHQ HUXGWU\NWLHYDOXHULQJHQVGRNXPHQWDWLRQLKYHUWWLOIOGHHIWHUIOJHVDIHWDIVQLWPHG
HYDOXHULQJVJUXSSHQVDQDO\VHUYXUGHULQJHURJDQEHIDOLQJHU
5HVXOWDWHU
,GHWWHDIVQLWEHKDQGOHVIDNXOWHWHWVUHVXOWDWHU)RUPnOHWPHGDIVQLWWHWHUDWYLVHKYDGIDNXOWHWHWKDU RSQnHWVRPEDJJUXQGIRUDWIRUVWnIDNXOWHWHWVVDPOHGHYLUNH
,QGOHGQLQJVYLVUHGHJUHVIRUIDNXOWHWHWVVXFFHVKLVWRULHULQGHQIRUXGGDQQHOVHRJIRUVNQLQJ'HU IRNXVHUHVSnSUPLVVHUQHIRURJGHWVUHJQHYHGIDNXOWHWHWVVXFFHVKLVWRULHURJLNNHSnGH VSHFLILNNHRPVWQGLJKHGHUYHGKYHUHQNHODIIDNXOWHWHWVVXFFHVHU)RUPnOHWHUDWInHQIRUVWnHOVH IRUKYDGGHUHUNHQGHWHJQHQGHIRUIDNXOWHWHWVVXFFHVHU(IWHUIOJHQGHEHKDQGOHVIDNXOWHWHWV UHVXOWDWHULQGHQIRUXGGDQQHOVHRJIRUVNQLQJ
%HKDQGOLQJHQDIEnGHXGGDQQHOVHRJIRUVNQLQJHUGHOWRSLWRXQGHUDIVQLWKYRUIDNXOWHWV IUHPVWLOOLQJJHQJLYHVHIWHUIXOJWDIHYDOXHULQJVJUXSSHQVDQDO\VHURJYXUGHULQJHU
)DNXOWHWHWVVXFFHVKLVWRULHU
)DNXOWHWHWKDULNNHVRPIRUXGVDWVHOYEHVNUHYHWVLQHVXFFHVKLVWRULHUVRPHWVUVNLOWDIVQLWL VHOYHYDOXHULQJHQPHQIDNXOWHWHWVVXFFHVKLVWRULHURJEDJJUXQGHQIRUGHPNDQOVHVIRUVNHOOLJH VWHGHULVHOYHYDOXHULQJHQ3nEHVJHWEOHYIDNXOWHWHWVVXFFHVHURJEDJJUXQGHQIRUGHPRJVn GLVNXWHUHWEUHGW
2YHURUGQHWHUGHWHYDOXHULQJVJUXSSHQVRSIDWWHOVHDWIDNXOWHWHWVVWUVWHVXFFHVKLVWRULHHUDW IDNXOWHWHWRJKHOH$DOERUJ8QLYHUVLWHWIUDEHJ\QGHOVHQYDOJWHDWWLOUHWWHOJJHRJEHGULYH XGGDQQHOVHRJIRUVNQLQJSnHQJUXQGOJJHQGHQ\RJXWUDGLWLRQHOPnGHRJDWGHQQHDOWHUQDWLYH PRGHOKDUYUHWHQVXFFHV
8GGDQQHOVH
3nIDNXOWHWHWHUGHUXGYLNOHWHQVUOLJXGGDQQHOVHVPRGHOLQGHQIRUUDPPHUGHUHUXGVWXNNHWDI XQLYHUVLWHWHW'HWJUXQGOJJHQGHHOHPHQWLPRGHOOHQHUGHWSUREOHPRULHQWHUHGHSURMHNWDUEHMGH VRPHUNHQGHWHJQHWYHGDWVWXGHUHQGHLJUXSSHUDIIRUVNHOOLJVWUUHOVHDUEHMGHUPHGDIJUQVHGH SUREOHPVWLOOLQJHU(QGYLGHUHHUPRGHOOHQNHQGHWHJQHWYHGVWRUNRQWDNWWLOUHJLRQHQVHUKYHUYVOLYRJ LQVWLWXWLRQHUVnOHGHVDWHQVWRUDQGHODISURMHNWHUWDJHUXGJDQJVSXQNWLNRQNUHWH
SUDNVLVRULHQWHUHGHSUREOHPHU*HQQHPSURMHNWDUEHMGHWRSQnUGHVWXGHUHQGHVWUNHNRPSHWHQFHU
LQGHQIRUSUREOHPOVQLQJRJVDPDUEHMGHRJIDJOLJWRSQnUGHLQGVLJWLQGHQIRUDIJUQVHGH IDJRPUnGHU$QGUHYVHQWOLJHNHQGHWHJQYHGXGGDQQHOVHVPRGHOOHQHUGHOVGHQJUXSSHVSHFLILNNH YHMOHGQLQJGHOVIRUHNRPVWHQDIDUEHMGVSODGVHUSnIDNXOWHWHWWLOKYHUSURMHNWJUXSSH
$WXGGDQQHOVHVPRGHOOHQHUHQVXFFHVIRUIDNXOWHWHWXQGHUE\JJHVDI
• YNVWLVJQLQJHQWLOIDNXOWHWHWVXGGDQQHOVHURJLNDQGLGDWSURGXNWLRQHQ
• KMVWXGLHHIIHNWLYLWHW
• HQUHODWLYKMJHQQHPIUHOVHVSURFHQWRJODYWIUDIDOG
• NRUWHVWXGLHWLGHU
• WLOIUHGVHGLPLWWHQGHU
• KMEHVNIWLJHOVHVJUDGIRUGLPLWWHQGHUQH
(WDQGHWYVHQWOLJWDVSHNWYHGIDNXOWHWHWVXGGDQQHOVHVPVVLJHVXFFHVHUDWIDNXOWHWHWV
XGGDQQHOVHURYHURUGQHWHUNDUDNWHULVHUHWYHGDWGHOEHQGHQGUHVLWDNWPHGXGYLNOLQJHQLQGHQ IRUGHSnJOGHQGHIDJRPUnGHURJQGULQJHUQHLSRWHQWLHOOHVWXGHUHQGHVVWXGLHLQWHUHVVHU'HWWH KDUYUHWPHGWLODWVLNUHIDNXOWHWHWHWNRQVWDQWVWLJHQGHRSWDJDIVWXGHUHQGHSnWURGVDIJHQHUHOOH YDQVNHOLJKHGHULQGHQIRUGHWWHNQLVNQDWXUYLGHQVNDEHOLJHRPUnGH
)RUVNQLQJ
)DNXOWHWHWKDURSE\JJHWIRUVNQLQJVPLOMHUKYRUDIIOHUHQ\GHUDQHUNHQGHOVHRJVnLQWHUQDWLRQDOW )DNXOWHWHWVIRUVNQLQJVPLOMHUHUNHQGHWHJQHWYHGDWYUHSURMHNWEDVHUHGHYUHRULHQWHUHWPRG DQYHQGWIRUVNQLQJKDYHNRQWDNWWLOHUKYHUYVOLYHWRJHQIDJOLJRUJDQLVHULQJGHUHUSUJHWDI EHW\GHOLJG\QDPLN(QGYLGHUHHUIDNXOWHWHWVIRUVNQLQJVPVVLJHVXFFHVHUNHQGHWHJQHWYHGDWGH HQWHQOLJJHULQGHQIRUDIJUQVHGHGHOHDIGHWUDGLWLRQHOOHIDJRPUnGHUHOOHUDWGHHU¨Q\H¨
IRUVNQLQJVRPUnGHUVRPRIWHJnUSnWYUVDIHWDEOHUHGHIDJRPUnGHU
)DNXOWHWHWVIRUVNQLQJVPLOMHUV\QHVDWEOLYHXGYLNOHWSnWRIRUVNHOOLJHPnGHU
• .QRSVN\GQLQJLQGHQIRUHNVLVWHUHQGHIRUVNQLQJVRPUnGHUHOOHULJUQVHIODGHUQHPHOOHP WUDGLWLRQHOOHRPUnGHU'HQQHXGYLNOLQJNHQGHWHJQHVYHGDWYUHEDVHUHWSnWDOHQWIXOGH
HQNHOWSHUVRQHUHOOHUIRUVNHUJUXSSHUVRPXGYLNOHUVWUNHIRUVNQLQJVPLOMHURIWHPHGXGJDQJVSXQNW LSUDNVLVRULHQWHUHGHLQJHQLUPVVLJHSUREOHPHU
• %HYLGVWVDWVQLQJSnQ\HLQGVDWVRPUnGHULQGHQIRUVnYHOODQGVSROLWLVNHUNOUHGHLQGVDWVRPUnGHU VRPWLOIOGLJWRSVWnHGHIRUVNQLQJVPXOLJKHGHU3nGHWWHRPUnGHKDUIDNXOWHWHWXGYLVWHYQHWLODW WLOWUNNHDNWXHOOHSURJUDPPHURJVDWVQLQJHURJKMHPWDJHKHOWQ\HIRUVNQLQJVPLOMHUI[
ELRWHNQRORJLRJVWDPFHOOHIRUVNQLQJ,QGWLOYLGHUHKDUIDNXOWHWHWKDIWVXFFHVPHGDWKMHPWDJHGLVVH
WRIRUVNQLQJVPLOMHU2PGHRJVnEOLYHUHQLQWHJUHUHWIRUVNQLQJVPVVLJVXFFHVIRUIDNXOWHWHWNDQ HQGQXLNNHYXUGHUHV
)DNXOWHWHWVUHVXOWDWHU
1HGHQIRUEHKDQGOHVIDNXOWHWHWVUHVXOWDWHULQGHQIRUXGGDQQHOVHRJIRUVNQLQJVnOHGHVDWGH VXFFHVKLVWRULHUGHUEOHYEHVNUHYHWLDIVQLWGRNXPHQWHUHV
8GGDQQHOVH
,QGOHGQLQJVYLVUHGHJUHVIRUIDNXOWHWHWVXGGDQQHOVHVPRGHO0RGHOOHQHUFHQWUDOIRUDWIRUVWn IDNXOWHWHWVXGGDQQHOVHVPVVLJHUHVXOWDWHU6nOHGHVPnUHVWHQDIGHUHVXOWDWHUGHUUHGHJUHVIRUL DIVQLWWHWLVWUUHHOOHUPLQGUHJUDGVHVLO\VHWDIXGGDQQHOVHVPRGHOOHQ(IWHUIOJHQGHUHGHJUHVIRU XGYLNOLQJHQLDQWDOOHWDIGLPLWWHQGHURJVWXGLHHIIHNWLYLWHWHQIDNXOWHWHWVUHVXOWDWHULUHODWLRQWLO XGYLNOLQJDIQ\HXGGDQQHOVHURJQGULQJHUDIHNVLVWHUHQGHLQJHQLUGLPLWWHQGHUVYXUGHULQJDI GHUHVXGGDQQHOVHRJGLPLWWHQGHUQHVEHVNIWLJHOVHVVLWXDWLRQ
D )DNXOWHWHWVXGGDQQHOVHVPRGHO
/LJHIUD$DOERUJ8QLYHUVLWHWVRSUHWWHOVHLKDUXQLYHUVLWHWHWVXQGHUYLVQLQJYUHWNHQGHWHJQHW YHGSUREOHPRULHQWHULQJRJSURMHNWRUJDQLVHULQJ)UDGHWWHIOOHVXGJDQJVSXQNWKDUGHUVLGHQ XGYLNOHWVLJIRUVNHOOLJHNRQNUHWHPRGHOOHUSnGHWUHIDNXOWHWHU
)DNXOWHWHWVXGGDQQHOVHVPRGHOHUNHQGHWHJQHWYHGDWDOOHXGGDQQHOVHUKDUHWEDVLVnUGHUHUIOOHV IRUDOOHVWXGHUHQGH%DVLVnUHWGDQQHUJUXQGODJIRUGHQHIWHUIOJHQGHRYHUE\JQLQJVXGGDQQHOVHRJ GHWDQGHWVHPHVWHUDIEDVLVnUHWHUWRQHWLIRUKROGWLOGHQYDOJWHRYHUE\JQLQJ)RUEnGH
FLYLOLQJHQLURJGLSORPLQJHQLUXGGDQQHOVHQHIWHUIOJHVEDVLVXGGDQQHOVHQDIWUHVHPHVWUH VHPHVWHULQGHQIRUHWEUHGWDIJUQVHWIDJRPUnGHHQVHNWRU'HUHIWHUIOJHUIRUFLYLOLQJHQLUHUQH HQVSHFLDOLVHULQJDIIHPVHPHVWUHVYDULJKHGVHPHVWHUGHULQNOXGHUHUHWDIJDQJVSURMHNW 'LSORPLQJHQLUVWXGLHWDIVOXWWHVPHGWRVHPHVWUHVVSHFLDOLVHULQJKHUXQGHUDIJDQJVSURMHNWHW'H QDWXUYLGHQVNDEHOLJHXGGDQQHOVHUHUVWUXNWXUHUHWVnOHGHVDWEDFKHORUXGGDQQHOVHQXGRYHUEDVLVnUHW RSE\JJHVDIpWHOOHUWRIDJRJNDQGLGDWXGGDQQHOVHQDIpW
+YHUWVHPHVWHUHUVRPKRYHGUHJHORSE\JJHWDISURMHNWDUEHMGHRJNXUVHUVRPEHJJHXGJUFLUND KDOYGHOHQDIWLGHQ.XUVHUQHRSGHOHVLSURMHNWRJVWXGLHHQKHGVNXUVHU3URMHNWHQKHGVNXUVHUQH3(
NXUVHUQHXGJUVDPPHQPHGSURMHNWHWHQSURMHNWHQKHGRJSODQOJJHVVDPOHWLQGHQIRUHWJLYHQW WHPD3URMHNWHQKHGVNXUVHUQHKDUWLOIRUPnODWJLYHLQVSLUDWLRQRJGHQQGYHQGLJHIDJOLJH
EDJJUXQGIRUGHVWXGHUHQGHVSURMHNWDUEHMGH,QGHQIRUUDPPHUQHDISURMHNWHQKHGHQVWHPD YOJHUGHVWXGHUHQGHHQDIJUQVHWSUREOHPVWLOOLQJIRUGHUHVSURMHNWDUEHMGH3nKYHUWVHPHVWHU LQGGHOHVGHVWXGHUHQGHLSURMHNWJUXSSHUDIKMVWVHNVVWXGHUHQGH'HVWXGHUHQGHVDPPHQVWWHU
VHOYJUXSSHUQH$OOHSURMHNWJUXSSHUUnGHURYHUHWSURMHNWUXPSnIDNXOWHWHWRJKDULGHWRPIDQJGHW HUQGYHQGLJWDGJDQJWLOODERUDWRULHUPY+YHUSURMHNWHQKHGSURMHNWDUEHMGHRJ
SURMHNWHQKHGVNXUVHUHNVDPLQHUHVVDPOHWYHGHQPXQGWOLJJUXSSHSUYHVRPEHGPPHV LQGLYLGXHOWHIWHUVNDODHQ9HGSUYHQIUHPOJJHVSURMHNWDUEHMGHWVRPGHUHIWHUGUIWHVPHG XGJDQJVSXQNWLSURMHNWUDSSRUWHQRJIUHPOJJHOVHQ'HUIRUHWDJHVVnOHGHVLNNHQRJHQ
VHOYVWQGLJEHGPPHOVHLIRUKROGWLOSURMHNWHQKHGVNXUVHUQH
6WXGLHHQKHGVNXUVHUQH6(NXUVHUWLOUHWWHOJJHVXDIKQJLJWDIVHPHVWHUHWVSURMHNWDUEHMGHRJ XGJUHVIRULQJHQLUXGGDQQHOVHUQHDINXUVHULQGHQIRUIOJHQGHRPUnGHUQDWXUYLGHQVNDEHOLJH JUXQGIDJPDWHPDWLNI\VLNGDWDORJLNHPLPIOJUXQGOJJHQGHLQJHQLUIDJVXSSOHUHQGH LQJHQLUIDJRJLNNHWHNQLVNQDWXUYLGHQVNDEHOLJHIDJVRPI[NRQRPLVSURJRJRUJDQLVDWLRQ 6WXGLHHQKHGVNXUVHUQHEHGPPHVLQGLYLGXHOWYHGHQLQWHUQSUYHRJVRPKRYHGUHJHOVRP EHVWnHWLNNHEHVWnHW3UYHQKDUWLOIRUPnODWDIJUHLKYLONHWRPIDQJGHQHQNHOWHVWXGHUHQGHV YLGHQHUWLOIUHGVVWLOOHQGHXGIUDGHRSVWLOOHGHPnO
3UDNVLVRULHQWHULQJHQDIXQGHUYLVQLQJHQHULIOJHVHOYHYDOXHULQJHQFHQWUDOSnIDNXOWHWHWKYLONHW NRPPHUWLOXGWU\NYHGDWHQODQJUNNHSURMHNWHUOVHVLVDPDUEHMGHPHGYLUNVRPKHGHU)DNXOWHWHW JHQQHPIUWHLHQXQGHUVJHOVHDIRPIDQJHWDIVWXGHQWHUSURMHNWHUGHUEOHYJHQQHPIUWL VDPDUEHMGHPHGHUKYHUYVOLYHW8QGHUVJHOVHQVNHOQHUPHOOHPSURMHNWHUKYRUGHVWXGHUHQGHGLUHNWH VDPDUEHMGHUPHGHQYLUNVRPKHGLQGLUHNWHVDPDUEHMGHUPHGHQYLUNVRPKHGRJVOHWLNNHKDU NRQWDNWPHGHQYLUNVRPKHG8QGHUVJHOVHQYLVHUDWVWUVWHGHOHQDIDIJDQJVSURMHNWHUQH
JHQQHPIUHVLVDPDUEHMGHPHGHUKYHUYVOLYHW3nFLYLOLQJHQLUXGGDQQHOVHQJHQQHPIUHVDI DIJDQJVSURMHNWHUQHLGLUHNWHVDPDUEHMGHPHGHQYLUNVRPKHGRJYHGLQGLUHNWHVDPDUEHMGH 3nGLSORPLQJHQLUXGGDQQHOVHQJHQQHPIUHVDOOHDIJDQJVSURMHNWHUHQWHQLGLUHNWHHOOHU LQGLUHNWHVDPDUEHMGHPHGHQYLUNVRPKHG3nGHYULJHVHPHVWUHJHQQHPIUHVDI SURMHNWHUQHSnFLYLOLQJHQLUVWXGLHWLGLUHNWHHOOHULQGLUHNWHVDPDUEHMGHPHGHQYLUNVRPKHGPHQV GHWWLOVYDUHQGHWDOIRUGLSORPLQJHQLUVWXGHUHQGHHU
3URMHNWDUEHMGHWIUHPKYHVLVHOYHYDOXHULQJHQRJVnVRPHWYVHQWOLJWHOHPHQWIRU
IRUVNQLQJVEDVHULQJHQDIIDNXOWHWHWVXGGDQQHOVHU*HQQHPSURMHNWDUEHMGHWInUGHVWXGHUHQGH HUIDULQJHUPHGDWOVHSUREOHPHUJHQQHPDQYHQGHOVHDIIRUVNQLQJVPVVLJHDUEHMGVPHWRGHURJ HYDOXHULQJVNULWHULHU'HUXGRYHUIUHPKYHVGHWDWSURMHNWDUEHMGHWE\JJHUSnGHVHQHVWH
IRUVNQLQJVUHVXOWDWHURJDWDIXQGHUYLVQLQJHQYDUHWDJHVDIDNWLYHIRUVNHUH
E $QWDOGLPLWWHQGHURJVWXGLHHIIHNWLYLWHW
2SWDJHWDIVWXGHUHQGHSnIDNXOWHWHWVXGGDQQHOVHUHUPHUHHQGIRUGREOHWLSHULRGHQMI QHGHQVWnHQGHWDEHO'LPLWWHQGWDOOHWIRURJW\GHUSnDWGHWJHGHRSWDJRJVnVOnU LJHQQHPLHWJHWDQWDOGLPLWWHQGHU
7DEHO
2YHUVLJWRYHURSWDJQHVWXGHUHQGHRJGLPLWWHQGHU
2SWDJSURNWREHUSnEDVLV
'LPLWWHQGHU
.LOGH6HOYHYDOXHULQJHQVGHO1RWHªªLQGLNHUHULQJHQRSO\VQLQJHU
$IGHQUHJLVWHUEDVHUHGHXQGHUVJHOVHIUHPJnUGHWMIQHGHQVWnHQGHWDEHODWDIGH VWXGHUHQGHVRPEOHYRSWDJHWLKDYGHDIVOXWWHWXGGDQQHOVHQLPHQVVWDGLJYDUL JDQJ%ODQGWGHPGHUVNLIWHGHVWXGLXPHUGHUHQDQGHOGHUVNLIWHGHLQWHUQWSnIDNXOWHWHW+YLV GLVVHVWXGHUHQGHLNNHWOOHVPHGXQGHUNDWHJRULHQVWXGLHVNLIWKDYGHDIGHVWXGHUHQGHGHU EOHYRSWDJHWLDIVOXWWHWXGGDQQHOVHQLPHQVVWDGLJYDULJDQJ
7DEHO
6WXGLHVWDWXVSUIRUnUJDQJRJ
6WXGLHVWDWXV 6WXGLHVWDWXVNRUULJHUHWIRUVWXGHUHQGHGHUHU VNLIWHWLQWHUQWSnIDNXOWHWHW
cUJDQJ cUJDQJ cUJDQJ cUJDQJ
,JDQJ
$IVOXWWHW
6WXGLHVNLIW
$IEUXGW
,DOW
.LOGH'DQPDUNV6WDWLVWLN1RWH,NRORQQHQ¨6WXGLHVWDWXV¨HUDOOHSHUVRQHUGHUKDUVNLIWHWVWXGLXPUHJLVWUHUHWXQGHU VWXGLHVNLIWXDQVHWRPGHKDUVNLIWHWWLOHWDQGHWVWXGLXPSnIDNXOWHWHWHOOHUWLOHWVWXGLXPXGHQIRUIDNXOWHWHW8QGHU NRORQQHQ¨6WXGLHVWDWXVNRUULJHUHWIRUVWXGHUHQGHGHUHUVNLIWHWLQWHUQWSnIDNXOWHWHW¨HUNXQSHUVRQHUGHUKDUVNLIWHW WLOHWVWXGLXPXGHQIRUIDNXOWHWUHJLVWUHUHWXQGHUVWXGLHVNLIW
+YLVRSJUHOVHQDIGHVWXGHUHQGHVVWXGLHVWDWXVRJVnLQNOXGHUHUGHVWXGHUHQGHVRPVNLIWHUVWXGLXP LQWHUQWSnIDNXOWHWHWHUGHUVnOHGHVIRUnUJDQJVRPKDUDIVOXWWHWGHUHVXGGDQQHOVH VRPVWDGLJHUVWXGLHDNWLYHRJVRPKDUVNLIWHWVWXGLXPHOOHUDIEUXGWGHUHVXGGDQQHOVH )RUnUJDQJHQHUGHUVRPKDUDIVOXWWHWVRPVWDGLJHUWLOPHOGWHQXGGDQQHOVHYHG IDNXOWHWHWRJVRPKDUVNLIWHWVWXGLXPHOOHUDIEUXGWGHUHVXGGDQQHOVH
$IVHOYHYDOXHULQJHQIUHPJnUGHWDWIDNXOWHWHWVVWXGHUHQGHKDUHQKMVWXGLHHIIHNWLYLWHWIRUVWnHW VRPDQGHOHQDIEHVWnHGHHNVDPLQHULIRUKROGWLOVWXGHQWHUEHVWDQGHQ,SHULRGHQOLJJHU VWXGLHHIIHNWLYLWHWHQSnRPNULQJ'HWWHEHNUIWHVDIGHQUHJLVWHUEDVHUHGHXQGHUVJHOVH0HQ VRPGHWIUHPJnUDIWDEHOHUGHUEHW\GHOLJHIRUVNHOOHVnYHOPHOOHPIDNXOWHWHWVVWXGLHQYQVRP IUDnUWLOnU6WXGLHQYQHWIRU%\JJHULRJ$QOJRJ6WXGLHQYQHWIRU(OHNWURQLNRJ
,QIRUPDWLRQVWHNQRORJLOLJJHUVnOHGHVXQGHULSHULRGHQPHQV6WXGLHQYQHWIRU
%DVLVXGGDQQHOVHQRJ6WXGLHQYQHWIRU$UNLWHNWXURJ'HVLJQLKHOHSHULRGHQOLJJHURYHU
7DEHO
6WXGLHQYQHQHVVWXGLHHIIHNWLYLWHWGHQSURFHQWYLVHDQGHODIEHVWnHGHHNVDPLQHUL IRUKROGWLOVWXGHQWHUEHVWDQGHQ
%\JJHULRJDQOJ
(OHNWURQLNRJLQIRUPDWLRQVWHNQRORJL
,QGXVWULRJHNVSRUW
.HPLRJELRWHNQRORJL
$UNLWHNWXURJ'HVLJQ
1DWXUYLGHQVNDE
/DQGLQVSHNWURJSODQOJQLQJ
%DVLVXGGDQQHOVHQ
.LOGH6HOYHYDOXHULQJHQVGHO
'HQKMHVWXGLHHIIHNWLYLWHWEHW\GHURJVnDWGHUSnIDNXOWHWHWHUJDQVNHNRUWHVWXGLHWLGHU, VHOYHYDOXHULQJHQVNULYHUIDNXOWHWHWDWGHQJHQQHPVQLWOLJHVWXGLHWLGIRUNDQGLGDWXGGDQQHOVHUQHL SHULRGHQWLOYDUSnPHOOHPRJnU
6RPGHWIUHPJnUDIWDEHOHUGHULSHULRGHQVNHWHQVWLJQLQJLVWXGHQWHUEHVWDQGHQSn PHQVGHULGHQVDPPHSHULRGHKDUYUHWHQVWLJQLQJLDQWDOOHWDIYLGHQVNDEHOLJH
PHGDUEHMGHUHDGMXQNWHUOHNWRUHURJSURIHVVRUHUSn6HVGHUSnJUXSSHQDIVHQLRUIRUVNHUH OHNWRUHURJSURIHVVRUHUKDUGHUYUHWHQVWLJQLQJSn
7DEHO
2YHUVLJWRYHUVWXGHQWHUEHVWDQGHQRJDQWDOOHWDIYLGHQVNDEHOLJHPHGDUEHMGHUH
QGULQJ
6WXGHQWHUEHVWDQG
9LGHQVNDEHOLJHPHGDUEHMGHUHDGMXQNWHUOHNWRUHURJSURIHVVRUHU
6/UDWLR
.LOGH6HOYHYDOXHULQJHQVGHORJIDNXOWHWVNRQWRUHW1RWH9LGHQVNDEHOLJHPHGDUEHMGHUHHURSJMRUWLDQWDOKRYHGHU F 8GYLNOLQJDIQ\HXGGDQQHOVHURJQGULQJDIHNVLVWHUHQGH
)DNXOWHWHWIUHPKYHULVHOYHYDOXHULQJHQDWGHUOJJHVVWRUYJWSnDUEHMGHWPHGQ\H XGGDQQHOVHVLQLWLDWLYHURJDWGHUXGYLVHVVWRUO\GKUKHGRYHUIRUSRWHQWLHOOHVWXGHUHQGHV
VWXGLHLQWHUHVVHUKYLONHWDQVHVIRUDWYUHHQYVHQWOLJIDNWRULIRUKROGWLODWWLOWUNNHVWXGHUHQGH 1\HXGGDQQHOVHURSE\JJHVRJXGYLNOHVPHQVHNVLVWHUHQGHXGGDQQHOVHUQGUHV'HQQHG\QDPLN XQGHUVWWWHVDIVSHFLHOWLQJHQLUXGGDQQHOVHUQHVWLOUHWWHOJJHOVH'HLQGOHGHQGHVHPHVWUH SnLQJHQLUXGGDQQHOVHUQHRSE\JJHVDIPHUHJHQHUHOOHRJEUHGHIDJHOHPHQWHUVRPDOOH
VWXGHUHQGHLQGHQIRUHQVHNWRUVRPI[HOHNWURQLNRJHOHNWURWHNQLNIOJHU)UDVMHWWHVHPHVWHU YOJHUGHVWXGHUHQGHHQOLQMHLQGHQIRUVHNWRUHQVRPI[LQIRUPDWLNRJIUDVHPHVWHURJIUHP NDQGHVWXGHUHQGHLQGHQIRUOLQMHQYOJHHQVSHFLDOLVHULQJ
,OEHWDIGHVHQHVWHIHPnUKDUIDNXOWHWHWRSUHWWHWHQUNNHQ\HXGGDQQHOVHU,QGHQIRUGHW QDWXUYLGHQVNDEHOLJHRPUnGHGUHMHUGHWVLJRP.HPL*HRJUDILRJ,QIRUPDWLNRJLQGHQIRUGHW LQJHQLUPVVLJHRP$UNLWHNWXURJ'HVLJQ6XQGKHGVWHNQRORJLVDPW3ODQRJPLOM'HUXGRYHUKDU IDNXOWHWHWXGEXGWHQUNNHQ\HVSHFLDOLVHULQJHUVRPIRUHNVHPSHO5XPIDUW,WLE\JJHULHW
(QWUHSUHQHXUVKLSRJ*HQWHNQRORJL G ,QWHUQDWLRQDOLVHULQJ
$IVHOYHYDOXHULQJHQIUHPJnUGHWDWIDNXOWHWHWVLQWHUQDWLRQDOLVHULQJVDUEHMGHSnXGGDQQHOVHVRPUnGHW IRNXVHUHUSn
• XGJnHQGHGDQVNHVWXGHUHQGH
• LQGJnHQGHXGHQODQGVNHJVWHVWXGHUHQGH
• HQJHOVNVSURJHGHXGGDQQHOVHU
• LQWHUQDWLRQDOHUIDULQJVXGYHNVOLQJ
'HWIUHPJnUDIVHOYHYDOXHULQJHQDWGHWHUIDNXOWHWHWVPnODWDOOHVWXGHUHQGHSnHWWLGVSXQNWLGHUHV XGGDQQHOVHVNDOWLOXGODQGHWLHQNRUWHUHHOOHUOQJHUHSHULRGH,SHULRGHQIUDKDU DQWDOOHWDIIDNXOWHWHWVHJQHVWXGHUHQGHVRPKDUYUHWSnHWXGYHNVOLQJVRSKROGOLJJHWSnPHOOHP VWXGHUHQGHRPnUHW$OOHVWXGHUHQGHSnIDNXOWHWHWKDUSnVHPHVWHUUHWWLODWWDJHHW VWXGLHRSKROGLXGODQGHW
$QWDOOHWDIXGHQODQGVNHVWXGHUHQGHVWXGHUHQGHGHUIOJHUHWKHOWXGGDQQHOVHVIRUOESnOLJHIRG PHGGDQVNHVWXGHUHQGHRJXGYHNVOLQJVVWXGHUHQGHVWXGHUHQGHGHUIOJHUHWHOOHUIOHUHVHPHVWUH PHQLNNHHWKHOWXGGDQQHOVHVIRUOEKDUGHVHQHUHnUXGYLNOHWVLJSRVLWLYW$QWDOOHWDIXGHQODQGVNH VWXGHUHQGHHULSHULRGHQWLOVWHJHWIUDFDWLOFDVWXGHUHQGHRPnUHW RJDQWDOOHWDIXGYHNVOLQJVVWXGHUHQGHIUDFDWLOFDVWXGHUHQGHRPnUHW
)DNXOWHWHWKDUHWDEOHUHWHQJHOVNVSURJHGHFLYLOLQJHQLUXGGDQQHOVHUVHPHVWHUHOOHU VHPHVWHU0HUHHQGKDOYGHOHQDIIDNXOWHWHWVNDQGLGDWRYHUE\JQLQJHUXGE\GHVVnOHGHVSnHQJHOVN (QGYLGHUHVNHUGHUHQVWDGLJXGYLNOLQJDIHQJHOVNVSURJHGHPDVWHUXGGDQQHOVHUnEHQXGGDQQHOVH
,VHOYHYDOXHULQJHQDQIUHVGHWDWIDNXOWHWHWVXGGDQQHOVHUDNWXHOWVDPDUEHMGHGHPHG XQLYHUVLWHWHUYHUGHQRYHURJDWGHUHUVWRULQWHUQDWLRQDOLQWHUHVVHIRUIDNXOWHWHWV
XGGDQQHOVHVPRGHO)DNXOWHWHWVHUHQVUOLJRSJDYHLDWUnGJLYHRJKMOSHLQJHQLUXGGDQQHOVHU YHUGHQRYHUPHGDWLPSOHPHQWHUHSUREOHPRULHQWHUHWRJSURMHNWRUJDQLVHUHWOULQJRJPHGDW XGYLNOHQ\HLQJHQLUSURILOHUUHWWHWPRGIUHPWLGLJHEHKRY
)DNXOWHWHWGHOWDJHUVRPUHVWHQDIXQLYHUVLWHWHWL(XURSHDQ&RQVRUWLXPRI,QQRYDWLYH8QLYHUVLWLHV (&,8,IOJHVHOYHYDOXHULQJHQEHVWnUNRQVRUWLHWDIXQLYHUVLWHWHUPHGEODQGWDQGHWIOJHQGH IOOHVWUNXQGHUYLVQLQJVRJIRUVNQLQJVPVVLJVW\UNHLQGHQIRUGHWWHNQLVNQDWXUYLGHQVNDEHOLJH RPUnGHVDPWVWUNWLONQ\WQLQJWLOLQGXVWULHQRJGHUHVJHRJUDILVNHUHJLRQ,VHOYHYDOXHULQJHQ EHVNIWLJHU(&,8VLJEODQGWDQGHWPHGXGDUEHMGHOVHDIIOOHVPDVWHUSURJUDPPHURJ
XGGDQQHOVHVPRGXOHUXGYLNOLQJDIQ\HHOHDUQLQJPRGXOHURJPHWRGHUIOOHVPDUNHGVIULQJDI (&,8XQLYHUVLWHWHUQHVWXGHQWHURJIRUVNHUPRELOLWHWVDPWPRQLWRUHULQJDIRJGHOWDJHOVHL
LQWHUQDWLRQDOHDNWLYLWHWHULQGHQIRURPUnGHUVRPDNNUHGLWHULQJRJNYDOLWHWVVLNULQJDIXGGDQQHOVHU
8QLYHUVLWHWVVDPDUEHMGHYHGUUHQGHXQGHUYLVQLQJILQGHUHQGYLGHUHVWHGJHQQHP81(6&2 ,QWHUQDWLRQDO&HQWHUIRU(QJLQHHULQJ(GXFDWLRQ8,&((+HUOLJJHUGHWLQWHUQDWLRQDOHFHQWHUIRU SUREOHPEDVHUHWOULQJLQGHQIRULQJHQLUXGGDQQHOVHUQH8&3%/YHGIDNXOWHWHWOLJHVRPFHQWHUHWV HXURSLVNHKRYHGNYDUWHUHUYHGDWEOLYHSODFHUHWYHGIDNXOWHWHW8,&(((+4
'HWHUIDNXOWHWHWVRSIDWWHOVHDWPnOVWQLQJHQYHGUUHQGHLQWHUQDWLRQDOWXQGHUYLVQLQJVVDPDUEHMGH RSI\OGHV
H ,QJHQLUGLPLWWHQGHUVYXUGHULQJDIGHUHVXGGDQQHOVH
,QJHQLUIRUHQLQJHQL'DQPDUNVVSUJHVNHPDXQGHUVJHOVHEODQGWLQJHQLUGLPLWWHQGHUEHO\VHU EODQGWDQGHWLQJHQLUGLPLWWHQGHUQHVYXUGHULQJDIGHUHVXGGDQQHOVH,IRUELQGHOVHPHG HYDOXHULQJHQHUGHUXGDUEHMGHWHWQRWDWSnEDJJUXQGDIXQGHUVJHOVHQGHUVDPPHQOLJQHU EHVYDUHOVHUQHIUDIDNXOWHWHWVGLPLWWHQGHUPHGEHVYDUHOVHUQHIUDGHQVDPOHGHLQJHQLUGLPLWWHQG SRSXODWLRQ$IXQGHUVJHOVHQIUHPJnUGHWDWIDNXOWHWHWVGLPLWWHQGHUJHQHUHOWHUWLOIUHGVHPHG GHUHVXGGDQQHOVHRJDWGHYXUGHUHUGHUHVHJQHNRPSHWHQFHUPHUHSRVLWLYWHQGDQGUH
LQJHQLUGLPLWWHQGHU(QGYLGHUHYLVHUXQGHUVJHOVHQDWIDNXOWHWHWVGLPLWWHQGHUHUPHUHWLOIUHGVHHQG GHQVDPOHGHSRSXODWLRQLQGHQIRUKRYHGSDUWHQDIRPUnGHUQH'HWNDQGRJEHPUNHVDW
GLPLWWHQGHUQHIUDIDNXOWHWHWLEHW\GHOLJJUDGHUPHUHWLOIUHGVHPHGEODQGWDQGHWXQGHUYLVHUQHV SGDJRJLVNHNYDOLILNDWLRQHUPXOLJKHGHQIRUIDJOLJNRQWDNWPHGXQGHUYLVHUQHVWXGLHPLOMHWSn XGGDQQHOVHQDOWLDOWYHMOHGQLQJHQYHGVWUUHSURMHNWHURJXQGHUYLVQLQJVORNDOHURJJUXSSHUXP I 'LPLWWHQGHUQHVEHVNIWLJHOVHVVLWXDWLRQ
'HQUHJLVWHUEDVHUHGHGLPLWWHQGXQGHUVJHOVHYLVHUXGYLNOLQJHQLGLPLWWHQGHUQHVnUJDQJRJ EHVNIWLJHOVHVVLWXDWLRQ%HVNIWLJHOVHVVLWXDWLRQHQNDQVHVVRPLQGLNDWLRQSnGHUHV DQYHQGHOLJKHGSnDUEHMGVPDUNHGHWVHOYRPGHUVNDOWDJHVKMGHIRUNRQMXQNWXUHULQGHQIRUGHQ HQNHOWHEUDQFKH
$IXQGHUVJHOVHQIUHPJnUGHWDWOHGLJKHGHQJHQHUHOWHUJDQVNHEHVNHGHQRJDWGHULHUHQ OHGLJKHGSnEODQGWEnGHGLPLWWHQGHUQHIUDRJ'LPLWWHQGHUQHIUDnUJDQJ KDYGHHQQRJHWKMHUHLQLWLDOOHGLJKHGOHGLJKHGHQHWnUHIWHUGLPLWWHULQJHQGnUJDQJ 'HUHUHQGYLGHUHIRUVNHOSnLQLWLDOOHGLJKHGHQIRUGLPLWWHQGHUIUDGHIRUVNHOOLJHVWXGLHQYQ )RUnUJDQJHQYDULHUHULQLWLDOOHGLJKHGHQPHOOHPRJIRUnUJDQJHQPHOOHP )RUEHJJHnUJDQJHKDUGLPLWWHQGHUIUDVWXGLHRPUnGHUQHE\JJHULRJDQOJVDPWODQGLQVSHNWU RJSODQOJQLQJGHQKMHVWHLQLWLDOOHGLJKHGRJGLPLWWHQGHUIUDVWXGLHRPUnGHUQHQDWXUYLGHQVNDE RJHOHNWURQLNRJLQIRUPDWLRQVWHNQRORJLGHQODYHVWHLQLWLDOOHGLJKHG
'HWIUHPJnUHQGYLGHUHDWHQVWRUGHODIIDNXOWHWHWVGLPLWWHQGHUInUDUEHMGHL-\OODQGXQGHUVJHOVHQ EHO\VHUGHQJHRJUDILVNHSODFHULQJDIGLPLWWHQGHUQHVDUEHMGVVWHGGHWIUVWHnUHIWHUGHUHV
GLPLVVLRQ)RUEHJJHGLPLWWHQGnUJDQJHHUGHUHQKMEHVNIWLJHOVHL1RUGM\OODQGV$PWSnKKY RJ,DOWYLVHURSJUHOVHQDWDIEHJJHnUJDQJHGHWIUVWHnUHUEHVNIWLJHWLHQ YLUNVRPKHGGHUKDUDUEHMGVVWHGL-\OODQG
J (IWHURJYLGHUHXGGDQQHOVH
)DNXOWHWHWVXGGDQQHOVHUXQGHUnEHQXGGDQQHOVHKDUJHQQHPJnHWHQXGYLNOLQJIUDHWRSWDJSnFD VWXGHUHQGHLWLOFDL6LGHQKDUIDNXOWHWHWKYHUWnUKROGW/LYVODQJ
8GGDQQHOVHVXJHLVnYHO$DOERUJVRP(VEMHUJ'HOWDJHUDQWDOOHWKDUYUHWSnPHOOHPRJ SHUVRQHU,EOHYIRUOEHWVHQHVWHYDOXHUHWDIIDNXOWHWHW(YDOXHULQJHQYLVHUDWGHUHU WLOIUHGVKHGPHGXGGDQQHOVHVXJHQEODQGWGHOWDJHUQH
(QGYLGHUHXGE\GHUIDNXOWHWHWIRUVNHOOLJHXGGDQQHOVHVIRUOELVDPDUEHMGHPHGYLUNVRPKHGHURJ RIIHQWOLJHLQVWLWXWLRQHU'LVVHRPIDWWHUEODQGWDQGHWIRUVJVYLV:RUN%DVHG/HDUQLQJGHUEHQ\WWHU GHQSGDJRJLVNHWLOJDQJIUDGHQSUREOHPRULHQWHUHGHRJSURMHNWRUJDQLVHUHGHXQGHUYLVQLQJVPRGHO SnNRQNUHWHSUREOHPVWLOOLQJHULHQYLUNVRPKHG,GHHQHUVnOHGHVDWYLUNVRPKHGHQEnGHInUOVW NRQNUHWHSUREOHPHURJXGGDQQHWVLQHPHGDUEHMGHUH
$QDO\VHURJYXUGHULQJHU
'HWHUHYDOXHULQJVJUXSSHQVRSIDWWHOVHDWIDNXOWHWHWKDUXGYLNOHWHQXGGDQQHOVHVPRGHOGHU JUXQGOJJHQGHHUYHOHJQHWRJIRUPnOVWMHQOLJVHWLIRUKROGWLOIDNXOWHWHWVSURILORJVRPJLYHUJRG PXOLJKHGIRUDWXQGHUVWWWHHWRPYHUGHQVRULHQWHUHWIRNXV8GGDQQHOVHVPRGHOOHQHUHQGYLGHUH NHQGHWHJQHWYHGHQKMVWXGLHHIIHNWLYLWHWDWGLPLWWHQGHUQHHUWLOIUHGVHPHGGHQRJDWGHKXUWLJW NRPPHULDUEHMGH
3nLQVWLWXWLRQVEHVJHWEOHYGHUSnWYUVDIDOOHJUXSSHUVWXGHUHQGHXQGHUYLVHUHIRUVNHUHRJ HUKYHUYVOLYXGWU\NWVWRUWLOIUHGVKHGPHGRJRSEDNQLQJWLOXGGDQQHOVHVPRGHOOHQ'HWEOHYLPLGOHUWLG IUHPKYHWDWGHUEODQGWEnGHVWXGHUHQGHRJVWXGLHOHGHUHHUHQRSPUNVRPKHGRPNULQJIRUKROG YHGXGGDQQHOVHVPRGHOOHQGHUPHGIRUGHONXQQHQGUHV%nGHEODQGWVWXGLHOHGHUQHRJEODQGWGH VWXGHUHQGHEOHYGHUJLYHWXGWU\NIRUDWVWXGLHPRGHOOHQPHGWLVHPHVWUHPHGSURMHNWRSJDYHULNNH QGYHQGLJYLVHURSWLPDORJGHUEOHYHIWHUO\VWPLQGUHRJIUUHSURMHNWHUVDPWLQGLYLGXHOWDUEHMGHL QRJOHSURMHNWHU'HWEOHYIUHPKYHWSnLQVWLWXWLRQVEHVJHWDWGHUHNVSHULPHQWHUHVPHGUHVXOWDWHW SURGXNWHWDISURMHNWDUEHMGHWVnOHGHVDWGHUSnQRJOHVWXGLHULHQNHOWHVHPHVWUHNDQDIOHYHUHVHQ DUWLNHOHOOHUHQSRVWHULVWHGHWIRUHQSURMHNWUDSSRUW
(QGYLGHUHIUHPKYHGHQRJOHXQGHUYLVHUHSnEHVJHWDWSURMHNWHQKHGVNXUVHUQHLNNHLWLOVWUNNHOLJ JUDGSUYHVYHGSURMHNWHNVDPLQHUQHRJDWGHW\GHUPHUHRIWHHUJUXQGOJJHQGHIDJHOHPHQWHUGHU EHKDQGOHVLGLVVHNXUVHUGHUGHUIRUOLJHVnJRGWNXQQHKDYHKDIWVWDWXVDIHWVWXGLHHQKHGVNXUVXV PHGHNVDPHQ6DPWLGLJHUGHUIRUVNHOSnRPVWXGLHHQKHGVNXUVHUQHEHGPPHVHIWHUVNDODHQ HOOHUPHGEHVWnHWLNNHEHVWnHW
(YDOXHULQJVJUXSSHQDQEHIDOHUDWIDNXOWHWHWEUXJHUHYDOXHULQJHQVRPHQDQOHGQLQJWLOHQ V\VWHPDWLVNJHQQHPJDQJDIXGGDQQHOVHVPRGHOOHQPHGKHQEOLNSnDWXGYLNOHGHQ\GHUOLJHUH
,ERJHQ7KH$DOERUJ(NVSHULPHQWIUDIUHPKYHVGHWDWXGGDQQHOVHVPRGHOOHQKDUEHW\GQLQJ IRUGLPLWWHQGHUQHVIDJOLJHSURILO%RJHQIUHPKYHULHQVDPPHQOLJQLQJPHG
FLYLOLQJHQLUGLPLWWHQGHUIUD'DQPDUNV7HNQLVNH8QLYHUVLWHWIDNXOWHWHWVFLYLOLQJHQLUGLPLWWHQGHUVRP VWUNHLQGHQIRUSUREOHPOVQLQJNRPPXQLNDWLRQVDPDUEHMGHRJJHQHUHOWHNQLVNYLGHQPHQVRP PLQGUHVWUNHLQGHQIRUSDUDWYLGHQRJIDJOLJPHWRGH'HQQHYXUGHULQJDIGLPLWWHQGHUQHVIDJOLJH SURILOEOHYRJVnEHNUIWHWSnEHVJHW
(YDOXHULQJVJUXSSHQGHOHUYXUGHULQJHQDIDWXGGDQQHOVHVPRGHOOHQJHQQHPHWIRNXVSnNRQNUHWH LQJHQLUPVVLJHSUREOHPVWLOOLQJHURJJHQQHPSURMHNWRUJDQLVHULQJJLYHUGLPLWWHQGHUPHGVWUNH NRPSHWHQFHUVRPSUREOHPOVHUHRJHQG\EWJnHQGHNRPSHWHQFHSnXGYDOJWHRPUnGHU6DPWLGLJ
QVNHUHYDOXHULQJVJUXSSHQDWIUHPKYHYLJWLJKHGHQDIDWIDNXOWHWHWVLNUHUWLOVWUNNHOLJEUHGGHRJ G\EGHLGHQIDJOLJHIXQGHULQJKHUXQGHUIDJOLJPHWRGHLGHWGHUHIWHUHYDOXHULQJVJUXSSHQV RSIDWWHOVHHUHQLERHQGHULVLNRIRUDWIDNXOWHWHWVSULRULWHULQJNDQSnYLUNHGLVVHIRUKROG
3UDNVLVUHODWLRQHQLGHVWXGHUHQGHVSURMHNWHUJHQQHPLQYROYHULQJDIYLUNVRPKHGHUYXUGHUHVVRPHQ VXFFHV'HWHUHYDOXHULQJVJUXSSHQVYXUGHULQJDWVXFFHVHQHUNRPPHWJHQQHPHQDNWLYLQGVDWV EnGHSnIDNXOWHWVQLYHDXRJSnGHFHQWUDOWQLYHDX'HVXGHQHUGHWIRUPRGHQWOLJHQXQGHUVWWWHQGH IDNWRUDWXQLYHUVLWHWHWSnJUXQGDIVLQSODFHULQJLYLGXGVWUNQLQJXGJUGHQPXOLJKHG
YLUNVRPKHGHULRPUnGHWKDUIRUDWLQGGUDJHVWXGHUHQGHLGHUHVDUEHMGH
$WGHWHUO\NNHGHVIRUIDNXOWHWHWDWJHRSWDJHWWLOLQJHQLUXGGDQQHOVHUQHLHQSHULRGHKYRUGHW KDUYUHWYDQVNHOLJWDWUHNUXWWHUHSnRPUnGHWJHQHUHOWILQGHUHYDOXHULQJVJUXSSHQSRVLWLYW(Q PXOLJIRUNODULQJSnGHWWHHUXQLYHUVLWHWHWVRJIDNXOWHWHWVVDWVQLQJSnSURPRYHULQJDI
XGGDQQHOVHUQHRJIDNXOWHWHWVHYQHWLODWIRUQ\XGGDQQHOVHUQHVnGHIUHPVWnUVRPUHOHYDQWHIRUGH VWXGLHVJHQGH8GGDQQHOVHVPRGHOOHQVPRGXOLVHUHGHIRUPJLYHUPXOLJKHGIRUDWWLOSDVVH
XGGDQQHOVHUQHWLOGHVWXGLHVJHQGHVQVNHUPHGUHODWLYWODYHRPNRVWQLQJHU6DPWLGLJXQGHUVWWWHV WLOSDVQLQJHQDIXGGDQQHOVHUQHYHGDWGHWHUGHVWXGHUHQGHGHUYOJHUSURMHNWHURJKHULJHQQHP SUHVVHUSnIRUDWDNWXHOOHHPQHUWDJHVRSLSURMHNWHUQH$IEHVJHWILNHYDOXHULQJVJUXSSHQGHW LQGWU\NDWGHVWXGHUHQGHRJGHUHVSURMHNWDUEHMGHVSLOOHUHQYVHQWOLJUROOHIRUIRUQ\HOVHQDI IDNXOWHWHWVIDJOLJHSURILORJGHUPHGHUPHGWLODWVWWHGDJVRUGHQHQ(YDOXHULQJVJUXSSHQILQGHUDW IDNXOWHWHWLYLGXGVWUNQLQJWDJHUGHVWXGHUHQGHDOYRUOLJWRJDNWLYWVJHUDWLQWHJUHUHGHPL IDNXOWHWHWVPLOM
(YDOXHULQJVJUXSSHQEHPUNHUDWGHUHUVNHWHQEHW\GHOLJHNVSDQVLRQLVWXGHQWHUEHVWDQGHQXGHQ DWGHQIDVWHXQGHUYLVHUVWDEHUIXOGWPHG)UDPGHWPHGXQGHUYLVHUQHILNHYDOXHULQJVJUXSSHQGHW LQGWU\NDWGHWWHNXQKDUYUHWPXOLJWJHQQHPHQHNVWUDXQGHUYLVQLQJVLQGVDWVIUD
XQGHUYLVHUJUXSSHQ(QVnGDQHNVWUDRUGLQULQGVDWVPnIRUYHQWHVDWYUHYDQVNHOLJDWRSUHWKROGH SnODQJWVLJWIRUGLGHUOJJHVSUHVSnXQGHUYLVHUQHVHQJDJHPHQWRJIRUVNQLQJVWLG
3nGHQEDJJUXQGHUGHWHYDOXHULQJVJUXSSHQVDQEHIDOLQJDWIDNXOWHWHWRYHUYHMHURPGHWHU IRUVYDUOLJWLIRUKROGWLOXGGDQQHOVHUQHVNYDOLWHWIRUWVDWDWJHRSWDJHWDIVWXGHUHQGHXGHQHQ WLOVYDUHQGHIRUJHOVHLXQGHUYLVHUVWDEHQ6DPWLGLJNDQGHQQHRYHUYHMHOVHYUHYDQVNHOLJSnHW WLGVSXQNWKYRUGHUIUDHUKYHUYVOLYHWVVLGHHIWHUVSUJHVIOHUHGLPLWWHQGHUPHGWHNQLVN
QDWXUYLGHQVNDEHOLJEDJJUXQGRJQnUPXOLJKHGHQIRUDWXGYLGHXQGHUYLVHUVWDEHQEODQGWDQGHW KQJHUVDPPHQPHGXGYLNOLQJHQLIRUVNQLQJVPLGOHUQH
)DNXOWHWHWKDUDUEHMGHWDNWLYWPHGLQWHUQDWLRQDOLVHULQJDIXGGDQQHOVHUQHEnGHKYDGJnUHWDEOHULQJ DIPXOLJKHGHUIRUDWHJQHVWXGHUHQGHNDQWDJHDIVWHGLIRUPDIHWVUOLJWWLOUHWWHODJWVHPHVWHUL IRUPDIHQJHOVNVSURJHGHXGGDQQHOVHVXGEXGRJLIRUPDILQWHUQDWLRQDOWVDPDUEHMGHLUHODWLRQWLO IDNXOWHWHWVSGDJRJLVNHPRGHO'HVWXGHUHQGHHYDOXHULQJVJUXSSHQPGWHSnEHVJHWKDYGHGRJ LNNHHUIDULQJHUPHGXGODQGVRSKROG,IRUKROGWLOIDNXOWHWHWVLQWHUQDWLRQDOHNRQWDNWIODGHYXUGHUHV GHWSRVLWLYWDWIDNXOWHWHWPHGYLUNHUL(&,8(XURSHDQ&RQVRUWLXPRI,QQRYDWLYH8QLYHUVLWLHV'HWHU LPLGOHUWLGLNNHNODUWIRUHYDOXHULQJVJUXSSHQKYLONHNRQNUHWHIRUGHOHVDPDUEHMGHWKDUKDIWVRP DGVNLOOHUVLJIUDDQGUHW\SHUDIVDPDUEHMGVDIWDOHU7DJHWGHDPELWLVHPnOVWQLQJHULEHWUDJWQLQJ NXQQHGHWKDYHYUHWIRUYHQWHWDWVDPDUEHMGHWKDYGHHQPHUHPDUNDQWUROOHLEHVNULYHOVHQDI IDNXOWHWHWVDNWLYLWHWHU2PYHQGWHUGHUIRUVWnHOVHIRUDWQ\HW\SHUDILQWHUQDWLRQDOWVDPDUEHMGHNDQ YUHYDQVNHOLJHDWHWDEOHUH
,QGHQIRUHIWHURJYLGHUHXGGDQQHOVHVRPUnGHWYLGQHULNNHPLQGVWZRUNEDVHGOHDUQLQJRJOLYVODQJ XGGDQQHOVHVXJHRPHQLQQRYDWLYWLOJDQJWLORPUnGHW8GIUDRPIDQJHWDIIDNXOWHWHWVDNWLYLWHWHU YXUGHUHUHYDOXHULQJVJUXSSHQDWHIWHURJYLGHUHXGGDQQHOVHHUHWRPUnGHVRPIDNXOWHWHWNXQQH VDWVHHQGQXPHUHSn/LYVODQJXGGDQQHOVHHUXGIUDGHOWDJHUDQWDOOHWRJGHOWDJHUYXUGHULQJHUQHDW GPPHHQVXFFHVPHQVGHWHQGQXHUIRUWLGOLJWDWVLJHQRJHWRPKYRUYLGWZRUNEDVHGOHDUQLQJYLO EOLYHHQVXFFHVEODQGWYLUNVRPKHGHUQH
)RUVNQLQJ
)DNXOWHWHWKDULVHOYHYDOXHULQJHQYDOJWDWUHGHJUHIRUVLQHIRUVNQLQJVPVVLJHUHVXOWDWHURJ IRUPLGOLQJHQDIGHPXQGHURYHUVNULIWHUQHIRUVNHUQHVGHOWDJHOVHLGHWJOREDOHIRUVNHUVDPIXQGV YLGHQVNDEHOVHIRUVNQLQJVIRUPLGOLQJRJRSI\OGHOVHDIYLUNVRPKHGHUQHVYLGHQVEHKRY6nOHGHVKDU IDNXOWHWHWYDOJWDWVRQGUHPHOOHPIRUVNQLQJRJIRUVNQLQJVIRUPLGOLQJ1HGHQIRUUHGHJUHVGHUIRU IDNXOWHWHWVIRUVNQLQJVPVVLJHUHVXOWDWHURJIRUPLGOLQJHQDIGHPXQGHUHW
D )DNXOWHWHWVIRUVNQLQJVPLOMHU
)DNXOWHWHWVIRUVNQLQJHURUJDQLVHUHWLLQVWLWXWWHURJHQUNNHFHQWUH2UJDQLVHULQJHQDI IRUVNQLQJHQKDUIRUDQGUHWVLJVLGHQRSUHWWHOVHQLPHGXGVSDOWQLQJHQDIQ\HLQVWLWXWWHU IO\WQLQJDIIDJJUXSSHUPHOOHPLQVWLWXWWHURJRSUHWWHOVHQDIIRUVNHOOLJHFHQWUH,VHOYHYDOXHULQJHQ EHVNULYHVUHODWLRQHQPHOOHPLQVWLWXWWHURJFHQWUHVRPHQPDWUL[
,UHODWLRQWLOIRUVNQLQJHQIUHPKYHUIDNXOWHWHWLVHOYHYDOXHULQJHQRSUHWWHOVHQDIHQUNNHFHQWUH VRPLIRUVNHOOLJWRPIDQJKDURSE\JJHWNRPSHWHQFHUSnUHJLRQDOWQDWLRQDOWRJLQWHUQDWLRQDOW QLYHDX&HQWUHQHIUHPKYHVRJVnVRPHNVHPSOHUSnVDPDUEHMGHWPHGHUKYHUYVOLYHWRJL IRUELQGHOVHPHGIRUPLGOLQJDIIDNXOWHWHWVIRUVNQLQJ,VHOYHYDOXHULQJHQQYQHVRJSUVHQWHUHV IOJHQGHFHQWUH&HQWHUIRU6DQVH0RWRULVN,QWHUDNWLRQ&HQWHUIRU3HUVRQ.RPPXQLNDWLRQ&HQWHU IRU,QGXVWULHO3URGXNWLRQ&HQWHUIRU0HQQHVNHWV/\GRSIDWWHOVH&HQWHUIRU-RUGEUXJVWHNQRORJL
&HQWHUIRU0DWHULDOHWHNQRORJLRJ1RXKDX]
1HGHQIRUSUVHQWHUHVGHLQVWLWXWWHURJGHWFHQWHUVRPKDUGHOWDJHWLGHQGHFHQWUDOHGHODI VHOYHYDOXHULQJVSURFHVVHQVDPW&HQWHUIRU3HUVRQ.RPPXQLNDWLRQ
,QVWLWXWIRU'DWDORJL
,QVWLWXWWHWHURUJDQLVHUHWLILUHIRUVNQLQJVHQKHGHUPHGIOJHQGHIRUVNQLQJVRPUnGHU'DWDEDVHRJ SURJUDPPHULQJVWHNQRORJLEHVOXWQLQJVVWWWHV\VWHPHULQIRUPDWLRQVV\VWHPHURJGLVWULEXHUHGH V\VWHPHURJVHPDQWLN9HG,QVWLWXWIRU'DWDORJLHUGHUDQVDWSURIHVVRUHURJOHNWRUHU DGMXQNWHURJSKGVWXGHUHQGH
,QVWLWXWWHWJHQQHPIUHUIRUVNQLQJVHYDOXHULQJHUPHGLQGGUDJHOVHDIXGHIUDNRPPHQGHHNVSHUWHU ,GHQVHQHVWHIRUVNQLQJVHYDOXHULQJIUDMXQLYXUGHUHVLQVWLWXWWHWPHJHWSRVLWLYW
,QVWLWXWWHWHWDEOHUHGHLFHQWHUHW1RXKDX]XGIUDHWQVNHRPDWHWDEOHUHHWWWWHUH VDPDUEHMGHPHOOHPLWYLUNVRPKHGHULUHJLRQHQRJLQVWLWXWWHWVIRUVNQLQJVHQKHGHU1RXKDX]HUHW IRUXPIRUGLVNXVVLRQVDPDUEHMGHRJNRQWDNWPHOOHPIRUVNHUHVWXGHUHQGHRJLWPHGDUEHMGHUHL 1RUGM\OODQG
,QVWLWXWIRU9DQG-RUGRJ0LOMWHNQLN
,QVWLWXWWHWHURUJDQLVHUHWLWUHHQKHGHU/DERUDWRULHWIRU*HRWHNQLNRJ)XQGHULQJ/DERUDWRULHWIRU +\GUDXOLNRJ+DYQHE\JQLQJVDPW6WUXNWXUHO'\QDPLN9HG,QVWLWXWIRU9DQG-RUGRJ0LOMWHNQLNHU GHUDQVDWSURIHVVRUHURJOHNWRUHUDGMXQNWHURJSKGVWXGHUHQGH
,QVWLWXWWHWKDUXQGHUJnHWIOHUHRUJDQLVDWRULVNHIRUDQGULQJHU9HG$$8ªVRSUHWWHOVHEOHYLQVWLWXWWHW HWDEOHUHWPHGIRNXVSnYDQGE\JQLQJJHRWHNQLNRJWHNQLVNK\JLHMQH6LGHQHUGHUEOHYHWXGYLNOHW HWPLOMLQGHQIRUELRWHNQLNGHUQXKDUGDQQHWVLWHJHWLQVWLWXW)RURPWUHQWHWnUVLGHQYDOJWH DIGHOLQJHQIRUPLOMWHNQLNDWRYHUJnWLO,QVWLWXWIRU%LRWHNQLNXGIUDHQYXUGHULQJDIHWVWUUHIDJOLJW IOOHVVNDE,QVWLWXWWHWHUWLOJHQJOGEOHYHWXGYLGHWPHGRPUnGHWVWUXNWXUHOG\QDPLN,
VHOYHYDOXHULQJHQIUHPKYHULQVWLWXWWHWYNVWGHOWDJHOVHYHGLQWHUQDWLRQDOHNRQIHUHQFHURJHQVWRU VDPDUEHMGVIODGHVRPHNVHPSOHUSnUHVXOWDWHU(QGYLGHUHIUHPKYHVLQVWLWXWWHWV
ODERUDWRULHIDFLOLWHWHUVRPHWVXFFHVIXOGWVDWVQLQJVRPUnGH
,QVWLWXWIRU(QHUJLWHNQLN
,QVWLWXWWHWHURUJDQLVHUHWLIOJHQGHVHNWLRQHU(OHNWULVNHIRUV\QLQJVV\VWHPHUWHUPLVNH HQHUJLV\VWHPHUHIIHNWHOHNWURQLVNHV\VWHPHUIOXLGPHNDQLNRJIRUEUQGLQJVWHNQLNHOHNWULVNH PDVNLQHURJK\GUDXOLVNHRJPHNDWURQLVNHV\VWHPHU9HG,QVWLWXWIRU(QHUJLWHNQLNHUGHUDQVDW SURIHVVRUHURJOHNWRUHUDGMXQNWHURJSKGVWXGHUHQGH
,QVWLWXWWHWKDULJHQQHPGHVHQHVWHWLnUKDIWHQPnOVWQLQJRPDWXGE\JJHVLQIRUVNQLQJVPVVLJH DNWLYLWHW,QVWLWXWWHWIUHPIUHUGHWVRPHQVXFFHVDWGHWHUO\NNHGHVDWJHGHNYDQWLWDWLYHUHVXOWDWHU LIRUKROGWLOLQGLNDWRUHUVRPI[DQWDODUWLNOHUSDWHQWVDJHUSKGSURMHNWHURJHNVWHUQWILQDQVLHUHGH IRUVNQLQJVDNWLYLWHWHU'HVXGHQIUHPKYHVWUHVWUDWHJLVNHVDWVQLQJHUPHGHNVWHUQHSDUWHU
• 'DQIRVV3URIHVVRU3URJUDPPHWGHUKDUWLOIRUPnODWVW\UNHHIIHNWHOHNWURQLNRPUnGHW3URMHNWHW JHQQHPIUHVPHGVWWWHIUD'DQIRVV'ULYHVVWDWHQRJ$$8
• ,VDPDUEHMGHPHG6DXHU'DQIRVV$6HUGHUWDJHWHWLQLWLDWLYLQGHQIRU(OHNWUR0HNDQLVN6\VWHP 'HVLJQGHUVNDOXGYLNOHRJLQGNUHHQQ\XGGDQQHOVHLQGHQIRUPHFKDWURQLFRPUnGHWVDPWVW\UNH IRUVNQLQJHQLQGHQIRUVDPPHRPUnGH
• (OHNWULVN'HVLJQRJ6W\ULQJHUHWSURJUDPGHUHUHWDEOHUHWLVWUDWHJLVNDOOLDQFHPHG5LVYHGUUHQGH HOHNWULVNGHVLJQRJVW\ULQJDIYLQGPOOHU
&HQWHUIRU6DQVH0RWRULVN,QWHUDNWLRQ
&HQWHUHWEOHYRSUHWWHWLVRPHWJUXQGIRUVNQLQJVFHQWHU(QVWRUGHODIFHQWHUHWVEHYLOOLQJWLO IRUVNQLQJRJIRUVNHUVNROHILQDQVLHUHVDI'DQPDUNV*UXQGIRUVNQLQJVIRQG)LQDQVLHULQJHQOEHU LQGWLO&HQWHUIRU6DQVH0RWRULVN,QWHUDNWLRQKDUWLONQ\WWHWSURIHVVRUHURJOHNWRUHU DGMXQNWRJSKGVWLSHQGLDWHU
)RUPnOHWPHGFHQWHUHWHUDWHWDEOHUHRJEHGULYHIRUVNQLQJRJGULYHHQIRUVNHUVNROHDIKM LQWHUQDWLRQDONYDOLWHW0HUHNRQNUHWVNDOFHQWHUHWXQGHUVJHEDVDOHRJNOLQLVNHDVSHNWHUDI PHQQHVNHUVVDQVHPRWRULVNHLQWHUDNWLRQRJXGYLNOHPHWRGHUWLODWJHQHWDEOHUHGHODJWHVDQVH PRWRULVNHIXQNWLRQHU&HQWHUHWVNRQWDNWWLOGHWUHJLRQDOHHUKYHUYVOLYEHVWnUDIXIRUPHOOH
SURMHNWVDPDUEHMGHURJGHOWDJHOVHLQHWYUNVDNWLYLWHWHU'HVXGHQLQGJnUFHQWHUHW
VDPDUEHMGVDIWDOHUPHGYLUNVRPKHGHURPnUHWVRPRIWHVWRPRSUHWWHOVHDISKGIRUOERJ DIWDOHURPUHNYLUHUHWDUEHMGHRPnUHW
&HQWHUIRU3HUVRQ.RPPXQLNDWLRQ&3.
&HQWHUIRU3HUVRQ.RPPXQLNDWLRQHURUJDQLVDWRULVNWLONQ\WWHW,QVWLWXWIRU(OHNWURQLVNH6\VWHPHU
$IGHOLQJHQIRU.RPPXQLNDWLRQVWHNQRORJL&HQWHUHWVIRUVNQLQJVRPUnGHRPIDWWHUEUHGWGHILQHUHW WHRULWHNQLNVDPWGHVLJQRJNRQVWUXNWLRQDIXGVW\UYHGRYHUIUVHORJEHKDQGOLQJDIVLJQDOHURJ LQIRUPDWLRQLQGHQIRUWUnGOVNRPPXQLNDWLRQ&HQWHUIRU3HUVRQ.RPPXQLNDWLRQKDUWLONQ\WWHW SURIHVVRUHURJOHNWRUHUDGMXQNWHURJSKGVWLSHQGLDWHU
,VHOYHYDOXHULQJHQDQIUHVGHWDW&HQWHUIRU3HUVRQ.RPPXQLNDWLRQKDUHQVWUN
HUKYHUYVWLONQ\WQLQJRJHQGYLGHUHKDUVSLOOHWHQFHQWUDOUROOHIRUSODFHULQJHQDIIRUVNQLQJVRJ XGYLNOLQJVDIGHOLQJHULQGHQIRUWHOHNRPPXQLNDWLRQL1RUGM\OODQG'HWIUHPKYHVHQGYLGHUHDW FHQWHUHWVDPDUEHMGHUPHGHWVWRUWDQWDOYLUNVRPKHGHURJDWIDNXOWHWHWXGGDQQHUHWVWRUWDQWDO NDQGLGDWHULQGHQIRURPUnGHW
&HQWHUHWKDUQHGVDWHQLQWHUQDWLRQDOUnGJLYQLQJVNRPLWH,QWHUQDWLRQDO$GYLVRU\%RDUGGHUIOJHU FHQWHUHWVDNWLYLWHWHU,UnGJLYQLQJVNRPLWHHQVXGWDOHOVHIUDYXUGHUHVDNWLYLWHWHUQHYHGFHQWHUHW SRVLWLYWRJEODQGWDQGHWIUHPKYHVGHQRPIDWWHQGHWLGVVNULIWSXEOLFHULQJRJGHOWDJHOVHYHG NRQIHUHQFHUVDPWVWDQGDUGLVHULQJVDNWLYLWHWHURJIRUVNQLQJVSURMHNWHUVDPPHQPHGHUKYHUYVOLYHW
&HQWHUHWVDNWLYLWHWHUILQDQVLHUHVDIIDNXOWHWHWRJ6WDWHQV7HNQLVN9LGHQVNDEHOLJH)RUVNQLQJVUnG3n EHVJHWRJLELODJVPDWHULDOHWJUHVGHURSPUNVRPSnDWUDPPHEHYLOOLQJHQIUDIRUVNQLQJVUnGHW VQDUWXGOEHURJDWFHQWHUHWGHUIRUKDUEHKRYIRUDWILQGHDOWHUQDWLYHILQDQVLHULQJVNLOGHUIRUDW RSUHWKROGHVLQHDNWLYLWHWHU
E )RUVNQLQJVNYDOLWHW
,VHOYHYDOXHULQJHQDQIUHVGHWDWNYDOLWHWHQDIIDNXOWHWHWVIRUVNQLQJGHOVYXUGHUHVYHGDW PHGDUEHMGHUQHLNRQNXUUHQFHPHGDQGUHIRUVNHUHDQVJHURPRJInUWLOGHOWUHVVRXUFHUIUD IRUVNQLQJVUnGRJSULYDWHIRQGHGHOVYXUGHUHVYHGJHQQHPIUHOVHDIIRUVNQLQJVHYDOXHULQJHUDI LQVWLWXWWHUQHVIRUVNQLQJKYHUWIHPWHnUVHRJVnDIVQLWRPNYDOLWHWVVLNULQJ
(QGYLGHUHYXUGHUHUIDNXOWHWHWPHGXGJDQJVSXQNWLIRUVNQLQJVEHUHWQLQJHQRPIDQJHWRJNYDOLWHWHQ DIDOOHSURIHVVRUHUVRJOHNWRUHUVIRUVNQLQJLKHQKROGWLOIOJHQGHWUHNDWHJRULHUVUOLJW
IRUVNQLQJVDNWLYHQRUPDOWIRUVNQLQJVDNWLYHRJVUOLJWXQGHUYLVQLQJVDNWLYH)DNXOWHWHWGHILQHUHU IRUVNQLQJVRPHQVRFLDODNWLYLWHWLPRGVWQLQJWLOIDJOLJXGYLNOLQJKYLONHWPHGIUHUDWIRUVNQLQJHQV
UHVXOWDWHUSRVLWLYHVRPQHJDWLYHVNDOSXEOLFHUHV'HWWHEHW\GHUDWHQYLJWLJLQGLNDWRUIRU YXUGHULQJHQDINYDOLWHWHQRJRPIDQJHWDIGHHQNHOWHIRUVNHUHVIRUVNQLQJHUDQWDOOHWDI
SXEOLNDWLRQHULLQWHUQDWLRQDOWDQHUNHQGWHIDJWLGVVNULIWHULQGOJSnLQWHUQDWLRQDOHIDJNRQJUHVVHU DIKDQGOLQJHURJOLJQHQGH(IWHUDWIDNXOWHWHWHUEHJ\QGWDWWLOGHOHLQVWLWXWWHUQHIRUVNQLQJVnUVYUN HIWHUHQYXUGHULQJDINYDOLWHWHQRJRPIDQJHWDIHQNHOWIRUVNHUHVDUEHMGHHUDQWDOOHWDISXEOLFHUHGH YLGHQVNDEHOLJHDUWLNOHURJNRQIHUHQFHLQGOJVWHJHW,VDPPHSHULRGHKDUGHUYUHWHWIDOGLLNNH SXEOLFHUHGHZRUNLQJSDSHUVPY
7DEHO
9LGHQVNDEHOLJHDUWLNOHURJZRUNLQJSDSHUVPY
QGULQJ
9LGHQVNDEHOLJHDUWLNOHURJNRQIHUHQFHLQGOJ
:RUNLQJSDSHUVPY
$QWDOYLGHQVNDEHOLJHPHGDUEHMGHUHJHQQHPVQLW
.LOGH6HOYHYDOXHULQJHQVGHORJIDNXOWHWVNRQWRUHW
9HGIDNXOWHWHWHUGHULSHULRGHQEOHYHWWLOGHOWGRNWRUJUDGHU
7DEHO
7LOGHOWHGRNWRUJUDGHU
7LOGHOWHGRNWRUJUDGHU
.LOGH6HOYHYDOXHULQJHQVGHO F )RUVNHUXGGDQQHOVH
,RSUHWWHGHIDNXOWHWHWHQIRUVNHUVNROHVRPOHGHVDIHQEHVW\UHOVHSnILUHSHUVRQHU
)RUVNHUVNROHQVSULPUHPnOHUDWVNDEHGHEHGVWPXOLJHUDPPHUIRUIRUVNHUXGGDQQHOVHQRJVLNUH DWIRUVNHUXGGDQQHOVHQHUSnLQWHUQDWLRQDOWQLYHDX'HUXGE\GHVWLSKGSURJUDPPHUXQGHU )RUVNHUVNROHQ
$IVHOYHYDOXHULQJHQIUHPJnUGHWDWHQVWRUGHODIIDNXOWHWHWVSKGVWXGHUHQGHHUILQDQVLHUHWDI HNVWHUQHEHYLOOLQJHU2YHUILQDQVORYHQWLOGHOHVIDNXOWHWHWSKGVWLSHQGLHUKYLONHWJLYHUJUXQGODJ IRUDWDQVWWHVWLSHQGLDWHURPnUHW6RPIOJHDIHNVWHUQHEHYLOOLQJHURSVOnUIDNXOWHWHWKYHUWnU
JDQJHVnPDQJHVWLSHQGLHU6RPGHWIUHPJnUDIQHGHQVWnHQGHWDEHOHURSWDJHWDISKG VWXGHUHQGHVWHJHWLSHULRGHQVHOYRPGHUHUEHW\GHOLJHXGVYLQJPHOOHPGHIRUVNHOOLJHnU, SHULRGHQKDUGHUHQGYLGHUHYUHWHQVWLJQLQJSnLDQWDOOHWDIWLOGHOWHSKG JUDGHU
7DEHO
7LOGHOWHSKGJUDGHURJRSWDJQHSKGVWXGHUHQGH
3KGJUDGHU
2SWDJQHSKGVWXGHUHQGH
.LOGH6HOYHYDOXHULQJHQVGHO)RUVNHUXGGDQQHOVHVUnGHWVVHNUHWDULDW)DNXOWHWVNRQWRUHW 1RWHªªLQGLNHUHULQJHQRSO\VQLQJHU
,)RUVNHUVNROHQVELGUDJWLOVHOYHYDOXHULQJHQIUHPKYHVEODQGWDQGHWIOJHQGHUHVXOWDWHUHQ JHQQHPVQLWOLJJHQQHPIUHOVHVWLGSnnUDQWDOOHWDIXGEXGWHSKGNXUVHUHUVWDGLJWVWLJHQGH RJDIDOOHSKGVWXGHUHQGHHUSnOQJHUHYDUHQGHPHUHHQGWUHPnQHGHUXGODQGVRSKROG 'HVXGHQIUHPKYHVGHWLVHOYHYDOXHULQJHQDW)RUVNHUVNROHQKDUVLNUHWDWIRUVNHUXGGDQQHOVHQWDJHV DOYRUOLJWRJVnUHVVRXUFHPVVLJWYHGIDNXOWHWHWRJDWXGGDQQHOVHQNYDOLWHWVVLNUHV
,IOJHGHQUHJLVWHUEDVHUHGHXQGHUVJHOVHILQGHUPHUHHQGKDOYGHOHQDIIDNXOWHWHWVSKGHUH DQVWWHOVHLGHWSULYDWHHUKYHUYVOLY
G 6DPDUEHMGHPHGYLUNVRPKHGHURJRUJDQLVDWLRQHU
$IVHOYHYDOXHULQJHQIUHPJnUGHWDWIDNXOWHWHWQVNHUDWWLOVN\QGHWLOVDPDUEHMGHPHGDOOHUHOHYDQWH SDUWHUXGHQIRUXQLYHUVLWHWHWVRPKDUHQLQWHUHVVHLIDNXOWHWHWVYLUNVRPKHG)DNXOWHWHWQVNHU HQGYLGHUHDWPHGYLUNHWLOHQIRUPDOLVHULQJDIVDPDUEHMGHWPHGXQLYHUVLWHWHUPYQnUGHUHUWDOHRP HWVDPDUEHMGHRYHUOQJHUHWLG
,RSUHWWHGHXQLYHUVLWHWHWHWQHWYUNVFHQWHUPHGKHQEOLNSnDWV\VWHPDWLVHUHRJVW\UNH XQLYHUVLWHWHWVIRUPLGOLQJVUHODWLRQHUPHGGHWRPJLYHQGHVDPIXQG1HWYUNVFHQWHUHWVNDOIXQJHUH VRPHQV\QOLJRJXIRUPHOLQGJDQJVSRUWDOWLOVDPDUEHMGVUHODWLRQHUPHGXQLYHUVLWHWHW6LGHQ HWDEOHULQJHQHUGHUVNHWHQEHW\GHOLJYNVWLDQWDOOHWDIIRUPDOLVHUHGHQHWYUNRJ
QHWYUNVPHGOHPPHUMIQHGHQVWnHQGHWDEHO
7DEHO
1HWYUNVDNWLYLWHWHUKHOHXQLYHUVLWHWHW
$QWDOQHWYUN
$QWDOQHWYUNVPHGOHPPHU
.LOGH6HOYHYDOXHULQJHQVGHO
)RUDWNQ\WWHXQLYHUVLWHWHWRJHUKYHUYVOLYHWWWWHUHVDPPHQHUXQLYHUVLWHWHWLVDPDUEHMGHPHG 1RUGM\OODQGV$PWLJDQJPHGDWXGYLNOHGDWDEDVHQ9LGHQVEDVH1RUGM\OODQG'DWDEDVHQVNDO NRRUGLQHUHRJIRUPLGOHQXYUHQGHIRUVNQLQJVSURMHNWHURJIRUVNQLQJVUHVXOWDWHUSn$DOERUJ 8QLYHUVLWHWWLOJDYQIRUEnGH$DOERUJ8QLYHUVLWHWRJHUKYHUYVOLYHWL1RUGM\OODQG
$QWDOOHWDIVDPDUEHMGVDIWDOHUPHOOHPIDNXOWHWHWVIRUVNHUHIRUVNQLQJVPLOMHURJSULYDWH YLUNVRPKHGHUHUVWHJHWPHGLSHULRGHQRJGHQJHQQHPVQLWOLJHLQGWJWSU VDPDUEHMGVDIWDOHHUVWHJHWFLUNDNUMIQHGHQVWnHQGHWDEHO
7DEHO
6DPDUEHMGVDIWDOHUPHGSULYDWHYLUNVRPKHGHU
$QWDOVDPDUEHMGVDIWDOHU
*HQQHPVQLWOLJLQGWJWSUDIWDOHNU
6DPOHWLQGWJWNU
.LOGH6HOYHYDOXHULQJHQVGHO
129,LQQRYDWLRQ$6QYQHVVRPHQYLJWLJNDWDO\VDWRUIRUUHVXOWDWHULUHODWLRQWLO
IRUVNQLQJVIRUPLGOLQJLIRUPDIVSLQRIIYLUNVRPKHGHU129,GHUEOHYLQGYLHWLHUHQEODQGLQJ DIIRUVNHUSDUNLQQRYDWLRQVPLOMRJYHQWXUHLQYHVWRU.RQNUHWQYQHVWHOHNRPPXQLNDWLRQVRJ DNXVWLNRPUnGHWVRPHNVHPSOHUKYRUIDNXOWHWHWKDUYUHWHQPHGYLUNHQGHIDNWRULXGYLNOLQJHQDI NRPSHWHQFHRJNRQNXUUHQFHHYQHEODQGWIOHUHUHJLRQDOHRJQDWLRQDOHYLUNVRPKHGHU
$QDO\VHURJYXUGHULQJHU
(YDOXHULQJVJUXSSHQILQGHUDWGHQIDJOLJHRUJDQLVHULQJHUYLJWLJIRUDWIRUVWnIDNXOWHWHWVVXFFHVHUSn IRUVNQLQJVRPUnGHW)DNXOWHWHWVIRUVNQLQJVRUJDQLVHULQJRJGHUPHGGHQIRUPHOOHRSGHOLQJDI
IDJRPUnGHUQHHUSUJHWDIEHW\GHOLJG\QDPLN'HWHURSIDWWHOVHQIUDVnYHOVHOYHYDOXHULQJVRP EHVJDWIDNXOWHWHWVIDJOLJHRUJDQLVHULQJPHGIRUGHONDQIRUVWnVXGIUDHWSURMHNWSHUVSHNWLYGHU LNNHHUXOLJGHQPnGHXQGHUYLVQLQJHQRUJDQLVHUHVSn'HWNRPPHUWLOXGWU\NYHGDWRUJDQLVDWLRQHQ IRUDQGUHVJHQQHPNQRSVN\GQLQJKYRUDIGHOLQJHUI[RSUHWWHVXQGHULQVWLWXWWHUQHIRUHYHQWXHOW VHQHUHDWXGJUHW\QJGHSXQNWHWLHWFHQWHUHOOHURPYHQGWKYRUFHQWUHEOLYHULQGOHMUHWLHWLQVWLWXW 'HQQHG\QDPLNKDULNNHPLQGVWYUHWYLJWLJLHQVLWXDWLRQKYRUIRUVNQLQJVIHOWHUQHRIWHKDUOLJJHW SnJUQVHQDIWUDGLWLRQHOOHIRUVNQLQJVIHOWHU
)DNXOWHWHWVEHVNULYHOVHDIIRUVNQLQJVRUJDQLVHULQJHQWDJHUDIVWLHQPDWUL[IRUVWnHOVHGHUJLYHU EHJUQVHWPXOLJKHGIRUDWIRUVWnGHQG\QDPLNGHUHULRUJDQLVDWLRQHQRYHUWLG'HUIRUYLO HYDOXHULQJVJUXSSHQDQEHIDOHIDNXOWHWHWDWDUEHMGHDNWLYWSnDWRSQnHQJHWIRUVWnHOVHDIGHW VUHJQHYHGIRUVNQLQJVPLOMHWSnIDNXOWHWHWKHUXQGHUKYLONHQPnGHGHWWHKDUPHGYLUNHWWLOGH VXFFHVHUIDNXOWHWHWKDUNXQQHIUHPYLVHSnRPUnGHW
$QEHIDOLQJHQVNDOGHVXGHQVHVLO\VHWDIDWEnGHQnUGHWJOGHUIRUVNQLQJRJQnUGHWJOGHU XGGDQQHOVHKDUIDNXOWHWHWHQWLOJDQJGHUDIYLJHUIUDGHQWUDGLWLRQHOOHXQLYHUVLWUHWLOJDQJ3n XGGDQQHOVHVRPUnGHWHUGHUHWKMWEHYLGVWKHGVQLYHDXRPNULQJKYRULVW\UNHUQHEHVWnU'HQQH EHYLGVWKHGJHQILQGHUHYDOXHULQJVJUXSSHQLNNHSnIRUVNQLQJVRPUnGHW
)DNXOWHWHWVRUJDQLVHULQJDIIRUVNQLQJHQLLQVWLWXWWHUDIGHOLQJHURJFHQWUHV\QHVLNNHDWIOJHHQNODU ORJLN+YHUNHQDIVHOYHYDOXHULQJHQHOOHUDIEHVJHWEOHYGHWNODUWKYDGGHUNRQVWLWXHUHUKHQKROGVYLV HWLQVWLWXWHQDIGHOLQJRJHWFHQWHURJGHUV\QHVDWYUHIRUVNHOOLJHRSIDWWHOVHUSnIDNXOWHWHWDI GHOVKYRUGDQRJKYRUQnUGHURSUHWWHVKHQKROGVYLVFHQWUHRJLQVWLWXWWHUGHOVKYLONHQUHODWLRQGHU VNDOYUHPHOOHPFHQWUHRJLQVWLWXWWHU(YDOXHULQJVJUXSSHQKDUIRUVWnHOVHIRUDW
FHQWHUNRQVWUXNWLRQHUHUYHOHJQHGHWLODWVNDEHHNVWHUQHNVSRQHULQJDIIDNXOWHWHWVIRUVNHOOLJH DNWLYLWHWHU$OOLJHYHOILQGHUHYDOXHULQJVJUXSSHQDWIDNXOWHWHWEUNODUJUHSUPLVVHUQHIRU RUJDQLVHULQJHQDIIRUVNQLQJPYLLQVWLWXWWHUDIGHOLQJHURJFHQWUH
,VHOYHYDOXHULQJHQHUIDNXOWHWHWVRSJUHOVHDIUHVXOWDWHULYLGXGVWUNQLQJRULHQWHUHWPRG
NYDQWLWDWLYHYNVWSDUDPHWUH8GRYHUDWGHUHUWDOHRPVWLJQLQJHUHUGHWLNNHNODUWKYRUGDQGLVVH XGYLNOLQJHUVNDOHYDOXHUHVRJKYDGGHVLJHURPNYDOLWHWHQDIIDNXOWHWHWVIRUVNQLQJ6RPELODJWLO IDNXOWHWHWVVHOYHYDOXHULQJHUGHUYHGODJWHNVHPSOHUSnHNVWHUQHHYDOXHULQJHUDIKHOH
IRUVNQLQJVPLOMHU(YDOXHULQJHUQHGRNXPHQWHUHUDWGHUIRUHJnUIRUVNQLQJSnKMWQLYHDX'HWHU HYDOXHULQJVJUXSSHQVRSIDWWHOVHDWGHWYLOOHKDYHYUHWJLYHQGHIRUHYDOXHULQJHQKYLVIDNXOWHWHWYDU NRPPHWPHGHQV\VWHPDWLVNNYDOLWDWLYYXUGHULQJDIIRUVNQLQJVPLOMHUQHVRPVXSSOHPHQWWLOGHQ NYDQWLWDWLYHEHO\VQLQJ,NNHPLQGVWVHWLO\VHWDIDWIDNXOWHWHWHNVSOLFLWVNULYHULVHOYHYDOXHULQJHQDW GHWRSHUHUHUPHGHQLQGGHOLQJDIIRUVNQLQJHQLILUHNODVVHU:RUOG&ODVV,QWHUQDWLRQDO&ODVV 1DWLRQDO&ODVVRJ5HJLRQDO&ODVV(YDOXHULQJVJUXSSHQEHPUNHUDWGHWIRUHNRPPHUNXQVWLJWDW
EHWHJQHGHQPLQGVWYHOO\NNHGHIRUVNQLQJVRPUHJLRQDOSnHWXQLYHUVLWHWGHUQHWRSKDUKDIWVXFFHV PHGDWVNDEHG\QDPLNPHOOHPGHWUHJLRQDOHRJGHWLQWHUQDWLRQDOHQLYHDX
,IRUOQJHOVHKHUDIHUGHWHYDOXHULQJVJUXSSHQVRSIDWWHOVHDWIDNXOWHWHWVNYDQWLWDWLYWRULHQWHUHGH PnGHDWRSJUHVLQHUHVXOWDWHUSnVWLOOHUIDNXOWHWHWRYHUIRUHWGLOHPPD3nGHQHQHVLGHJUGHQ GHWYDQVNHOLJWDWJLYHHQI\OGHVWJUHQGHEHO\VQLQJDIIDNXOWHWHWVUHVXOWDWHUGHUNXQLEHJUQVHW RPIDQJODGHUVLJEHVNULYHDIHQNRQYHQWLRQHONYDQWLWDWLYWRULHQWHUHWGRNXPHQWDWLRQ3nGHQDQGHQ VLGHHUGHQNRQYHQWLRQHOOHWLOJDQJHWYVHQWOLJELGUDJWLODWNXQQHGRNXPHQWHUHVLQHUHVXOWDWHUL IRUKROGWLORPYHUGHQHQ,GHQIRUELQGHOVHVNDOGHWEHPUNHVVRPSRVLWLYWDWIDNXOWHWHWKDUHW DGPLQLVWUDWLYWV\VWHPGHUNDQJLYHRSO\VQLQJHURPUHVXOWDWRSQnHOVH
(YDOXHULQJVJUXSSHQYLODQEHIDOHIDNXOWHWHWQMHDWRYHUYHMHKYRUGDQGHUNDQRSQnVEDODQFHPHOOHP GHWRSROHULGLOHPPDHWXGHQDWULVLNHUHDWVWWHGHVUOLJHNDUDNWHULVWLNDGHUHUIDNXOWHWHWV VW\UNHSRVLWLRQRYHUVW\U
'HWYXUGHUHVLXGJDQJVSXQNWHWSRVLWLYWDWIDNXOWHWHWJHQQHPGHVLGVWHnUKDUJHWDQWDOOHWDI DUWLNOHUSXEOLFHUHWLWLGVVNULIWHUPHGSHHUUHYLHZOLJHVRPGHWYXUGHUHVSRVLWLYWDWGHWHUO\NNHGHV IDNXOWHWHWDWWLOWUNNHVWLJHQGHHNVWHUQHIRUVNQLQJVPLGOHU(YDOXHULQJVJUXSSHQILQGHUGHW DIJUHQGHDWGHUHUHQRSPUNVRPKHGRPNULQJDWGHQPnGHIDNXOWHWHWRSJUVLQHUHVXOWDWHUSn SnIDNXOWHWVQLYHDXKDUNRQVHNYHQVHUIRUKYRUGDQIRUVNHUQHDJHUHU$IEHVJHWIUHPJLNGHWDW SXEOLFHUHGHDUWLNOHUHUHQSDUDPHWHUVRPGHULQWHUQWSnIDNXOWHWHWOJJHVPHJHWYJWSnRJVRP KDUHQYLVDGIUGVUHJXOHUHQGHHJHQVNDE6RPGHWEOHYVDJWSnHWPGHXQGHULQVWLWXWLRQVEHVJHW VnInUPDQDUWLNOHUQnUPDQWOOHUDUWLNOHU
'HWHUHYDOXHULQJVJUXSSHQVRSIDWWHOVHDWIRNXVHULQJHQSnHNVWHUQSXEOLFHULQJKDUYUHWPHGWLODW VW\UNHRSPUNVRPKHGHQRPNULQJIRUVNQLQJSnIDNXOWHWHW6DPWLGLJHUGHUWYLYORPKYRUYLGWGHQQH VWUDWHJLHUKHQVLJWVPVVLJSnODQJWVLJWIRUGLHWXSULRULWHUHWIRNXVSnHNVWHUQSXEOLFHULQJNDQ PHGIUHHQULVLNRIRUIDJOLJXGW\QGLQJSnEHNRVWQLQJDIGHWVUHJQHYHGIDNXOWHWHWVIRUVNQLQJI[
GHQSURMHNWRULHQWHUHGHRUJDQLVHULQJVIRUPRJRULHQWHULQJHQPRGHUKYHUYVOLYHW
)RUVNHUVNROHQRSIDWWHVVRPHWSRVLWLYWLQLWLDWLYGHUNDQPHGYLUNHWLODWVWWHIRNXVSn
IRUVNHUXGGDQQHOVHQRJVLNUHDWGHQWDJHVDOYRUOLJWSnLQVWLWXWWHUQH6DPWLGLJHUGHWLQGWU\NNHWIUD LQVWLWXWLRQVEHVJHWRJIUD)RUVNHUVNROHQVELGUDJWLOVHOYHYDOXHULQJHQDW)RUVNHUVNROHQHQGQXLNNH KDUIXQGHWVLQHQGHOLJHIRUPSnDOOHRPUnGHU%ODQGWDQGHWIUHPVWnUIDNXOWHWHWVXGI\OGHOVHDIGH IRUPHOOHUDPPHUIRUIRUVNHUXGGDQQHOVHQPHGHQGHOLJVWXGLHSODQRJKDOYnUVHYDOXHULQJHUVRPPHUH EXUHDXNUDWLVNHHQGKYDGGHUHUKHQVLJWVPVVLJW6DPOHWKDUHYDOXHULQJVJUXSSHQLNNHInHWLQGWU\N DIDW)RUVNHUVNROHQKDUUHDOLVHUHWGHQWLOWQNWHSRVLWLRQLIRUKROGWLOIRUVNHUXGGDQQHOVHQSn
IDNXOWHWHW
'HWHUHYDOXHULQJVJUXSSHQVRSIDWWHOVHDWIDNXOWHWHWKDUWDJHWYLGHQVRYHUIUVHOWLOHUKYHUYVOLYHW DOYRUOLJW1HWYUNVFHQWHUHWRJGHPDQJHVDPDUEHMGVSURMHNWHUHUHNVHPSOHUSnGHWWH)DNXOWHWHW KDUHWDEOHUHWHQEUHGNRQWDNWIODGHWLOYLUNVRPKHGHURJDQGUHRUJDQLVDWLRQHU'HWHURSIDWWHOVHQDW GHUHUEHW\GHOLJHIRUVNHOOHSnGHIRUVNHOOLJHRPUnGHU,QGHQIRUWHOHNRPPXQLNDWLRQVRPUnGHWHUGHW I[HYDOXHULQJVJUXSSHQVRSIDWWHOVHDWGHUHUVNDEWQHWYUNGHUHUYRNVHWIUHPRYHUHQOQJHUH SHULRGH3nDQGUHRPUnGHUHUGHUIUVWIRUQ\OLJWDJHWLQLWLDWLYHUGHUVNDOVW\UNHVDPDUEHMGH'HW JOGHUI[1RXKDX]GHUHUHWFHQWHUHWDEOHUHWPHGGHWIRUPnODWVW\UNHVDPDUEHMGHWPHOOHP ,QVWLWXWIRU'DWDORJLRJHUKYHUYVOLYHW
'HWHUHYDOXHULQJVJUXSSHQVRSIDWWHOVHDWGHQ\HRPUnGHUGHUHUKMHPWDJHWEODQGWDQGHW
VWDPFHOOHIRUVNQLQJVPLOMHWRJHQGHODIGHWELRWHNQLVNHPLOMLNNHKDUGHQVDPPHJUDGDINRQWDNW WLOGHWORNDOHRJUHJLRQDOHHUKYHUYVOLY
)DNXOWHWHWRSIRUGUHVWLODWXQGHUVWWWHDWHWVnGDQWNRQWDNWQHWHWDEOHUHVGDHUKYHUYVNRQWDNWHQHUHW YUGLIXOGWNHQGHWHJQIRUIDNXOWHWHWVRPGHWIRUPRGHQWOLJYLONUYHHQDNWLYLQGVDWVDWRSUHWKROGHL WDNWPHGDWIDNXOWHWHWYRNVHURJWLOIUHVIOHUHRPUnGHU6DPWLGLJNDQHUKYHUYVNRQWDNWHQEOLYH FHQWUDOQnUGHQIDJOLJHLQGVDWVVNDOVLNUHHQEUHG\JWLJXGGDQQHOVHVDNWLYLWHW
9LGHQVRYHUIUVHOIUDYLUNVRPKHGHUWLOXQLYHUVLWHWHWVSLOOHUHQEHVNHGHQUROOHLIDNXOWHWHWV
VHOYHYDOXHULQJ3nLQVWLWXWLRQVEHVJHWJDYIDNXOWHWHWXGWU\NIRUDWGHUHURSPUNVRPKHGRPNULQJ GHWWH'HWEOHYGRJVDPWLGLJSnSHJHWDIHQGHODIGHYLUNVRPKHGHUIDNXOWHWHWVDPDUEHMGHUPHG LNNHKDUHJHQIRUVNQLQJVSURGXNWLRQ'HWHURSIDWWHOVHQDWIDNXOWHWHWPHGIRUGHONXQQHLQGWQNH YLGHQVRYHUIUVHOIUDYLUNVRPKHGHUWLOIDNXOWHWHWPHUHDNWLYWLVLQRPYHUGHQVEHVNULYHOVH
,IRUKROGWLOGHWLQWHUQDWLRQDOHSHUVSHNWLYILQGHUHYDOXHULQJVJUXSSHQDWHWYLJWLJWDVSHNWYHG LQWHUQDWLRQDOLVHULQJHUDWGHUEHGULYHVIRUVNQLQJSnHWQLYHDXVnLQWHUQDWLRQDOHNROOHJDHUEOLYHU LQWHUHVVHUHWLVDPDUEHMGH
6WUXNWXUHURJSURFHVVHU
,GHWWHNDSLWHOEHKDQGOHVGHVWUXNWXUHURJSURFHVVHUGHUXGJUJUXQGODJHWIRUGHUHVXOWDWHU IDNXOWHWHWKDURSQnHW.DSLWOHWRPKDQGOHUVnDWVLJHGHWDSSDUDWIDNXOWHWHWDQYHQGHUIRUDWRSQn VLQHUHVXOWDWHU.DSLWOHWHURSGHOWLILUHXQGHUDIVQLW'HWIUVWHIRNXVHUHUSnKYRUGDQIDNXOWHWHW IRUPXOHUHUPnOVWQLQJHUIRUVLQYLUNVRPKHGPnOVWQLQJHURJVWUDWHJL'HWDQGHWEHKDQGOHUGHQ RUJDQLVDWLRQVVWUXNWXUGHUHUSnIDNXOWHWHW'HWWUHGMHRPKDQGOHUGHQOHGHOVHVPRGHOGHUHUYDOJWSn IDNXOWHWHW7LOVLGVWEHKDQGOHVGHNYDOLWHWVVLNULQJVPHNDQLVPHUGHUHUHWDEOHUHWWLODWEHO\VHRJ XGYLNOHNYDOLWHWHQDIIDNXOWHWHWVXGGDQQHOVHRJIRUVNQLQJ
'HILUHDIVQLWHURSGHOWVnOHGHVDWIDNXOWHWVIUHPVWLOOLQJIUVWJHQJLYHVHIWHUIXOJWDI HYDOXHULQJVJUXSSHQVDQDO\VHURJYXUGHULQJHU
0nOVWQLQJHURJVWUDWHJL
$IVHOYHYDOXHULQJHQIUHPJnUGHWDWYLVLRQHQIRUIDNXOWHWHWVDUEHMGHHUDWELGUDJHWLOVDPIXQGHWV EHKRYIRUYLGHQ'HQYLGHQIDNXOWHWHWQVNHUDWELGUDJHPHGVNDOYUHEDVHUHWSnHQJOREDO IRUDQNULQJRJHWUHJLRQDOWDQVYDURJIRUHQHGHQDNDGHPLVNHWUDGLWLRQPHGGHQSURIHVVLRQVUHWWHGH ,IDNXOWHWHWVVWUDWHJLSODQIUDIRUPXOHUHVPnOVWQLQJHQIRUIDNXOWHWHW
¨'HWRYHURUGQHGHVLJWHGHUDQOJJHVIRURSJDYHUQHVOVQLQJHUDW ELGUDJHWLOGHWGDQVNHYHOIUGVVDPIXQGVIRUWVDWWHXGYLNOLQJVDPWELGUDJH WLOGHWLQWHUQDWLRQDOHIRUVNHUVDPIXQGVIUHPEULQJHOVHDIQ\YLGHQ0HUH NRQWDQWHUGHWIDNXOWHWHWVPnODWPHGYLUNHWLODWKYHWHNQRORJLLQGKROGHWL GDQVNHYLUNVRPKHGHURJSURGXNWHUDWXGYLNOHRPUnGHWIRUGHWWHNQLVN PXOLJHVDPWDWXGYLNOHYRUHVQDWXUYLGHQVNDEHOLJHHUNHQGHOVH¨
6DPPHPnOVWQLQJIUHPJnUDIVHOYHYDOXHULQJHQVHOYRPGHULNNHEUXJHVLGHQWLVNHIRUPXOHULQJHU
,IRUKROGWLODWEHVNULYHIDNXOWHWHWVQXYUHQGHNRQNUHWHPnOVWQLQJHURSVWLOOHGHIDNXOWHWHWWLOEUXJ IRUVHOYHYDOXHULQJHQHWPnOPLGGHOKLHUDUNLGHUVNDORSIDWWHVVRPHWELOOHGHDIIDNXOWHWHWVDNWXHOOH PnOVWQLQJHU