ABSTRACT
LRQRIWKH5HSRUWV GVRIWKH,QGLYLGXDO6WXGLHV V
INTRODUCTION
GGLQJQHZ WHVWLQJSURFHGXUHV WR UHJXODWRU\SURFHVVHV IROORZV ORSPHQWWHVWYDOLGDWLRQDQGWHVWDFFHSWDQFH%DOOVHWDO WKHSURFHVVRIFRQFHLYLQJGHVLJQLQJDQGPDNLQJWKHWHVWZRUN YLQFLQJRWKHUVWKDWWKHWHVWLVZRUWK\RIHQWHULQJWKHYDOLGDWLRQ RQLVWKHSURFHVVRIGHWHUPLQLQJZKHWKHURWKHUODERUDWRULHVFDQ WHVWDQGJHWWKHH[SHFWHGUHVXOWV7HVWDFFHSWDQFHLVWKHGHFLVLRQ HQFLHV WKDW WKH WHVW FDQ EH URXWLQHO\ XVHG IRU WKHLU VSHFLÀHG HVWHSVVKRXOGEHIROORZHGZKHWKHUWKHWHVWLVDQHZSURFHGXUH HSODFHRUDXJPHQWDQHVWDEOLVKHGSURFHGXUH,QSUDFWLFHWKHVH
LQFRPSOHWHO\ SHUIRUPHG DQG UHFRUGHG MXPEOHG WRJHWKHU RU HU%HFDXVHRIWKLVIDLOXUHWRDFKLHYHDGHÀQHGSURFHVVZHDUH DFFHSWHG WHVWSURFHGXUHVZKHUH LQVWUXFWLRQVDUH LQFRPSOHWHRU HKDYHQRHYLGHQFHWKDWWKHUHVXOWVDUHFRQVLVWHQWRUDFFXUDWHO\ V WKDWZH DUH REVHUYLQJ7KLV KDV EHFRPHSDUWLFXODUO\ WUXH LQ
WKH JHQHUDO SURFHVV SURFHGXUHVDQGWKHG 2UJDQL]DWLRQIRU(FR 7KLVFKDSWHUIRFXVHV UHSRUWVRQWKHGHUPD 3URJUDPV 233 8 VWDQGDUGIRUH[SHULP RSPHQW WR WHVWYDOLG YLYR XVLQJ WKH UDW PHPEUDQHSUHSDUDWLR PDOPHPEUDQHSUHS
METHO
6WXG\UHSRUWVRQ DSHVWLFLGHUHJLVWUDQW UHSRUWVFRQIRUPWRW UHTXLUHPHQWVDUHLQ 5HJXODWRU\ UHTXLUHP WKH\FRQVLVWRI UHTX RI QR GDWD FRQÀGHQ VWDWHPHQWVLJQHGT UDF\VLJQHGWDEOHR DUHWKRVHRIWKHLQGLY UHTXLUHPHQWV DUH VS KDYHWKHIRUFHRIODZ ZLWKWKHW\SHRIVWXG LQWKH*XLGHOLQHIRU WKH\ FRQVLVW RI WKH YHKLFOHDQGH[SHULP YDWLRQVDQGSUHSDUD WLRQ RI WKH DSSOLFDW FROOHFWLRQDQGVDPS XVXDOO\LQDSSHQGLFH 7KHUHSRUWVRIWKHDF
7KHVWXGLHVZHU FULWHULDIRUDGHUPDO
RI YDOLGDWLQJ LQ YLWUR GHUPDO DEVRUSWLRQ GHUPDO SHQHWUDWLRQ HYHORSPHQWRILQYLWURGHUPDODEVRUSWLRQWHVWJXLGHOLQHVE\WKH QRPLF&RRSHUDWLRQDQG'HYHORSPHQW2(&'$QRQ RQWKHÀUVWVWHSRIWKHSURFHVVWHVWGHYHORSPHQWDQGXVHVWKH ODEVRUSWLRQRIDFHWRFKORUVXEPLWWHGWRWKH2IÀFHRI3HVWLFLGH 6 (QYLURQPHQWDO 3URWHFWLRQ$JHQF\ (3$ WR LOOXVWUDWH WKH HQWDOGHVLJQDQGUHSRUWLQJQHFHVVDU\WRPRYHIURPWHVWGHYHO DWLRQDQGXOWLPDWHDFFHSWDQFH7KHVWXGLHVZHUHSHUIRUPHG LQ /\WKJRH DQG -RQHV LQ YLWUR XVLQJ WKH UDW HSLGHUPDO Q&ORZHVDQG6FRWWDDQGLQYLWURLQWKHKXPDQHSLGHU DUDWLRQ&ORZHVDQG6FRWWE
DS FOR EVALUATION OF THE REPORTS
WKHGHUPDODEVRUSWLRQRIDFHWRFKORUZHUHVXEPLWWHGWR233E\ LQWKHSURFHVVRIUHUHJLVWUDWLRQRIWKHSHVWLFLGHDFHWRFKORU7KH KH233UHTXLUHPHQWVIRUVWXG\WHVWUHSRUWLQJ233UHSRUWLQJ WZRSDUWVUHJXODWRU\UHTXLUHPHQWVDQGVFLHQWLÀFUHTXLUHPHQWV HQWV DSSO\ WR DOO VWXG\ UHSRUWV VXEPLWWHG WR233 ,Q JHQHUDO LUHPHQWV IRUDQGGHWDLOHGFRPSRVLWLRQRI WLWOHSDJH VWDWHPHQW WLDOLW\ FODLPV VLJQHG JRRG ODERUDWRU\ SUDFWLFH FRPSOLDQFH XDOLW\DVVXUDQFHVWDWHPHQWVLJQHGFHUWLÀFDWLRQRIGDWDDFFX IFRQWHQWVVXPPDU\DQGERG\RIUHSRUW7KHVLJQDWXUHVUHTXLUHG LGXDOVUHVSRQVLEOHIRUHDFKSDUWLFXODUDVSHFWRIWKHVWXG\7KHVH HFLÀHG LQ WKH IHGHUDO UHJLVWHU &)5 SDUWV WR DQG 7KHVFLHQWLÀFUHTXLUHPHQWVIRUUHSRUWLQJYDU\WRVRPHH[WHQW \7KHUHTXLUHPHQWVIRUGHUPDODEVRUSWLRQVWXGLHVDUHVSHFLÀHG 'HUPDO$EVRUSWLRQRI3HVWLFLGHV=HQG]LDQ,QJHQHUDO IROORZLQJ LGHQWLÀFDWLRQ DQG SURSHUWLHV RI WKH WHVW FRPSRXQG HQWDODQLPDOWKHH[SHULPHQWDOGHVLJQDQLPDOKXVEDQGU\REVHU WLRQIRUGRVLQJGRVHSUHSDUDWLRQGRVHDSSOLFDWLRQDQGSURWHF LRQ VLWH KDQGOLQJ GXULQJ H[SRVXUH DQG WHUPLQDWLRQ VDPSOH OHDQDO\VLV$OOGDWDJHQHUDWHGGXULQJWKHVWXG\PXVWEHUHSRUWHG VDQGWKHUHVXOWVGLVFXVVHGZLWKVXPPDU\WDEOHVRULOOXVWUDWLRQV HWRFKORUVWXGLHVVDWLVÀHGDOORIWKHVHGDWDUHSRUWLQJUHTXLUHPHQWV H MXGJHGVFLHQWLÀFDOO\DFFHSWDEOH ,QHDFKVWXG\ WKH IROORZLQJ DEVRUSWLRQVWXG\ZHUHPHW
,QHDFKVWXG\UD XQODEHOHGDFHWRFKORU IRUPXODWLRQ'RVHVD UDWDQG ZHUH IRUWKHKXPDQLQYLWU VLPLODUWRDOORZFRP
,Q SDUWLFXODU WKH VWXG\ ZDV LGHQWLFDO GXUDWLRQVZHUHXVHG WKURXJKWKHVNLQPHP
MATERIALS
'RVHSUHSDUDWLRQ VWXGLHV/\WKJRHDQ
'RVHVROXWLRQVZ RI DFHWRFKORU EHIRU VDPSOH FROOHFWLRQ IR IROORZV
GLRODEHOHGDFHWRFKORU&SKHQ\OZDVWKHWUDFHUGLOXWHGZLWK ZKHUHQHFHVVDU\WRPDNHXSWKHGRVH,WZDVDSSOLHGLQDXVH SSOLHGZHUHDVIROORZVDQGQJFPLQYLYR DQGQJFPLQYLWURUDWDQGKXPDQ([SRVXUHGXUDWLRQV DQGKUIRUWKHUDWLQYLYRDQGLQYLWURDQGDQGKU R7KHGRVHVDQGGXUDWLRQVRIH[SRVXUHZHUHMXGJHGVXIÀFLHQWO\ SDULVRQRIWKHH[SHULPHQWDOUHVXOWV HYDOXDWLRQ GHWHUPLQHG WKDW WKH WHVWPDWHULDO DSSOLHG LQ HDFK WKH GRVHV ZHUH HVVHQWLDOO\ LGHQWLFDO DQG FRPPRQ H[SRVXUH 7KXVRQHFDQFRPSDUHDQGFRQWUDVWWKHHQWU\LQWRDQGSDVVDJH EUDQHLQWKHWKUHHWHVWV\VWHPV
AND METHODS OF THE INDIVIDUAL STUDIES
ZDV DV IROORZV'RVHSUHSDUDWLRQZDV WKH VDPH LQ WKH WKUHH G-RQHV&ORZHVDQG6FRWWDE
HUHVDPSOHGDQGDQDO\]HGIRUUDGLRDFWLYLW\DQGFRQFHQWUDWLRQ H GXULQJ DQG DIWHU GRVLQJ$QLPDO SUHSDUDWLRQ GRVLQJ DQG U WKH UDW LQ YLYR VWXG\ RI /\WKJRH DQG -RQHV ZHUH DV
$EORRGVDPSOH XDOXULQHZDVUHPRY
7KHUHVLGXDOFDU )RUHDFKUDW LQ W
PJJ DQG DQDO\]HGVNLQZDVK DQGFDUFDVV)RUWKH FDUERQÀOWHUZHUHDQ
7KHHSLGHUPDOP DQG6FRWWD
ZDVWDNHQE\FDUGLDFSXQFWXUHDQGWKHDQLPDOVDFULÀFHG5HVLG HGIURPWKHEODGGHUDQGDGGHGWRWKHXULQHFROOHFWLRQ
FDVVZDVUHWDLQHGIRUDQDO\VLV KH IRUPXODWLRQFRQFHQWUDWH PJJDTXHRXVGLOXWLRQ DTXHRXV GLOXWLRQ PJJ WKH IROORZLQJ VDPSOHVZHUH SURWHFWLYHFRYHUVNLQDSSOLFDWLRQVLWHXULQHIHFHVFDJHZDVK
DTXHRXVGLOXWLRQPJJWKHUXEEHU¶2·ULQJVDQG DO\]HGVHSDUDWHO\ HPEUDQHXVHGLQWKHVHVWXGLHVZHUHSUHSDUHGDVIROORZV&ORZHV
(DFK HSLGHUPDO DOXPLQXP IRLO LQ D ZLWKLQGD\VRISUH
3HUFXWDQHRXVDEV
7KHYROXPHRI W ZDVDVVHVVHGDVIROOR
3HUFXWDQHRXVDEV
PHPEUDQH ZDV JLYHQ DQ LGHQWLI\LQJ QXPEHU DQG VWRUHG RQ IUHH]HU DW ²r& XQWLO XVHG (SLGHUPDO VDPSOHV ZHUH XVHG SDUDWLRQ RUSWLRQZDVVWXGLHGDVIROORZV&ORZHVDQG6FRWWD
KHFKDPEHUZDVQRW VSHFLÀHG7KH LQWHJULW\RI WKHPHPEUDQH ZV
RUSWLRQRI>&@DFHWRFKORUZDVDVVHVVHGDVIROORZV
7KHIROORZLQJGH VDPSOHFROOHFWLRQIR
9ROXPHIRUWKHU
VFULEHWKHSUHSDUDWLRQRIVNLQVDPSOHVGRVHDGPLQLVWUDWLRQDQG UWKHKXPDQLQYLWURVWXG\&ORZHVDQG6FRWWE
HFHSWRUFKDPEHUZDVQRWVSHFLÀHG
7KHVWXG\UHSRUW HYDOXDWLRQ UHSRUW ' VWXG\ UHSRUWV LQSDU SUHSDUDWLRQGRVLQJ GDWDJHQHUDWHGLQWKH WKHVWXGLHVDUHSUHVH URXQGLQJQXPEHUVP
7DEOH VXPP DQDO\]HGSURYLGHDF FDQIROORZHQWU\LQWR PHQW DQG H[FUHWLRQ IHFHVFDJHZDVKDQ RIGRVH LQ WKHZDVKH OLWWOH FKDQJH ZLWK LQ ZDVKHGVNLQGRHVLQF LQWKHVNLQGHFUHDVHV RI DQG GXUDWLRQ RI H[SRVXUH LQFUHDVHVZLWKLQFUHD 7KLVSDWWHUQLVW\SLFD WKHVNLQ
7DEOH VXPP GLVWULEXWLRQRIFRQFH VKRZVQRLQFUHDVHZ 7KHSHUFHQWRIGRVH LQFUHDVHVZLWKLQFUHD DEVRUEHGLQFUHDVHVZ RI DQG DQGQJFP WKHDEVRUSWLRQFXUYH
RESULTS OF THE STUDIES
VZHUHUHYLHZHGE\WKHÀUVWDXWKRUDQGDUHYLHZFDOOHGDGDWD (5ZDVZULWWHQ IRU HDFK UHSRUW7KH'(5V VXPPDUL]HG WKH WLFXODUPDWHULDO WHVWHGH[SHULPHQWDOGHVLJQPHWKRGVRIGRVH DQLPDOKDQGOLQJVDPSOHFROOHFWLRQDQGVDPSOHDQDO\VLV7KH VWXGLHVZHUHVXPPDUL]HGLQWDEXODUIRUP6XPPDU\UHVXOWVRI QWHGLQ7DEOHVDQGIURPWKH'(5V2ZLQJWR D\QRWDGGXS DUL]HV WKH UHVXOWV IURP WKH UDW LQ YLYR VWXG\ 7KH VDPSOHV RPSOHWHPDWHULDOEDODQFHRIGRVHGLVWULEXWLRQLQWKHUDWV2QH WKHVNLQSDVVDJHWKURXJKWKHVNLQLQWRWKHV\VWHPLFFRPSDUW 7KH DPRXQW DEVRUEHG LV WKH VXPRI DFHWRFKORU LQ WKH XULQH GFDUFDVV2ISDUWLFXODULPSRUWDQFHLVWKHTXDQWLW\DQGSHUFHQW GVNLQDQGDEVRUEHG7KHTXDQWLW\ LQ WKHZDVKHGVNLQVKRZV FUHDVHG GXUDWLRQ RI H[SRVXUH +RZHYHU WKH TXDQWLW\ LQ WKH UHDVHZLWKGRVHEXWWKHSHUFHQWGRHVQRWLQFUHDVH7KHSHUFHQW EHWZHHQQJFPDQGQJFPEXWLVVLPLODUIRUWKHGRVHV QJFP 7KH TXDQWLW\ DEVRUEHG LQFUHDVHV ZLWK LQFUHDVLQJ DQGZLWK LQFUHDVLQJ GRVH ,Q FRQWUDVW WKH SHUFHQW DEVRUEHG VLQJGXUDWLRQRIH[SRVXUHEXWGHFUHDVHVZLWKLQFUHDVLQJGRVH ORIDFKHPLFDOWKDWLVDSSURDFKLQJVDWXUDWLRQLQSDVVDJHWKURXJK
DUL]HV WKH UHVXOWV RI WKH UDW LQ YLWUR VWXG\ +HUH WKH GRVH UQLVZDVKVNLQDQGDEVRUEHG7KHTXDQWLW\LQWKHZDVKHGVNLQ LWKGXUDWLRQRIH[SRVXUHEXWGRHVLQFUHDVHZLWKLQFUHDVLQJGRVH LQWKHVNLQLVVLPLODUIRUDOOIRXUGRVHV7KHTXDQWLW\DEVRUEHG VLQJGXUDWLRQRIH[SRVXUHDQGZLWKLQFUHDVLQJGRVH7KHSHUFHQW
LWKLQFUHDVLQJGXUDWLRQRIH[SRVXUHEXWLVVLPLODUIRUWKHGRVHV QJFP7KHSHUFHQW DEVRUEHGGHFUHDVHVEHWZHHQGRVHVRI LQGLFDWLQJWKDWWKHKLJKGRVHLVRQWKHVDWXUDWLRQSRUWLRQRI
7DEOH VXPP GRVHVZHUHXVHGEXW WRWKHOLPLWHGDYDLODE ZDVK VNLQDQGDEVR LQFUHDVLQJ GXUDWLRQ GRVHLQWKHZDVKHGV ZLWKLQFUHDVLQJGRVH WLRQRIH[SRVXUHIRU RIDQGQJ
2YHUDOO WKHTXDQ VNLQLQYLWURLVJUHDWH
DUL]HV WKH UHVXOWVRI WKHKXPDQ LQYLWUR VWXG\7KHVDPH IRXU WKHGXUDWLRQVRIH[SRVXUHZHUHOLPLWHGWRDQGKUGXH LOLW\RIKXPDQVNLQ$JDLQWKHGRVHGLVWULEXWLRQRIFRQFHUQLV UEHG7KHTXDQWLW\ LQ WKHZDVKHGVNLQGRHVQRW LQFUHDVHZLWK RI H[SRVXUH EXW LW GRHVZLWK LQFUHDVLQJ GRVH7KH SHUFHQW RI NLQLVVLPLODUIRULQFUHDVLQJGXUDWLRQRIH[SRVXUHEXWGHFUHDVHV
7KHTXDQWLW\RIGRVHDEVRUEHGLQFUHDVHVZLWKLQFUHDVLQJGXUD GRVHVRIDQGQJFPEXWLVVLPLODUIRUWKHGRVHV FPLQGLFDWLQJVDWXUDWLRQRIDEVRUSWLRQDWWKHWZRKLJKGRVHV WLW\ DQGSHUFHQW RI GRVH HQWHULQJ DQGSDVVLQJ WKURXJK WKH UDW UWKDQWKDWHQWHULQJDQGSDVVLQJWKURXJKWKHKXPDQVNLQLQYLWUR
7KHVWXGLHVZHUH DOORIWKH233GDWD HTXLSSHGODERUDWRU\ UHSURGXFLEOH 7KDW +RZHYHUWKHUHUHPD VWHS"7KHVWXGLHVZH GDWDDW WKHVDPHIRX DW WKH VDPH IRXU GR KXPDQ+RZGRWKH GHYHORSHUVPXVWSUH
7KHSHUFHQWRIG WR LQYLYRDUHSUHVHQ YLYRVKRXOGDSSUR[LP LQYLWURUDW WR LQYLY GXUDWLRQRIH[SRVXUH LQ WKH UDW RYHUHVWLP GXUDWLRQVZLWKWKHJ ZLWKGRVHDQGGXUDWLR
DISCUSSION
ZHOOGHVLJQHGZHOOSHUIRUPHGDQGZHOOUHSRUWHG7KH\VDWLVÀHG UHSRUWLQJUHTXLUHPHQWV:LWKWKHUHSRUWVLQKDQGDQ\SURSHUO\ FRXOGUHSHDWWKHVWXGLHVDQGGHWHUPLQHZKHWKHUWKHUHVXOWVDUH LV RWKHU ODERUDWRULHV FRXOG SHUIRUP WKH WHVW YDOLGDWLRQ VWHS LQVRQHVPDOOTXHVWLRQ6KRXOGWKHSURFHGXUHHQWHUWKHYDOLGDWLRQ UHFDUHIXOO\GHVLJQHGWRSURGXFHFRPSDUDEOHLQYLYRDQGLQYLWUR UGRVHVDQGWKHVDPHVL[GXUDWLRQVRIH[SRVXUH LQ WKHUDWDQG VHV DQG WKUHHPDWFKLQJ GXUDWLRQV RI H[SRVXUH LQ YLWUR LQ WKH UHVXOWVPDWFK",QRUGHUWRHQWHUWKHWHVWYDOLGDWLRQVWHSWKHWHVW VHQWPDWFKLQJUHVXOWVIURPPDWFKHGLQYLYRDQGLQYLWURWHVWV RVHDEVRUEHGLQYLYRDQGLQYLWURLQWKHUDWDQGWKHUDWLRLQYLWUR WHG LQ7DEOH7REHDFFHSWDEOH WKHUDWLRRI LQYLWUR WR LQ DWHRQHIRUDOOGRVHVDQGGXUDWLRQVRIH[SRVXUH7KHUDWLRVRI
RUDWIRUHDFKGRVHDUHSORWWHGLQ)LJXUHDVUDWLRDJDLQVW 7KHGDWDFOHDUO\VKRZWKDW WKLVSDUWLFXODU LQYLWURSURFHGXUH DWHGGHUPDO DEVRUSWLRQ LQ WKHPDMRULW\ RI GRVHV DQG H[SRVXUH UHDWHVWHUURULQWKHORZHUGRVHV7KHUDWLRYDULHVLQFRQVLVWHQWO\ QRIH[SRVXUH7KHUHLVQRFRPPRQIDFWRUZKLFKZRXOGLQGLFDWH
DV\VWHPDWLFHUURULQ QRWEHFRUUHFWDEOH7 WKHWHVWYDOLGDWLRQVW
:HKDYHQRKXP FDQQRWGLUHFWO\DVVHV YLWURGDWDGRQRWPDWF
WKH LQYLWURSURFHGXUH7KLVLQGLFDWHVWKDWWKHSURFHGXUHPD\
KHGDWDVWURQJO\VKRZWKDWWKHSURFHGXUHLVQRWUHDG\WRHQWHU HS DQ LQYLYRGDWD WRFRPSDUHZLWKWKHKXPDQ LQYLWURGDWDDQGVR V LWVYDOLGLW\+RZHYHU WKHSRLQWKDVEHHQUDLVHG WKDWHYHQ LI LQ KLQYLYRRQHPD\FRPSDUHUDWDQGKXPDQLQYLWURGDWDWRREWDLQ
D UDW WR KXPDQ DEVR PRUH SHUPHDEOH WR F SHUPHDEOH$FRQYHUV KXPDQGHUPDOWR[LFLW HSLGHUPDOPHPEUDQH RILQYLWURUDWWRLQYLW
USWLRQ FRQYHUVLRQ IDFWRU ,W LV JHQHUDOO\ DFFHSWHG WKDW UDW VNLQ LV KHPLFDOV WKDQ KXPDQ LQ WKH RUGHU RI WKUHH WR ÀYH WLPHVPRUH LRQIDFWRUZRXOGHQDEOHRQHWRFRQYHUWUDWGHUPDOWR[LFLW\GDWDWR \7KHSHUFHQWRIGRVHDEVRUEHGLQYLWURLQWKHUDWDQGLQWKHKXPDQ SUHSDUDWLRQDQGWKHLUUDWLRDUHSUHVHQWHGLQ7DEOH7KHUDWLRV URKXPDQIRUHDFKGRVHDUHSORWWHGLQ)LJXUHDVUDWLRDJDLQVW
GXUDWLRQRIH[SRVXUH IDFWRURUDQ\WKLQJHYH WRDQGVKRZVQR GRVH7KLVYDULDWLRQD DEOH$JDLQWKHSURFH
%DVHGRQWKLVGDW IRU WKH WHVW YDOLGDWLR DGGLWLRQDOGHYHORSP EH UHYLVHG WR SURGX FRPSDUDEOHGDWDVWUR
7KLVSDUWLFXODUSURFHGXUHGRHVQRWSURYLGHDVLQJOHFRQYHUVLRQ QDSSURDFKLQJDIDFWRU7KHUDWLRRIUDWWRKXPDQYDULHVIURP HYLGHQFHRIDSDWWHUQHLWKHUZLWKGXUDWLRQRIH[SRVXUHRUZLWK QGLWVPDJQLWXGHVWURQJO\DUJXHWKDWWKHSURFHGXUHLVQRWFRUUHFW GXUHLVQRWUHDG\WRHQWHUWKHWHVWYDOLGDWLRQVWHS DVHWWKHLVRODWHGHSLGHUPDOPHPEUDQHSUHSDUDWLRQLVQRWUHDG\ Q RU WKH WHVW DFFHSWDQFH VWHSV $W WKLV WLPH LW DSSHDUV WKDW HQWDOZRUNLVQHFHVVDU\RQWKHSURFHGXUHWRGHWHUPLQHLILWFDQ FH FRPSDUDEOH GDWD 7KH YDULDWLRQ DQG LQFRQVLVWHQF\ RI WKH QJO\LQGLFDWHWKDWWKHSURFHGXUHLVQRWFRUUHFWDEOH
REFERENCES
