ࡱ> :J  !"#$%&'()*+,-./0123456789K<=>?@ABCDEFGHILMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{}~RdO)7hPicturesPowerPoint Document(SummaryInformation(; n*tzL(qCyPNG  IHDR6 !rbKGDT cmPPJCmp0712`$IDAT(Sc@`"G{iGҫIENDB` ՜.+,0h     On-screen ShowAuckland University4  4( / 0DArialngs000~01,0D-3 00000000~01,0 DWingdings000~01,0 ` .  @n?" dd@  @@`` h, 0      ,b$*tzL(qCy`S @8=%uʚ;2Nʚ;g4kdkdHPrppp@ <4!d!dgʚ;<4ddddgʚ; #___PPT10(00H0.___PPT9P`0`0`h___PPT2001D<4XH___PPTMac11"@f   hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography D   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  H   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  8   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  X   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  ? %z Why clean data?91 quality is important. Cleaning dataMakes the data fit for purpose/plausible Reduces the negative impact of errors Improves the data quality Improves the quality of the outputs:)&# What to look for Non-response an item non response eg missing data Erroneous data Can negatively affect data and resulting quality Suspicious datal %1 %1 "]Process of cleaning dataDetect Resolve Treat& Detect Identify erroneous or suspicious data Graph or sort data - look at outliers I have a student who throws ten dice and records the number of sixes. They recorded: (2, 0, 3, 12, 2, 0, 1, 1, 3, 1, 4). What is wrong? What do you think is the cause of it?b&&{5&&z &K Detect*Consider the data points 3, 4, 7, 4, 8, 3, 9, 5, 7, 6, 92  92 is suspicious - an outlier Outliers: are potentially legitimate (correct) can be data or model glitches can be a data miners dream, for example, a highly profitable customer Outlier -  departure from the expected A (!   %F'  ,cBn ResolveDeciding if erroneous or suspicious data should be corrected or amended Deciding on the action to  treat the data&sH* TreatJLeave as is Change Impute: determine replacement value Replacement value is obtained from a similar record from the  clean respondents from the data at hand Removeb%g %g ,Y1 <` 3f3f[` T]` [UUU]` hv` Xhv_q` YTT` u>?" dd@,?" xd@ d " @`"  n?" dd@   @@``PR    @ ` ` p>> 0 p(   HT     " "   # lG0*fd @| s)?#"   "   BG0*v @c"$ ?<o*    BXCDE,F @ 7hP>XG @   `"q"    B&CbDE$Fd @ H-abTP!A& @  `"V*   BXCDE,Fd @ 7hP>XG @   `"  0- "  T Click to edit Master title style! !  s *0- "   RClick to edit Master text styles Second level Third level Fourth level Fifth level!     S  s *- "P 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  P*   s *P- "`  0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  R*   s *- " 0___PPT106___PPT9B___PPTMac11   hnamd` Arial&Monotype Typography  V* j  RA ޽h ?aqbg T]80___PPT10.@Jy Candybar < @ _(    0 . "`` 0___PPT106___PPT9:___PPTMac11  hnamd` Arial&Monotype Typography b* b  0P. "`@@  0___PPT106___PPT9:___PPTMac11  hnamd` Arial&Monotype Typography d*   b  0 #. "`p  0___PPT106___PPT9:___PPTMac11  hnamd` Arial&Monotype Typography h*$  f  0'. " `    W#Click to edit Master subtitle style$ $HT    "  "  # lG0*fd @| s)?#"   "  BG0*v @c"$ ?<o*    BXCDE,F @ 7hP>XG @   `"q"    B&CbDE$Fd @ H-abTP!A& @  `"V*    BXCDE,Fd @ 7hP>XG @   `"   07. "  T Click to edit Master title style! !j  RA ޽h ?aqbg T]80___PPT10.@Jy=  ( hVq~A r  S 0>   l  C  `    H  0޽h ? 3380___PPT10. vW = P(  l  C .    l  C w.    H  0޽h ? [UUU]80___PPT10. v/5 = `( rohcngam l  C     l  C +    H  0޽h ? [UUU]80___PPT10. vEd = p(    l  C  !    l  C @>    H  0޽h ? [UUU]80___PPT10. vv = ( BD l  C \    l  C  \    H  0޽h ? [UUU]80___PPT10. v  = (( vaC'zBCB (l ( C     l ( C     H ( 0޽h ? [UUU]80___PPT10. vgA =  ( D'zB@DB  l  C 09    l  C [    H  0޽h ? [UUU]80___PPT10. vo = $( D'zB@DB $l $ C _    l $ C @^    H $ 0޽h ? [UUU]80___PPT10. vdxp^RЀ3ÿ lHbP  @AL G@;b `B&V( / 0DArialngs00DocumentSummaryInformation8Current User J Oh+'0 hp ( H T `lt'Why clean data?An Employee of\Macintosh HD:Applications:Microsoft Office 2004:Templates:Presentations:Designs:CandybarAn Employee of6Microsoft PowerPoint@@Ah@H>hGNPICTF HH HH  )lu<ڡ{cYVVYhުoebbftg4 AJׂ}Ɂʻwjᓊہ̯x $7IRX[[XN; @7樐Áq麠ցǀ6.PVVGz4z筏؉ KKI]Tcuapn  !"!"#$%&'&'())()*' <meej|ssy*OɊjjlnjj؞xxz|xxoG:roopÀ~~[/ޟt ttttttttztۅ ąم PoPP[h՗{ {{{{{{{{ެی 댌ڌ o\P\PP>&ԓہÍぷߒܗ߁ځާۓ㓓㓼ʼʓͭړBBP\0\xPxB\\&*ŒڇŒڗג퇭퇭هЦ֣ۚƲî֚К֚ښxfPPm\0\x\pB\'ĒڎҎ莘؎Ϧڡ͡顡顰ʡ١P\11PP\B\\x\x ͒ڔÔÔԷ֦֔ڨ稨ͬب1m\أϯP\yPyPP##ɏڙƙՙؙ̙̙Фڮ鮴ƱսخQp}\\y\Qg22229ށ։ 魮ί Ͽڷ ڝ8  ]]RR]]gR] ]̺ӺиS5SFFFF5SFSPͻ➻ޞɧS"8")Nvͽ͞u܅ݞԾ(|K(&yGy{Ё ː%// .3J g搑ՁϛuP.55 4!QӀsaӉԁϔnL.::5 [ёdÁncїrׁӼ~om#2;==;4'd s_qU~ |lρa@  R]n\TQQT\ovg_]]_gxg; ( / 0DArialngs000~01,0D-3 00000000~01,0 DWingdings000~01,0 ` .  @n?" dd@  @@`` p0 3       ,b$*tzL(qCy`S @8+uʚ;2Nʚ;g4kdkdHPrppp@ <4!d!dgʚ;<4ddddgʚ; <4ddddʚ;v*X___PPT1080(0@0H0___PPT9P`0`0`h___PPT2001D<4X#___PPTMac11#@f   hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography    hnamd` Arial&Monotype Typography D   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  H   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  p   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  8   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  X   hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography     hnamd` Arial&Monotype Typography  ? %Why clean data?91 quality is important. Cleaning dataMakes the data fit for purpose/plausible Reduces the negative impact of errors Improves the data quality Improves the quality of the outputs:)&# What to look for Non-response an item non response eg missing data Erroneous data Can negatively affect data and resulting quality Suspicious datal %1 %1 "] 91 gathering problemsManual entry (input error) For example, switching numbers around, missing numbers, inputting two responses into one field Duplicates For example, submit button hit more than once Measurement errors For example, using inches instead of cm, reading scales incorrectly Non uniform standards for content and format For example, people using different units - some giving index finger lengths in cm, some in mm.Z_Z Z.ZZDZ-Z`Z_ .  D-`PIG0/Process of cleaning dataDetect Resolve Treat& Detect Identify erroneous or suspicious data Graph or sort data - look at outliers I have a student who throws ten dice and records the number of sixes. They recorded: (2, 0, 3, 12, 2, 0, 1, 1, 3, 1, 4). What is wrong? What do you think is the cause of it?b&&{5&&z &K Detect*Consider the data points 3, 4, 7, 4, 8, 3, 9, 5, 7, 6, 92  92 is suspicious - an outlier Outliers: are potentially legitimate (correct) can be data or model glitches can be a data miners dream, for example, a highly profitable customer Outlier -  departure from the expected A (!   %F'  ,cBn ResolveDeciding if erroneous or suspicious data should be corrected or amended Deciding on the action to  treat the data&sH* TreatJLeave as is Change Impute: determine replacement value Replacement value is obtained from a similar record from the  clean respondents from the data at hand Removeb%g %g ,Y1ry' @RdO)TJKPicturesPowerPoint Document(SummaryInformation(;  !"#$%&'()*+,-./0123456789K<=>?@ABCDEFGHILMNOPQRSTUVWXYZ[\]^_`abcdefghijklmnopqrstuvwxyz{}~DocumentSummaryInformation8Current User M   ArialMS Pゴシック Wingdings CandybarWhy clean data?Cleaning dataWhat to look for 91 gathering problemsProcess of cleaning dataDetect DetectResolveTreat  Fonts UsedDesign Template '_(Dept StatisticsDept StatisticsSlide Titles