Statistics Spring 2008

Lab #8 ANVOA (between and within) Defined: Variables: Relations ip: "#ample: &ssumptions: Testing differences between group means IV is categorical, DV is continuous !roup differences $ o is appier republicans, democrats, independents% 'ormalit() *omogeneit()

In statistics, anal(sis of +ariance ,&'-V&, or..sometimes..&)')-)V)&)/ is a collection of statistical models about comparing t e mean +alues of different groups) T ere are a few t(pes of &'-V& depending on t e number of treatments and t e wa( t e( are applied to t e sub0ects in t e e#periment: 1) -ne.$a( &'-V& 1 IV, 2 or more le+els or conditions, suc as low, medium, ig , etc 3etween sub0ects 2 or more conditions t at are independent of eac ot er Repeated 4easures 2 or more conditions w ere same sub0ect is in all conditions 'otice t at &'-V& is different t an 5t.test6 in t at t e t.test is testing t e mean difference between two groups7 w ereas &'-V& is testing t e mean difference between t ree or more groups) "#amples:
8 T.test compares two means to eac ot er ,$ o is appier: Republicans, Democrats%/ &'-V& compares t ree or more means to eac ot er ,*appier: Republicans, Democrats, Independents, etc/ 8

2)

Two.$a( &'-V& 29 IV, called a 5factorial design6 3etween sub0ects 2#2, 2#2, 2#10, etc) Repeated 4easures same sub0ect in all conditions 4i#ed designs contains bot between and repeated factors :ab ;8 is de+oted to t e first two t(pes of &'-V& ,between and wit in/) :ab ;< is de+oted to =actorial &'-V&)

............................................................................................................................................. 3efore we begin anal(>ing &'-V&s, we need to create a new +ariable) $e are going to anal(>e t e relations ip between deat penalt( and errors1a) T e deat penalt( +ariable is called 5deat opinion6 and currentl( as si# le+els) See below:
deat opinion $ at is (our opinion of using t e deat penalt( to punis con+icted murderers: 1?I strongl( support t e deat penalt( 2?I moderatel( support deat penalt( 2?I am neutral about t e deat penalt( @?I moderatel( oppose deat penalt( A?I strongl( oppose t e deat penalt( B?I a+e no opinion a deat penalt(

I want to looC at deat penalt( opinion wit t ree le+els, so use t e 5Recode into different +ariable6 function so t at: . le+el 1 of t e new +ariable is for 5support of t e deat penalt( ,categor( 1, 2/, . le+el 2 of t e new +ariable is for 5neutral6 ,categor( 2/ and . le+el 2 of t e new +ariable is for 5oppose t e deat penalt(6 ,categor( @, A/) 1

Dall t e new +ariable 5deat Et reele+el6 1) Graphing T e first step of an( statistical anal(sis is to first grap icall( plot t e data) T ere are two t(pes of grap ical plots for &'-V& data) a) T e first t(pe of grap ical plot is pro+ided b( using t e Graphs ..> Legacy Dial gs ..> !rr r "ars# T is t(pe of plot pro+ides confidence inter+als w ic are useful w en +isuall( inspecting t e data) b) T e second t(pe of grap ical plot is pro+ided w en (ou conduct t e anal(sis ,&'-V&/, but t e plot does not include confidence inter+als) &s (ou become more e#perienced anal(>ing data, (ou will reali>e t at (ou donFt need to conduct t e first t(pe of grap ical plot t at contains t e confidence inter+als because t e same information is pro+ided non.grap icall( in t e output for eac anal(sis) In t is section I will e#plain ow to conduct t e first t(pe of plot t at contains confidence inter+als) In later sections w en I s ow (ou ow to conduct &'-V&s, I will s ow (ou ow to conduct t e second t(pe of plot) *ow do *ow do I plot t e data% 1) Select Graphs ..> Legacy Dial gs ..> !rr r "ars 2) DlicC 5Simple6, and 5Define6 2) 4o+e t e categorical +ariable ,IV/ into t e 5Dategor( &#is6 and mo+e t e DV into t e 5+ariable6 bo#) @) DlicC -G) T e output below indicates t at le+el 1 ,support/ and le+el 2 ,neutral/ are similar to eac , and bot are different from le+el 2 ,oppose/) In ot er words, I would suspect t at t ose sub0ects w o oppose t e deat penalt( are significantl( different on errors1a t an sub0ects w o support or are neutral toward t e deat penalt() T is maCes sense conceptuall( because lower on errors1a indicates t at (ou would rat er acHuit guilt( people t an con+ict innocent people) In ot er words, opposing t e deat penalt( is associated wit opposing to con+ict innocent people)

$# Ass%&pti ns ' ( & geneity $ en dealing wit group means ,t.test, &'-V&/, t ere are two assumptions: 'ormalit( and *omogeneit() 'ormalit( was discussed in :ab ;1) *omogeneit( is w et er t e +ariances in t e populations are eHual) $ en conducting an &'-V&, one of t e options is to produce a test of omogeneit( in t e output, called :e+eneFs Test) a) If :e+eneFs test is significant ,p I )0A/ t en eHual +ariances are '-T assumed, called eterogeneit() b) If :e+eneFs is not significant ,p J )0A/ t en eHual +ariances are assumed, called omogeneit()

It doesnFt reall( matter w et er (ou a+e omogeneit( or eterogeneit( since SKSS output gi+es (ou all a+ailable information for bot situations: eHual +ariances assumed, and eHual +ariances not assumed) See t e ne#t section w ere I discuss t e output generated b( SKSS for t.tests) :e+eneFs Test is generated for bot between &'-V&s and wit in &'-V&s )) ANOVA between Lou conduct &'-V& between b(: 1) Select Analy*e ..> + &pare ,eans ..> One'-ay ANOVA 2) 4o+e t e DV into t e 5Dependent :ist6 bo#, and mo+e t e IV into t e 5=actor6 bo#) 2) DlicC 5Kost oc6 and clicC 5:SD6 @) DlicC -ptions, and clicC 5Descripti+e6 and 5*omogeneit(6 and 5$elc 6 and 54eans plot6 @) DlicC -G) T e output below is for 5deat Et reele+els6 and 5errors1a6) T e output is in four parts: Kart 1 is t e descripti+e anal(sis) T e second bo# tells (ou w et er or not t e data are omogeneous) Since :e+eneFs test is significant, t en eHual +ariances are not assumed)

Kart 2 is t e -mnibus =) If :e+eneFs test from abo+e is significant, t en (ou use t e data from t e second bo# w ic indicates t e 5$elc 6 test In t is case, :e+eneFs test is significant ,p ? )02B/ so eHual +ariances are not assumed) T e -mnibus = tells us if at least one of t e pairwise comparisons is significant, but it does not indicate w ic of t e pairwise comparison,s/ is significant) To find out w ic pairwise comparison is significant, (ou need to do eit er Kost. ocs or Klanned Dontrasts)

Kart 2 are t e multiple comparisons and plots) Some statistics booCs sa( t at (ou can onl( test for Kost. oc pairwise comparisons if t e -mnibus = is significant, but ot er statistics booCs sa( (ou can test for Kost. oc 2

pairwise comparisons e+en if t e -mnibus = is not significant) In t is case, le+els 1 ,support/ and 2 ,neutral/ are significantl( different t an le+el 2 ,oppose/ but are not significantl( different from eac ot er) =LI I c ose to use 5:SD6 as t e post. oc test) T ere are man( different post. oc options depending upon a number of different factors) See t e =ieldFs te#tbooC 22< for ow to maCe decisions about w ic post. oc option (ou want to use) I t(picall( onl( use :SD because it is t e least strict test)

T e output pro+ides information about significance +alue, but (ou a+e to calculate t e effect si>e b( and) T e formula is on page 2AM of =ieldFs te#tbooC) T e pieces of information reHuired to calculate t e effect si>e are reported abo+e in t e output from SKSS SS between and SS wit in) =LI SS means 5Sum of SHuares6) I a+enFt found a website t at will calculate t e effect si>e for (ou) In t is case t e effect si>e is )1<A $RIT".NK) T e information included in t e write up is t e means, = +alue, df, and significance +alue) :atel(, t e field as a w ole as recommended t at (ou report effect si>e as well) a) T e o+erall effect across conditions was significant, F,2, 11</ ? B)M0A, p ? )002) Kost. oc tests indicated t at participants w o support t e deat penalt( ,4 ? A)B@/ were significantl( different t an participants w o oppose t e deat penalt( ,M ? @)A1/, p ? )002) Kost. oc tests also indicated t at @

participants w o are neutral about t e deat penalt( ,M ? A)<@/ were significantl( different t an participants w o oppose t e deat penalt( ,M ? @)A1/, p ? )00@) T e effect si>e is )1<A) "V&:N&TI-': Oust liCe wit e+aluation all t(pes of anal(ses in+ol+ing group means ,t.test, &'-V&/, (ou onl( reall( care about t ree pieces of information: ,1/ is t e effect significant ,p.+alue/, ,2/ w at is t e si>e of t e effect ,effect si>e/, and ,2/ w at is t e direction of t e effect ,w ic mean is larger t an t e ot er/) 'ow, letFs do t e same between &'-V& anal(sis. b%t this ti&e %se /lanned + ntrasts# In t e anal(sis abo+e, we conducted Kost. oc tests) &not er option is Klanned Dontrasts) Klanned Dontrasts onl( test specific pairwise comparisons, as compared to Kost. oc tests w ic test all possible comparisons) Klanned Dontrasts onl( tests specific c unCs of +ariance, as compared to -mnibus = and post. oc tests w ic test all t e +ariance) Lou c oose t e specific Klanned Dontrasts based upon aprori (pot eses) Lou conduct specific Klanned Dontrasts b( using t e 5Dontrast6 option in SKSS) In essence, (ou assign 5weig ts6 to t e different pairwise comparisons) T e rules for weig ting Klanned Dontrasts are somew at complicated, so if (ou are t inCing about conducting Klanned Dontrasts, start b( reading page 22A of =ieldFs te#tbooC) Klanned Dontrasts are not as commonl( conducted as Kost. oc tests, but I want to be aware of t e concept, so letFs do a concrete e#ample using our dataset) :etFs sa( t at we want to specificall( test t e relations ip between le+el 1 ,support/ and le+el 2 ,neutral/) Lou assign weig ts so t at t e( sum to 0, and (ou onl( assign weig ts to t e le+els (ou want to test) In t is case, we would assign: :e+el 1 ? .1 :e+el 2 ? 1 :e+el 2 ? 0 $it in SKSS (ou assign weig ts b(: 1) Select Analy*e ..> + &pare ,eans ..> One'-ay ANOVA 2) 4o+e t e DV into t e 5Dependent :ist6 bo#, and mo+e t e IV into t e 5=actor6 bo#) 2) DlicC 5Dontrasts6 and clicC 5pol(nomial6, and clicC degree t at is 5At 6 T en enter t e coefficients one at a time) So .1, 1, 0) @) DlicC -ptions, and clicC 5Descripti+e6 and 5*omogeneit(6 and 5$elc 6 and 54eans plot6 A) DlicC -G) T e output below is for 5deat Et reele+els6 and 5errors1a6) 4ost of t e output is t e same as before w en we conducted t e same anal(sis using Kost. oc tests, so below is onl( t e output specific to Klanned Dontrasts) a) &'-V& Instead of reporting one -mnibus =, t e output now displa(s an -mnibus = for :inear and Puadratic situations) If our categorical +ariable as more le+els ,suc as @, A, B, etc/ t en e+en more situations would appear in t e output ,suc as cubic, @t order, At order/) Lou c oose to report t e -mnibus = t at corresponds to ow (our data are grap icall( represented) See t e grap s on page 228 of =ieldFs te#tbooC for grap icall( representations of t e different situations) b) Dontrast Doefficients T is bo# reminds (ou ow (ou weig ted t e le+els c) Dontrast Tests T is bo# tells (ou if t e specific Klanned Dontrast is significant) $ en conducting Klanned Dontrasts (ou can di+ide t e p.le+el b( 2 to maCe t e test 5one.tailed6) I will e#plain about 5one.tailed6 later, but for rig t now notice t at it maCes t e p.le+el smaller, and t us closer to significant) T us, it is possible t at (ou could find a non.significant relations ip w en anal(>ed as a Kost. oc test, but find a significant relations ip w en anal(>ed as a Klanned Domparison) =or our e#ample, t e significant is )@M<Q2 ? )2@) T is p.le+el is not significant)

0) ANOVA repeated $e donFt a+e a repeated &'-V& factor in our dataset so we canFt use repeated &'-V&) *owe+er, i&agine. 0ust for t e saCe of argument, t at s(stem1, s(stem2, and s(stem2 are t e same Huestion) &lso imagine t at we asCed sub0ects to answer s(stem1 before t e stud( began, and t at we asCed sub0ects to answer s(stem2 in t e middle of t e stud(, and we asCed sub0ects to answer s(stem2 at t e end of t e stud() T e (pot esis would be t at answering Huestions about t e legal s(stem c anged ow sub0ects would answer t is Huestion) =or e#ample, t e (pot esis is t at being e#posed to t e Huestions in t e sur+e( ,suc as flaws in t e legal s(stem regarding con+icting innocent people, problems wit D'& e+idence, etc/ made t e sub0ects answer lower on t e scale) *ow to conduct repeated &'-V&: 1) Select Analy*e ..> General Linear , del ..> 1epeated ,eas%res 2) "nter t e number of le+el into 5'umber of :e+els6) In t is case its 526) DlicC 5&dd6) DlicC 5Define6) 2) 4o+e t e t ree +ariables o+er to t e 5$it in.Sub0ects6 bo#) @) DlicC 5Klots6, mo+e factor1 into t e 5*ori>ontal &#is6 bo#, clicC 5&dd6, t en 5Dontinue6 A) DlicC 5-ptions6, mo+e 5factor16 into t e 5Displa( 4eans6 bo#, clicC 5Dompare 4ain "ffects6) =LI t is is t e wa( (ou conduct Kost. oc anal(ses in repeated &'-V& B) $ ile still in 5-ptions6, clicC 5Descripti+e6, 5"ffect Si>e6, clicC 5Dontinue6 M) DlicC -G) I am going to e#plain t e output in four separate parts) Kart 1 is t e descripti+e statistics)

Kart 2 is t e -mnibus =) =irst (ou c ecC t e middle bo# to identif( Sp ericit(, w ic is w et er t e +ariance across conditions and across pairs is eHual) a) If t e test is non.significant ,p J )0A/, t en sp ericit( e#ists) If sp ericit( e#ists, t en looC at t e t ird bo# w ere it sa(s 5Sp ericit( &ssumed6 to find t e -mnibus =, w ic is p ? )000 b) If t e test is significant ,p I )0A/, t en sp ericit( does not e#ist) If Sp ericit( does not e#ist, (ou a+e two options: ,1/ looC at t e !reen ouse.!eisser or *u(n .=eldt correction, or ,2/ looC at t e 4ulti+ariate Tests bo#) T e corrections correct for sp ericit(, w ereas t e 4ulti+ariate tests are not based upon t e assumption of sp ericit() In all cases, t e same result occurs, p ? )000)

Kart 2 are t e post. ocs) Lou interpret t e Kost. oc anal(sis 0ust as (ou would for &'-V& between)

Kart @ is t e grap ical plot of t e data:

T e output pro+ides information about effect si>e, called partial eta sHuared) $RIT".NK) T e information included in t e write up is t e means, = +alue, df, and significance +alue) :atel( t e field as a w ole as recommended t at (ou report effect si>e as well) =LI I am reporting results for !reen ouse.!eisser/) =LI w en all conditions are significantl( different from eac ot er, report t e post. oc tests in a table) a) T e o+erall effect across conditions was significant, F,1)<2, B21)@@/ ? 208)B2, p I )000) Kost. oc tests indicated t at all t ree conditions were significantl( different from eac ot er) T e effect si>e is )2<2) "V&:N&TI-': Oust liCe wit e+aluation all t(pes of anal(sis in+ol+ing group means ,t.test, &'-V&/, (ou onl( reall( care about t ree pieces of information: ,1/ is t e effect significant ,p.+alue/, ,2/ w at is t e si>e of t e effect ,effect si>e/, and ,2/ w at is t e direction of t e effect ,w ic mean is larger t an t e ot er/) <