Transcript t test

S519: Evaluation of
Information Systems
Social Statistics
Inferential Statistics
Chapter 9: t test
This week




What is t test
Types of t test
TTEST function
T-test ToolPak
Why not z-test



In most cases, the z-test requires more
information than we have available
We do inferential statistics to learn about the
unknown population but, ironically, we need to
know characteristics of the population to make
inferences about it
Enter the t-test: “estimate what you don’t know”
William S. Gossett



Employed by Guinness Brewery,
Dublin, Ireland, from 1899 to
1935.
Developed t-test around 1905, for
dealing with small samples in
brewing quality control.
Published in 1908 under
pseudonym “Student” (“Student’s
t-test”)
Types of t test
Degrees of Freedom and t test



Degrees of freedom describes the number of
scores in a sample that are free to vary.
degrees of freedom = df = n-1
The larger, the better
One sample t test



Very similar like z test
Use sample statistics instead of population
parameters (mean and standard deviation)
Evaluate the result through t test table (Table
B2) instead of z test table (Table B1)
An example





We show 26 babies the two pictures at the same time
(one w/ his/her mother, the other a scenery picture) for
60 seconds, and measure how long they look at the
facial configuration.
Our null assumption is that they will not look at it for
longer than half the time, μ = 30
Our alternate hypothesis is that they will look at the face
stimulus longer b/c face recognition is hardwired in their
brain, not learned (directional)
Our sample of n = 26 babies looks at the face stimulus
for M = 35 seconds, s = 16 seconds
Test our hypotheses (α = .05, one-tailed)
Step 1: Hypotheses

Sentence:



Null: Babies look at the face stimulus for less than
or equal to half the time
Alternate: Babies look at the face stimulus for
more than half the time
Code Symbols:
Step 2: Determine Critical
Region





Population variance is not known, so use
sample variance to estimate
n = 26 babies; df = n-1 = 25
Look up values for t at the limits of the critical
region from our critical values of t table
Set α = .05; one-tailed
tcrit = +1.708
Step 3: Calculate t statistic
from sample

Central Limit Theorem



μ = 30
sM=s/ n =16/
26 =
3.14
Step 4: Decision and
Conclusion



The tobt=1.59 does not exceed tcrit=1.708
∴ We must retain the null hypothesis
Conclusion: Babies do not look at the face
stimulus more often than chance, t(25) =
+1.59, n.s., one-tailed. Our results do not
support the hypothesis that face processing
is innate.
Independent t test

A research design that uses a separate
sample for each treatment condition is called
an independent-measures (or betweensubjects) research design.
t Statistic for IndependentMeasures Design





The goal of an independent-measures
research study:
To evaluate the difference of the means
between two populations.
Mean of first population: μ1
Mean of second population: μ2
Difference between the means: μ1- μ2
t Statistic for IndependentMeasures Design

Null hypothesis: “no change = no effect = no
difference”


H0: μ1- μ2 = 0
Alternative hypothesis: “there is a difference”

H1: μ1- μ2 ≠ 0
T test formula
x1  x2
t
 (n1  1) s12  (n2  1) s22   n1  n2 




n1  n2  2

  n1n2 
x1
x2
n1
n2
s12
s22
: is the mean for Group 1
: is the mean for Group 2
: is the number of participants in Group 1
: is the number of participants in Group 2
: is the variance for Group 1
: is the variance for Group 2
Value for degrees of freedom: df = df1 + df2
An Example
Group 1
7
5
3
4
3
6
2
10
3
10
8
5
8
1
5
1
8
4
5
3
5
7
1
9
2
5
2
12
15
4
Group 2
5
4
4
5
5
7
8
8
9
8
3
2
5
4
4
6
7
7
5
6
4
3
2
7
6
2
8
9
7
6
T test steps

Step 1: A statement of the null and research
hypotheses.

Null hypothesis: there is no difference between
two groups
H 0 : 1  2

Research hypothesis: there is a difference
between the two groups
H1 : 1  2
T test steps

Step 2: setting the level of risk (or the level of
significance or Type I error) associated with
the null hypothesis

0.05
T test steps

Step 3: Selection of the appropriate test
statistic


Determine which test statistic is good for your
research
Independent t test
T test steps

Step 4: computation of the test statistic value

t= 0.14
T test steps

Step 5: determination of the value needed for
the rejection of the null hypothesis


Table B2 in Appendix B (S-p360)
Degrees of freedom (df): approximates the sample
size



Group 1 sample size -1 + group 2 sample size -1
Our test df= 58
Two-tailed or one-tailed


Directed research hypothesis  one-tailed
Non-directed research hypothesis  two-tailed
T test steps

Step 6: A comparison of the obtained value
and the critical value



0.14 and 2.001
If the obtained value > the critical value, reject the
null hypothesis
If the obtained value < the critical value, retain the
null hypothesis
T test steps

Step 7 and 8: make a decision

What is your decision and why?
Interpretation

How to interpret t(58) = 0.14, p>0.05, n.s.
Excel: TTEST function

TTEST (array1, array2, tails, type)




array1 = the cell address for the first set of data
array2 = the cell address for the second set of
data
tails: 1 = one-tailed, 2 = two-tailed
type: 1 = a paired t test; 2 = a two-sample test
(independent with equal variances); 3 = a twosample test with unequal variances
Excel: TTEST function


It does not compute the t value
It returns the likelihood that the resulting t
value is due to chance (the possibility of the
difference of two groups is due to chance)
Excel ToolPak

Select t-test: two sample assuming equal
variances
t-Test: Two-Sample Assuming Equal Variances
Mean
Variance
Observations
Pooled Variance
Hypothesized Mean Difference
df
t Stat
P(T<=t) one-tail
t Critical one-tail
P(T<=t) two-tail
t Critical two-tail
Variable 1
5.433333333
11.70229885
30
7.979885057
0
58
-0.137103112
0.44571206
1.671552763
0.891424121
2.001717468
Variable 2
5.533333333
4.257471264
30
Effect size

If two groups are different, how to measure
the difference among them

Effect size
X1  X 2
ES 
SD
ES: effect size
X : the mean for Group 1
X : the mean for Group 2
SD: the standard deviation from either group
1
2
Effect size

A small effect size ranges from 0.0 ~ 0.2


A medium effect size ranges from 0.2 ~ 0.5



The two groups are different
A large effect size is any value above 0.50


Both groups tend to be very similar and overlap a lot
The two groups are quite different
ES=0the two groups have no difference and overlap entirely
ES=1the two groups overlap about 45%