Professional Documents
Culture Documents
Outline
I
I
I
I
I
where:
66
Slope 1
is positive
x
8
Regression line
Slope 1
is negative
x
9
No Relationship
E(y)
Intercept
Regression line
Slope 1
is 0
x
10
11
Estimation Process
Regression Model
y = 0 + 1x +
Regression Equation
E(y) = 0 + 1x
Unknown Parameters
0, 1
b0 and b1
provide estimates of
0 and 1
Sample Data:
x
y
x1 y1
.
.
.
.
xn yn
Estimated
Regression Equation
Sample Statistics
b 0, b 1
12
Model
yi = 0 + 1xi +
Estimate
i = b0+b1xi
Error
ei = y i i
13
where:
yi = observed value of the dependent variable
for the ith observation
y^i = estimated value of the dependent variable
for the ith observation
14
1.
2.
15
where:
xi = value of independent variable for ith
observation
yi = value of dependent variable for ith
_ observation
x = mean value for independent variable
_
y = mean value for dependent variable
16
17
18
19
20
y = 100
21
22
23
Coefficient of Determination
I
SSR
SSE
where:
SST = total sum of squares
SSR = sum of squares due to regression
SSE = sum of squares due to error
24
Coefficient of Determination
I
25
Coefficient of Determination
r2 = SSR/SST = 100/114 = .8772
The regression relationship is very strong; 87.72%
of the variability in the number of cars sold can be
explained by the linear relationship between the
number of TV ads and the number of cars sold.
26
where:
b1 = the slope of the estimated regression
equation
27
is +.
rxy = +.9366
28
29
Model Assumptions
30
Model Assumptions
31
and
F Test
32
An Estimate of 2
The mean square error (MSE) provides the estimate
of 2, and the notation s2 is also used.
s 2 = MSE = SSE/(n 2)
where:
33
An Estimate of
To estimate we take the square root of 2.
The resulting s is called the standard error of
the estimate.
14
5
2.16
34
Hypotheses
Test Statistic
where
35
Rejection Rule
Reject H0 if p-value <
or t < -tor t > t
where:
t is based on a t distribution
with n - 2 degrees of freedom
36
= .05
1.08
39
b1 is the
point
where
estimator
is the
margin
of error
40
Rejection Rule
Reject H0 if 0 is not included in
the confidence interval for 1.
95% Confidence Interval for 1
= 5 +/- 3.182(1.08) = 5 +/- 3.44
or
1.56 to 8.44
Conclusion
0 is not included in the confidence interval.
Reject H0
41
Hypotheses
Test Statistic
F = MSR/MSE
where:
MSR = mean square regression
MSE = mean square error
MSR = SSR/Regression degree of freedom
Regression degree of freedom
= Number of independent
variables (excluding
p
(
g the constant))
42
Rejection Rule
Reject H0 if
p-value <
or F > F
where:
For simple regression, F is based on an F distribution
with 1 degree of freedom in the numerator and
n - 2 degrees of freedom in the denominator
43
= .05
F = MSR/MSE
Reject H0 if p-value < .05
or F > 10.13 (with 1 d.f.
in numerator and
3 d.f. in denominator)
44
45
46
Excel Example
I
47
Excel Example
48