Chapter 13

Simple Regression

[30/100%]
Show
LaTeX
Problem 13.1

This regression equation was estimated using data on college applicants who were admitted both to Pomona College and to another college ranked among the top 20 small liberal arts colleges by US News E\mathcal{E} World Report:

Y=.2935(.0781)+.0293X(.0065),R2=.562 \mathrm{Y}=\underset {(.0781)}{.2935}+\underset {(.0065)}{.0293 \mathrm{X}}, \mathrm{R}^{2}=.562

where: Y=\mathrm{Y}= fraction of students who were admitted to both this college and Pomona College who enrolled at Pomona college; average value =.602=.602 X = US. News World Report ranking of this college ()== standard error

?
(a)

How were the numbers .2935 and .0293 obtained? (Do not show any formulas; explain in words the basis for the formulas.)

(b)

Explain why you are not surprised that the R-squared for this equation is not 1.0.

(c)

Does the coefficient of XX have a plausible value?

(d)

Is the estimated coefficient of XX statistically persuasive?

(e)

What is the null hypothesis in (d)?

(f)

What is the predicted value of YY for X=30X=30?

(g)

Why should we not take the prediction in (f) seriously?

Problem 13.2

Explain why you either agree or disagree with each of these claims about the simple regression model:

?
(a)

If the estimated slope in a simple regression equation is negative, it cannot be statistically significant.

(b)

The estimated correlation coefficient doesn't depend on which variable is the dependent variable and which is the explanatory variable.

(c)

Ordinary least squares assumes that the explanatory variable is normally distributed.

Problem 13.3

Two researchers used annual data for 2000-2021 to estimate a simple regression model, where X=X= percentage change in the SP 500 from January 1 through January 31 and Y=\mathrm{Y}= percentage change in the SP 500 index of stock prices from February 1 through December 31 of that same year:

The authors reported that Y=4.670−3.081X,R2=.22,b=−3.08,tY=4.670-3.081 X, R^{2}=.22, b=-3.08, t-value =−2.39,p=-2.39, p-value == .1917. The beta is not substantial because the tt-value is less than 2. We can reject the null hypothesis. Our results show that FebruaryDecember change in the SP 500 does not depend on the change in January. Identify five distinct problems with this analysis.

?
Problem 13.4

The equation Y=α+βX+ε\mathrm{Y}=\alpha +\beta \mathrm{X}+\varepsilon was estimated by ordinary least squares. Explain why you either agree or disagree with these statements:

?
(a)

Least squares regression minimizes the sum⁡∑i=1n(X1−X‾)2\operatorname {sum} \sum_{i=1}^{n}\left(X_{1}-\overline{X}\right)^{2}

(b)

R2\quad R^{2} is equal to the correlation coefficient squared.

(c)

A doubling of the number of observations, with the new data exactly replicating the original data, would increase R2\mathrm{R}^{2}.

(d)

R2=1R^{2}=1 means Y=XY=X.

Problem 13.5

A researcher wanted to investigate burnout in competitive mountain biking. He looked at every California U23 (ages 19-22) mountain biker in 2012, and calculated the total number of sanctioned events they had competed in while in U23 and while they were in Junior racing (ages 17-18). The least squares regression was Y=1.45+1.11X\mathrm{Y}=1.45+1.11 \mathrm{X}, with t=7.91\mathrm{t}=7.91 for the slope estimate and R -squared =.5=.5.

?
(a)

What are the most important problem(s) with these data?

(b)

Which variable in the regression equation should be the dependent variable?

(c)

Is the two-sided p-value for the slope estimated less than .05?

(d)

Explain why you either agree or disagree with this interpretation of the regression results: "This shows that racers generally raced close to the same number of times as a junior and as a U23."

Problem 13.6

A researcher specified this time-series model

Y=α+βX+ε Y=\alpha +\beta X+\varepsilon

where: Y=\mathrm{Y}= annual percentage change in household spending X=\mathrm{X}= annual percentage change in the SP 500 index of stock prices He reported these results

Estimate of α=.21\alpha =.21

Estimate of β=.48\beta =.48 > Estimate of ε=1.13\varepsilon =1.13 > t=2.43t=2.43 for test of H0:X=0H_{0}: X=0 :

What two mistakes do you see in these reported results?

?
Problem 13.7

Data were collected for 25 new cars on the car's weight (X)(X) and estimated highway miles per gallon (Y)(Y). The model Y=α+βX+εY=\alpha +\beta X+\varepsilon was estimated by ordinary least squares in three different ways: (a) the data were arranged alphabetically by car name; (b) the data were arranged numerically from the lightest car to the heaviest; and (c) the data were arranged numerically from the lowest miles per gallon to the highest. Which procedure yielded the smallest estimate of the intercept? Which yielded the highest estimate?

?
Problem 13.8

The equation Y=α+βX+εY=\alpha +\beta X+\varepsilon was estimated by ordinary least squares. How would a doubling of the number of observations, with the new data exactly replicating the original data, affect the

?
(a)

estimates of the slope and intercept?

(b)

standard error of the estimate of the slope?

(c)

tt-value of the estimate of the slope?

(d)

R2\mathrm{R}^{2}?

Problem 13.9

A regression model was constructed to predict the sale price of homes in Elm City:

We looked at the list (asking) prices for 60 homes that are for sale in Elm City. We wrote down the square footage and price of the property and used that information to make a scatterplot with a line of least regression. The relationship between square footage and price of the listing was positive. The equation is y=242+.00247xy=242+.00247 x, where y=y= square footage and x=x= list price. How would you improve this study and the report of the results?

?
Problem 13.10

Critically evaluate:

Many people believe that the 1979 spike in oil prices increased the unemployment rate in the United States. However, when I used monthly data for 1979 to estimate the equation U=α+βP+εU=\alpha +\beta P+\varepsilon, where UU is the unemployment rate and PP is the price of Texas crude oil, the estimated slope was not statistically significant-demonstrating that oil prices, in fact, had no effect on the unemployment rate.

?
Problem 13.11

A researcher used least squares to estimate the equation Y=α+βX+εY=\alpha +\beta X+\varepsilon, where Y=\mathrm{Y}= college GPA and X=\mathrm{X}= high school GPA. First, he estimated the equation using all his data. Then, he separated his data into male and female students and estimated separate equations for each sex. Identify three apparent errors you see in these reported results.

(): standard error

?
Problem 13.12

A 2005 linear regression estimated the relationship between the dollar prices P of 45 used 2001 Audi A4 2.8L sedans with manual transmissions and the number of miles M the car had been driven:

P=16,958−.0677M,R2=.70(2,553)(.0233) \begin{gathered} \mathrm{P}=16,958-.0677 \mathrm{M}, \mathrm{R}^{2}=.70 \\ (2,553) \quad (.0233) \end{gathered}

The standard errors are in parentheses.

?
(a)

Does the value 16,958 seem reasonable?

(b)

Does the value -.0677 seem reasonable?

(c)

Is the estimated relationship between M and P statistically persuasive?

(d)

Should the variables be reversed, with M on the left-hand side and P on the right-hand side?

(e)

Suppose that the true relationship is P=α−β1M+β2C+ε\mathrm{P}=\alpha -\beta_{1} \mathrm{M}+\beta_{2} \mathrm{C}+\varepsilon, where C is the car's condition (scale of 1−51-5, with 5 best) and α,β1\alpha , \beta_{1}, and β2\beta_{2} are all positive. If MM and CC are negatively correlated, does the omission of CC from the estimated equation bias the estimate of β1\beta_{1} upward or downward?

Problem 13.13

Here is an excerpt from a debate between two famous economists on the relationship between the growth of the money supply and the rate of inflation. Which economist do you agree with on the question of whether regression implies causation? Steve Hanke: I related the growth rate in the money supply to the inflation rate [in] 147 countries and the money supply measure I used is M2 and what do we end up with? We have almost a perfect correlation. John Cochrane: Correlation is not causation. We've known that forever. Steve Hanke: I also ran a regression and that does imply causation. John Cochrane: Oh, no no. Correlation does not imply causation. Come on now.

?
Problem 13.14

A researcher obtained the Scholastic Aptitude Test (X) scores and college grade point averages (Y) of 396 college students and reported these regression results:

Y=1146.0+1.4312X,R2=0(195.6)(71111.6)[5.86][.02] \begin{align} \mathrm{Y}= & 1146.0& +& 1.4312 \mathrm{X}, \mathrm{R} 2=0 \\ & (195.6) & & (71111.6) \\ & [5.86] & & [.02] \end{align}

(): std. devs. [ ]: t-values

?
(a)

There is a major error in these results. What is it?

(b)

The researcher concluded that, "Therefore I reject the null hypothesis and conclude that SAT scores and grades are not related." What is the basis for this conclusion and why is it wrong?

Problem 13.15

A study of 15 stocks that were wildly popular in the 1970s collected these data: (1) the December 1972 price earnings ratio (P/E) and (2) the annual percentage rate of return (R) from 1973 through 2000. What statistical test would you use to see if stocks with high P/E ratios tended to have low annual returns? (You do not have to actually do the test, just identify it clearly.) Be sure to identify the null hypothesis and how you would test it.

1972 P/ER
Polaroid90.7-6.07
McDonald's85.711.85
Walt Disney81.610.58
Avon Products65.46.30
Kresge (now Kmart)54.31.20
Simplicity Pattern53.1-2.01
Xerox48.8-1.99
Eastman Kodak48.22.68
Coca-Cola47.614.64
IBM37.48.65
Procter \Gamble32.012.27
PepsiCo29.316.17
General Electric26.116.85
Philip Morris25.918.00
Gillette25.914.89
?
Problem 13.16

A finance professor estimated this model to see if investors could increase their returns by buying stocks with high PEG ratios:

The model is

R=α+βPEG+ε \mathrm{R}=\alpha +\beta \mathrm{PEG}+\varepsilon

using these data for the 30 stocks in the Dow-Jones Industrial Average on December 31 of each year, during the period December 31, 2004, through December 31, 2021. > P=P= per share stock price on December 31 of that year > E=E= per share earnings during the preceding year > G=G= growth rate of earnings over the next 5 years > PEG = (P/E)/G > R=R= stock rate of return over next 7 months; January 1 through July 31

?
(a)

What are the two most important issues you would raise with this analysis?

(b)

Give at least three ways in which this presentation of the results could be improved:

CoefficientStandard Error
Constant.0198368.0238002
PEG.0050861∗∗.0050861^{* *}.0017132
: Least squares estimates show a statistically significant relationship between PEG and R:

**: p<.05\mathrm{p}<.05

Problem 13.17

US taxpayers can either take a standard deduction or an itemized deduction based on property taxes, mortgage interest, charitable contributions, and a few other items. The deduction of property taxes and mortgage interest is intended to encourage home ownership which is thought to boost active citizenship, stable neighborhoods, and other positive externalities. A cross-section regression equation was estimated using 20152019 average values for each of the 58 counties in California: Y=α+βX+ε\mathrm{Y}=\alpha +\beta \mathrm{X} +\varepsilon, where Y is the percentage of the eligible population who voted in the 2019 presidential primary election and X is the average value during the years 2015-2019 of the ratio of the number of homeowners divided by the total number of households in each county.

The estimated value of β\beta was 19.35 with a standard error of 20.95. Explain why you either agree or disagree with the authors' conclusion that

Although homeownership seems to have an economically significant and positive impact on voting percentage, statistical significance is lacking. Therefore, critics of the mortgage interest deduction have further support that home ownership does not encourage voting.

?
Problem 13.18

What is puzzling about this plot of the residuals from a least squares regression?

?
Problem 13.19

This regression equation was estimated using data for 481 California Census blocks that were more than 95%95 \% Hispanic in 2008,

Y=.843+.00023X,R2=.0025 Y=.843+.00023 X, R^{2}=.0025

[97.12] [1.18] where: Y=\mathrm{Y}= percentage of the two-party vote received by Barack Obama in the 2008 Presidential election X = median household income of Hispanics, $1000s of dollars The t -values are in brackets. Identify the logical error in this conclusion:

Income is not statistically significant; the pp-value is .27, meaning that there's a 27 chance we accept the null hypothesis that income has no effect on the Hispanic vote.

?
Problem 13.20

In 2005, Granite Construction applied for a permit to build a quarry near Temecula, California. Rocks would be dislodged from a mountain by daily blasts of 10,000 pounds of explosives and then crushed into gravel and sand that are used for concrete, asphalt, and other construction material. Mining and processing would go on 20 hours a day, 6 days a week, with 1,600 trucks entering and leaving the site daily.

The proposed quarry was in a mountain gap where ocean breezes carry cool air to the Temecula Valley. Residents were alarmed about the effect of this quarry on the city's economy and property values. However, an economist hired by Granite argued that in the city of Corona, which is 40 miles away and has had mines for many years, there was a "direct positive correlation" between annual mine production and property values over the past 20 years. Temecula residents evidently should be celebrating that their city was chosen for this quarry-which would have a positive effect on property values.

Provide a clear, persuasive refutation of this statistical argument.

?
Problem 13.21

A researcher used annual data for Major League Baseball (MLB) players for 1962 (when the current 162-game schedule was introduced) through 2011 to estimate this equation

Y=−14.75(2,285)+.083X(.012),R2=.508 \mathrm{Y}=\underset {(2,285)}{-14.75}+\underset {(.012)}{.083 \mathrm{X}}, \mathrm{R}^{2}=.508

where: Y=\mathrm{Y}= average number of home runs per game that season X = average weight (in pounds) of MLB players and the standard errors are in parentheses. The average value of Y is 1.76 and the average value of X is 191.76.

?
(a)

Do you agree with the author's choice of which variable should be the dependent variable?

(b)

Why is the estimated intercept negative?

(c)

Is the estimated slope substantial, plausible, and statistically persuasive?

(d)

What fraction of the variation in YY is explained by XX?

Problem 13.22

Critically evaluate:

The American Mustache Institute (AMI) is planning a "Million Mustache March" on the nation's capital. Their rallying cry: Pass the "Stimulus to Allow Critical Hair Expenses," or STACHE Act, which would "provide a $250\$ 250 annual tax deduction for expenditures on mustache grooming supplies." According to AMI research, mustached Americans earn 4.3 more money than "clean-shaven Americans" on average per year. Therefore incentivizing mustache growth would boost the economy. > "Given the clear link between the growing and maintenance of mustaches and income, it appears clear that mustache maintenance costs qualify for and should be considered as a deductible expense related to the production of income under Internal Revenue Code Section 212," wrote Dr. John Yeutter, a tax policy professor at Northeastern State University.

?
Problem 13.23

A researcher estimated a simple regression model using stock market returns for these (X,Y)(\mathrm{X}, \mathrm{Y}) pairs: X=1930\mathrm{X}=1930 return, Y=\mathrm{Y}= average return 19301939; X=1940\mathrm{X}=1940 return, Y=\mathrm{Y}= average return 1940-1949, and so on. The estimated correlation was positive, leading him to conclude that annual stock market returns could be used to predict returns over the next 10 years. What statistical flaw do you see in his procedure?

?
Problem 13.24

A study of the number of times that Trump tweeted the word economy each day and the daily high temperature in Moscow five days later found this relationship:

Y=49.49[65.13]+2.00Z,[2.62]R2=.01 \mathrm{Y}=\underset {[65.13]}{49.49}+\underset {[2.62]}{2.00 \mathrm{Z},} \mathrm{R}^{2}=.01

where: Y=Y= Moscow temperature (∘F)({ }^{\circ } \mathrm{F}) Z=\mathrm{Z}= daily Z-score for Trump tweets of the word economy The t -values are in brackets.

?
(a)

What is the average value of ZZ?

(b)

What is the average value of Y?

(c)

Does the coefficient of Z seem statistically persuasive to you?

(d)

Does the coefficient of ZZ seem substantial to you?

(e)

Why are you deeply skeptical of this equation?

Problem 13.25

Explain why you either agree or disagree with these statements:

?
(a)

"Two variables with a +1.00 correlation move up and down at the same time, with the same magnitude."

(b)

"If the estimated slope in a simple regression model is larger than the true slope, then the estimated intercept is smaller than the true intercept."

Problem 13.26

Write the correct correlation value on each graph: −.140,−.988,.509,.863-.140,-.988, .509, .863 :

?
Problem 13.27

A researcher estimated this equation for 74 breakfast cereals,

Y=.3834[16.81]−.0074X[3.55] \mathrm{Y}=\underset {[16.81]}{.3834}-\underset {[3.55]}{.0074 \mathrm{X}}

where: Y=\mathrm{Y}= price per ounce X = grams of sugar per ounce

The t -values are in brackets. Explain why you either agree or disagree with this reasoning: "The Y-intercept of 0.3834 is statistically significant at the 1%1 \% level. This result makes perfect sense because one would expect a box of cereal with zero grams of sugar to cost zero cents."

?
Problem 13.28

A study of the effect of driving speed on traffic fatalities estimated the following model by ordinary least squares,

Y=α+βX+ε, Y=\alpha +\beta X+\varepsilon ,

where: Y=\mathrm{Y}= deaths per million miles driven X=\mathrm{X}= average speed, miles per hour The researcher used the data shown below:

YearX\mathbf{X}Y\mathbf{Y}
198057.01.6
198459.21.4
198559.51.3
?
(a)

The researcher argued that "supporters of lower speed limits would expect β\beta to be close to one, reflecting a strong, direct effect of X on Y." What is wrong with this argument?

(b)

Do you think that an ordinary least squares estimate of β\beta using these data will be positive or negative?

(c)

Why, no matter what the estimate of β\beta, are you suspicious of her data?

Problem 13.29

Least squares will be used to estimate the model Y=α+βX+ε\mathrm{Y}=\alpha +\beta \mathrm{X}+\varepsilon, using annual data for 1991 through 2000. If X=100\mathrm{X}=100 and Y=100\mathrm{Y}=100 in 1991 and X=200X=200 and Y=200Y=200 in 2000, can the least squares estimate of β\beta possibly be negative? Explain your reasoning.

?
Problem 13.30

Least squares regression minimizes which of the following sums? Explain your reasoning.

?
(a)

∑i=1n(Yi−Xi)2\sum_{\mathrm{i}=1}^{\mathrm{n}}\left(\mathrm{Y}_{\mathrm{i}}-\mathrm{X}_{\mathrm{i}}\right)^{2}

(b)

∑i=1n(Yi−Y‾)2\sum_{\mathrm{i}=1}^{\mathrm{n}}\left(\mathrm{Y}_{\mathrm{i}}-\overline{\mathrm{Y}}\right)^{2}

(c)

∑i=1n(Xi−X‾)2\sum_{\mathrm{i}=1}^{\mathrm{n}}\left(\mathrm{X}_{\mathrm{i}}-\overline{\mathrm{X}}\right)^{2}

(d)

∑i=1n(Yi−a−bXi)2\sum_{i=1}^{n}\left(Y_{i}-a-b X_{i}\right)^{2}