Hello, dear friend, you can consult us at any time if you have any questions, add WeChat: THEend8_
100C Instructor: Nicolas Christou Homework 8 Exercise 1 Answer the following questions: a.
Consider the multiple regression model Y = Xβ + , subject to a set of m linear restrictions
of the form Cβ = γ with γ 6= 0. The matrix C is m × (k + 1) and assume that the last m columns
of C are linearly independent so that C can be partitioned in (C1,C2), where C2 is nonsingular.
(The columns of C2 are the last m columns of C). Transform the model into Yr = Xrβ1 + and
explain how to estimate β. b. Consider the constrained least squares problem. If we denote with Yˆ
the unconstrained fitted values and with Yˆc the constrained fitted values show that (Y − Yˆc)′(Y − Yˆc) =
(Y − Yˆ)′(Y − Yˆ) + (Yˆ − Yˆc)′(Yˆ − Yˆc). Exercise 2 Answer the following questions: a.
For the constrained least squares problem let λ be the Lagrange multiplier.
Show that SSEc − SSE = σ2λ′ [var(λ)]−1 λ, where SSEc is the constrained error sum of
squares and SSE is the error sum of squares when there are no constraints. b. Consider the usual multiple regression model.
Show that E(βˆ ′ βˆ) = β′β+σ2 ∑k+1 i=1 1 λi , where βˆ is the ordinary least squares estimator of β
and λi, i = 1, . . . , k + 1 are the eigenvalues of X ′X. c. Consider a multiple regression problem with k = 5 predictors.
The Gauss-Markov conditions hold and also i ∼ N(0, σ). Find the distribution and the pdf of Q = ( βˆ1 − 2βˆ2 + 3βˆ4 βˆ0 + βˆ4 + 3βˆ5 ) .
Exercise 3 Consider the multiple regression model Y = Xβ + . Let X = [X1,X2]. Assume there is no intercept in the model.
Regress Y on X1 and obtain the residuals Y ∗ from this regression. Then regress each column of X2 on X1 to get a matrix of residuals X∗2.
Finally regress the residuals from the first regression on the residuals from the second regression to obtain the partial coefficient βˆ2.1.
Show that Y ∗ −X∗2βˆ2.1 is orthogonal to X. Exercise 4 Answer the following questions: a.
Let Y1 = α1 + 1, Y2 = 2α1 − α2 + 2, Y3 = α1 + 2α2 + 3, where ∼ N3(0, σ2I). Show that the F test for
testig H0 : α1 = α2 is given by F = (αˆ1−αˆ2) 2 11 30 S2e . b. Let Y1 = θ1 + θ2 + 1, Y2 = 2θ2 + 2, Y3 = −θ1 + θ2 + 3,
where ∼ N3(0, σ2I). Explain how you would use the canonical form to derive the F statistic for
testing H0 : θ1 = 2θ2. 1 Exercise 5 Access the following data: a <- read.table