Chapter 6

Geometrical Considerations

[5/100%]
Show
LaTeX
Problem 6.1

Use the Schwarz inequality to show that, for any two matrices AA and BB in a linear space V\mathcal{V},

∥A+B∥≤∥A∥+∥B∥, \left\| A+B\right\| \leq \left\| A\right\| + \left\| B\right\| ,

with equality holding if and only if B=0B = 0 or A=kBA = kB for some nonnegative scalar kk. (This inequality is known as the triangle inequality.)

?
Problem 6.2

Letting AA, BB, and CC represent arbitrary matrices in a linear space V\mathcal{V}, show that

?
(a)

δ(B,A)=δ(A,B)\delta (B,A) = \delta (A,B), that is the distance between BB and AA is the same as that between AA and BB;

(b)
δ(A,B)>0,if A≠B,=0,if A=B, \delta (A,B) > 0, \quad \text{if } A \neq B, \qquad = 0, \quad \text{if } A = B,

that is, the distance between any two matrices is greater than zero, unless the two matrices are identical, in which case the distance between them is zero;

(c)

δ(A,B)≤δ(A,C)+δ(C,B)\delta (A,B) \leq \delta (A,C) + \delta (C,B), that is, the distance between AA and BB is less than or equal to the sum of the distances between AA and CC and between CC and BB;

(d)

δ(A,B)=δ(A+C,B+C)\delta (A,B) = \delta (A+C, B+C), that is, distance is unaffected by a translation of ``axes.''

Remark.
?

For Part (c), use the result of Exercise 6.1, i.e., the triangle inequality.

Problem 6.3

Let w→1′\overrightarrow {w}_1', w→2′\overrightarrow {w}_2', and w→3′\overrightarrow {w}_3' represent the three linearly independent 4-dimensional row vectors (6,0,−2,3)(6,0,-2,3), (−2,4,4,2)(-2,4,4,2), and (0,5,−1,2)(0,5,-1,2), respectively, in the linear space R4\mathbb {R}^{4}, and adopt the usual definition of inner product.

?
(a)

Use Gram-Schmidt orthogonalization to find an orthonormal basis for the linear space sp(w→1′,w→2′,w→3′)\mathrm{sp}(\overrightarrow {w}_1', \overrightarrow {w}_2', \overrightarrow {w}_3').

(b)

Find an orthonormal basis for R4\mathbb {R}^{4} that includes the three orthonormal vectors from Part (a). Do so by extending the results of the Gram-Schmidt orthogonalization [from Part (a)] to a fourth linearly independent row vector such as (0,1,0,0)(0,1,0,0).

Problem 6.4

Let {A1,…,Ak}\left\{ A_1, \ldots , A_k\right\} represent a nonempty (possibly linearly dependent) set of matrices in a linear space V\mathcal{V}.

?
(a)

Generalize the results underlying Gram-Schmidt orthogonalization (which are for the special case where the set {A1,…,Ak}\left\{ A_1, \ldots , A_k\right\} is linearly independent) by showing (1) that there exist scalars xijx_{ij} (i<j=1,…,ki < j = 1, \ldots , k) such that the set comprising the kk matrices

B1=A1,B2=A2−x12B1,  ⋮Bj=Aj−xj−1,jBj−1−⋯−x1jB1,  ⋮Bk=Ak−xk−1,kBk−1−⋯−x1kB1 \begin{align} B_1 & = A_1, \\ B_2 & = A_2 - x_{12}B_1, \\ & \; \vdots \\ B_j & = A_j - x_{j-1,j}B_{j-1} - \cdots - x_{1j}B_1, \\ & \; \vdots \\ B_k & = A_k - x_{k-1,k}B_{k-1} - \cdots - x_{1k}B_1 \end{align}

is orthogonal; (2) that, for j=1,…,kj = 1, \ldots , k and for those i<ji < j such that BiB_i is nonnull, xijx_{ij} is given uniquely by

xij=Aj∙BiBi∙Bi; x_{ij} = \frac{A_j \bullet B_i}{B_i \bullet B_i};

and (3) that the number of nonnull matrices among B1,…,BkB_1, \ldots , B_k equals dim⁡[sp(A1,…,Ak)]\dim [\mathrm{sp}(A_1, \ldots , A_k)].

(b)

Describe a procedure for constructing an orthonormal basis for sp(A1,…,Ak)\mathrm{sp}(A_1, \ldots , A_k).

Problem 6.5

Let AA represent an m×km \times k matrix of rank rr (where rr is possibly less than kk). Generalize the so-called QR decomposition of AA, which is for the special case where r=kr = k and is obtainable through the application of Gram-Schmidt orthogonalization to the columns of AA. Do so by using the results of Exercise 6.4 to obtain a decomposition of the form A=QR1A = QR_1, where QQ is an m×rm \times r matrix with orthonormal columns and R1R_1 is an r×kr \times k submatrix whose rows are the rr nonnull rows of a k×kk \times k upper triangular matrix RR having rr positive diagonal elements and k−rk-r null rows.

?