Chapter 8

Perron-Frobenius Theory of Nonnegative Matrices

[33/97%]
Show
LaTeX
Problem 8.2.1

Verify Perron's theorem by computing the eigenvalues and eigenvectors for

A=(723183129). \mathbf{A} = \begin{pmatrix} 7 & 2 & 3 \\ 1 & 8 & 3 \\ 1 & 2 & 9 \end{pmatrix}.

Find the right-hand Perron vector pp as well as the left-hand Perron vector qTq^T.

?
Problem 8.2.2

Convince yourself that (8.2.2)-(8.2.5) are indeed true.

Statements (8.2.2)-(8.2.5) are properties of the Perron root and Perron vector established in the text for a positive matrix An×n>0A_{n\times n} > 0 with r=ρ(A)r = \rho (A): (8.2.2) r>0r > 0; (8.2.3) r∈σ(A)r \in \sigma (A) (called the Perron root); (8.2.4) alg multA(r)=1\text{alg mult}_A(r) = 1; (8.2.5) there exists an eigenvector x>0x > 0 such that Ax=rxAx = rx.

?
Problem 8.2.3

Provide the details that explain why the Perron vector is uniquely defined.

?
Problem 8.2.4

Find the Perron root and the Perron vector for

A=(1−αβα1−β), A = \begin{pmatrix} 1 - \alpha & \beta \\ \alpha & 1 - \beta \end{pmatrix},

where α+β=1\alpha + \beta = 1 with α,β>0\alpha , \beta > 0.

?
Problem 8.2.5

Suppose that An×n>0A_{n\times n} > 0 has ρ(A)=r\rho (A) = r.

?
(a)

Explain why lim⁡k→∞(A/r)k\lim_{k\to \infty } (A/r)^k exists.

(b)

Explain why lim⁡k→∞(A/r)k=G>0\lim_{k\to \infty } (A/r)^k = G > 0 is the projector onto N(A−rI)N(A - rI) along R(A−rI)R(A - rI).

(c)

Explain why rk⁡(G)=1\operatorname {rk}\left(G\right) = 1.

Problem 8.2.6

Prove that if every row (or column) sum of An×n>0A_{n\times n} > 0 is equal to ρ\rho, then ρ(A)=ρ\rho (A) = \rho.

?
Problem 8.2.7

Prove that if An×n>0A_{n\times n} > 0, then

min⁡i∑j=1naij≤ρ(A)≤max⁡i∑j=1naij. \min _i \sum _{j=1}^{n} a_{ij} \leq \rho (A) \leq \max _i \sum _{j=1}^{n} a_{ij}.
?
Remark.
?

Recall the fact (established earlier in the book) that if 0≤B≤C0 \leq B \leq C entrywise, then ρ(B)≤ρ(C)\rho (B) \leq \rho (C).

Problem 8.2.8

To show the extent to which the hypothesis of positivity cannot be relaxed in Perron's theorem, construct examples of square matrices AA such that A≥0A \geq 0, but A≯0A \not> 0 (i.e., AA has at least one zero entry), with r=ρ(A)∈σ(A)r = \rho (A) \in \sigma (A) that demonstrate the validity of the following statements. Different examples may be used for the different statements.

?
(a)

rr can be 00.

(b)

alg multA(r)\text{alg mult}_A(r) can be greater than 11.

(c)

index(r)\text{index}(r) can be greater than 11.

(d)

N(A−rI)N(A - rI) need not contain a positive eigenvector.

(e)

rr need not be the only eigenvalue on the spectral circle.

Problem 8.2.9

Establish the min-max version of the Collatz--Wielandt formula that says the Perron root for A>0A > 0 is given by r=min⁡x∈Pg(x)r = \min_{x \in \mathcal{P}} g(x), where

g(x)=max⁡1≤i≤n[Ax]ixiandP={x∣x>0}. g(x) = \max _{1 \leq i \leq n} \frac{[Ax]_i}{x_i} \quad \text{and} \quad \mathcal{P} = \left\{ x \mid x > 0\right\} .
?
Problem 8.2.10

Notice that N={x∣x≥0 with x≠0}\mathcal{N} = \left\{ x \mid x \geq 0 \text{ with } x \neq 0\right\} is used in the max-min version of the Collatz--Wielandt formula, but P={x∣x>0}\mathcal{P} = \left\{ x \mid x > 0\right\} is used in the min-max version in the previous exercise. Give an example of a matrix A>0A > 0 that shows r≠min⁡x∈Ng(x)r \neq \min_{x \in \mathcal{N}} g(x) when g(x)g(x) is defined as

g(x)=max⁡1≤i≤nxi≠0[Ax]ixi. g(x) = \max _{\substack {1 \leq i \leq n \\ x_i \neq 0}} \frac{[Ax]_i}{x_i}.
?
Problem 8.3.1

Let A=(010303020)A = \begin{pmatrix} 0 & 1 & 0 \\ 3 & 0 & 3 \\ 0 & 2 & 0 \end{pmatrix}.

?
(a)

Show that AA is irreducible.

(b)

Find the Perron root and Perron vector for AA.

(c)

Find the number of eigenvalues on the spectral circle of AA.

Problem 8.3.2

Suppose that the index of imprimitivity of a 5×55 \times 5 nonnegative irreducible matrix AA is h=3h = 3. Explain why AA must be singular with alg multA(0)=2\text{alg mult}_A(0) = 2.

?
Problem 8.3.3

Suppose that AA is a nonnegative matrix that possesses a positive spectral radius and a corresponding positive eigenvector. Does this force AA to be irreducible?

?
Problem 8.3.4

Without computing the eigenvalues or the characteristic polynomial, explain why σ(Pn)={1,ω,ω2,…,ωn−1}\sigma (P_n) = \{ 1, \omega , \omega^2, \ldots , \omega^{n-1}\}, where ω=e2πi/n\omega = e^{2\pi i/n} for

Pn=(010⋯0001⋯0⋮⋮⋱⋱⋮00⋯01100⋯0). P_n = \begin{pmatrix} 0 & 1 & 0 & \cdots & 0 \\ 0 & 0 & 1 & \cdots & 0 \\ \vdots & \vdots & \ddots & \ddots & \vdots \\ 0 & 0 & \cdots & 0 & 1 \\ 1 & 0 & 0 & \cdots & 0 \end{pmatrix}.
?
Problem 8.3.5

Determine whether

A=(0120000070200000920400010) A = \begin{pmatrix} 0 & 1 & 2 & 0 & 0 \\ 0 & 0 & 0 & 7 & 0 \\ 2 & 0 & 0 & 0 & 0 \\ 0 & 9 & 2 & 0 & 4 \\ 0 & 0 & 0 & 1 & 0 \end{pmatrix}

is reducible or irreducible.

?
Problem 8.3.6

Determine whether the matrix AA in Exercise 8.3.5 is primitive or imprimitive.

?
Problem 8.3.7

A matrix Sn×n≥0S_{n\times n} \geq 0 having row sums less than or equal to 11 with at least one row sum less than 11 is called a substochastic matrix.

?
(a)

Explain why ρ(S)≤1\rho (S) \leq 1 for every substochastic matrix.

(b)

Prove that ρ(S)<1\rho (S) < 1 for every irreducible substochastic matrix.

Problem 8.3.8

A nonnegative matrix for which each row sum is 11 is called a stochastic matrix (some say row-stochastic). Prove that if An×nA_{n\times n} is nonnegative and irreducible with r=ρ(A)r = \rho (A), then AA is similar to rPrP for some irreducible stochastic matrix PP.

?
Remark.
?

Consider D=(p10⋯00p2⋯0⋮⋮⋱⋮00⋯pn)D = \begin{pmatrix} p_1 & 0 & \cdots & 0 \\ 0 & p_2 & \cdots & 0 \\ \vdots & \vdots & \ddots & \vdots \\ 0 & 0 & \cdots & p_n \end{pmatrix}, where the pkp_k's are the components of the Perron vector for AA.

Problem 8.3.9

Wielandt constructed the matrix

Wn=(010⋯0001⋯0⋮⋮⋱⋱⋮00⋯01110⋯0) W_n = \begin{pmatrix} 0 & 1 & 0 & \cdots & 0 \\ 0 & 0 & 1 & \cdots & 0 \\ \vdots & \vdots & \ddots & \ddots & \vdots \\ 0 & 0 & \cdots & 0 & 1 \\ 1 & 1 & 0 & \cdots & 0 \end{pmatrix}

to show that Wnn2−2n+2>0W_n^{n^2-2n+2} > 0, but [Wnn2−2n+1]11=0[W_n^{n^2-2n+1}]_{11} = 0. Verify that this is true for n=4n = 4.

?
Problem 8.3.10

In the Leslie population model, explain what happens to the vector f(t)f(t) as t→∞t \to \infty depending on whether r<1r < 1, r=1r = 1, or r>1r > 1.

?
Remark.
?

The Leslie population model divides a population of females into age groups G1,…,GnG_1, \ldots , G_n, with bkb_k the birth rate and sks_k the survival rate for group GkG_k, and f(t)=(f1(t),…,fn(t))Tf(t) = (f_1(t), \ldots , f_n(t))^T the vector of group sizes at time tt, satisfying f(t+1)=Lf(t)f(t+1) = Lf(t) for the Leslie matrix LL; r=ρ(L)r = \rho (L) is the Perron root of LL, and p,qp, q are the respective Perron vectors of LL and LTL^T.

Problem 8.3.11

Use the characteristic equation to show that the Leslie matrix (from the Leslie population model) is primitive even if b1=0b_1 = 0 (assuming all other bkb_k's and sks_k's are positive).

?
Problem 8.3.12

A matrix A∈Rn×nA \in \mathbb {R}^{n \times n} is said to be essentially positive if AA is irreducible and aij≥0a_{ij} \geq 0 for every i≠ji \neq j. Prove that each of the following statements is equivalent to saying that AA is essentially positive.

?
(a)

There exists some α∈R\alpha \in \mathbb {R} such that A+αIA + \alpha I is primitive.

(b)

etA>0e^{tA} > 0 for all t>0t > 0.

Problem 8.3.13

Let AA be an essentially positive matrix as defined in Exercise 8.3.12. Prove that each of the following statements is true.

?
(a)

AA has an eigenpair (ξ,x)(\xi , x), where ξ\xi is real and x>0x > 0.

(b)

If λ\lambda is any eigenvalue for AA other than ξ\xi, then Re(λ)<ξ\mathrm{Re}\left(\lambda \right) < \xi.

(c)

ξ\xi increases when any entry in AA is increased.

Problem 8.3.14

Let A≥0A \geq 0 be an irreducible matrix, and let aij(k)a_{ij}^{(k)} denote entries in AkA^k. Prove that AA is primitive if and only if

ρ(A)=lim⁡k→∞[aij(k)]1/k. \rho (A) = \lim _{k\to \infty } \left[a_{ij}^{(k)}\right]^{1/k}.
?
Problem 8.4.1

Find the stationary distribution for

P=(1/4003/43/81/43/801/31/61/61/3001/21/2). P = \begin{pmatrix} 1/4 & 0 & 0 & 3/4 \\ 3/8 & 1/4 & 3/8 & 0 \\ 1/3 & 1/6 & 1/6 & 1/3 \\ 0 & 0 & 1/2 & 1/2 \end{pmatrix}.

Does this stationary distribution represent a limiting distribution in the regular sense or only in the Cesaro sense?

?
Problem 8.4.2

A doubly-stochastic matrix is a nonnegative matrix Pn×nP_{n\times n} having all row sums as well as all column sums equal to 11. For an irreducible nn-state Markov chain whose transition matrix is doubly stochastic, what is the long-run proportion of time spent in each state? What form do lim⁡k→∞(I+P+⋯+Pk−1)/k\lim_{k\to \infty } (I + P + \cdots + P^{k-1})/k and lim⁡k→∞Pk\lim_{k\to \infty } P^k (if it exists) have?

?
Remark.
?

The purpose of this exercise is to show that doubly-stochastic matrices are not very interesting from a Markov-chain point of view. However, there is an interesting theoretical result (due to G. Birkhoff in 1946) that says the set of n×nn \times n doubly-stochastic matrices forms a convex polyhedron in Rn×n\mathbb {R}^{n \times n} with the permutation matrices as the vertices.

Problem 8.4.3

Explain why rk⁡(I−P)=n−1\operatorname {rk}\left(I-P\right) = n-1 for every irreducible stochastic matrix Pn×nP_{n\times n}. Give an example to show that this need not be the case for reducible stochastic matrices.

?
Problem 8.4.4

Prove that the left-hand Perron vector for an irreducible stochastic matrix Pn×nP_{n\times n} (n>1n > 1) is given by

πT=1∑i=1nPi(P1,P2,…,Pn), \pi ^T = \frac{1}{\sum _{i=1}^{n} P_i}\left(P_1, P_2, \ldots , P_n\right),

where PiP_i is the iith principal minor determinant of order n−1n-1 in I−PI-P.

?
Remark.
?

What is [adj⁡(A)]A[\operatorname {adj}(A)]A if AA is singular?

Problem 8.4.5

Let Pn×nP_{n\times n} be an irreducible stochastic matrix, and let Qk×kQ_{k\times k} be a principal submatrix of I−PI - P, where 1≤k<n1 \leq k < n. Prove that ρ(Q)<1\rho (Q) < 1.

?
Problem 8.4.6

Let Pn×nP_{n\times n} be an irreducible stochastic matrix, and let Qk×kQ_{k\times k} be a principal submatrix of I−PI - P, where 1≤k<n1 \leq k < n. Explain why QQ is an M-matrix.

?
Remark.
?

An M-matrix is a real nonsingular matrix Qk×kQ_{k\times k} such that [Q]ij≤0[Q]_{ij} \leq 0 for all i≠ji \neq j and Q−1≥0Q^{-1} \geq 0; equivalently, QQ is an M-matrix if and only if there exists a matrix B≥0B \geq 0 and a real number s>ρ(B)s > \rho (B) such that Q=sI−BQ = sI - B.

Problem 8.4.7

Let Pn×nP_{n\times n} (n>1n > 1) be an irreducible stochastic matrix. Explain why all principal minors of order 1≤k<n1 \leq k < n in I−PI - P are positive.

?
Problem 8.4.8

Use the same assumptions that are used for the fail-safe system described in the worked example on two independent controls (Example 8.4.5), but use three controls, AA, BB, and CC, instead of two. Determine the mean time to failure starting with three proven controls, two proven but one untested control, and three untested controls.

?
Remark.
?

The referenced example: a system has two independent controls that can prevent it from being destroyed, activated at discrete time points; the system is "under control" if at least one control holds, and destroyed if all controls fail simultaneously. A control that holds at one activation is 90%90\% reliable at the next; a control that fails and is replaced is only 60%60\% reliable at the next activation.

Problem 8.4.9

A mouse is placed in one chamber of the box shown in the figure below, and a cat is placed in another chamber. Each minute the doors to the chambers are opened just long enough to allow movement from one chamber to an adjacent chamber. Half of the time when the doors are opened, the cat doesn't leave the chamber it occupies. The same is true for the mouse. When either the cat or mouse moves, a door is chosen at random to pass through.

Figure 8.4.1: the mouse-in-a-box floor plan (chamber # 1 is connected to both # 2 and # 3, and # 2 is connected to # 3).Figure 8.4.1: the mouse-in-a-box floor plan (chamber # 1 is connected to both # 2 and # 3, and # 2 is connected to # 3).

?
(a)

Explain why the cat and mouse must eventually end up in the same chamber, and determine the expected number of steps for this to occur.

(b)

Determine the probability that the cat will catch the mouse in chamber jj for each j=1,2,3j = 1, 2, 3.