Chapter 1.5

Differentiation

[29/0%]
LaTeX
Problem 1.5.1

Let ff be defined for all real xx, and suppose that

∣f(x)−f(y)∣≤(x−y)2 \left|f(x)-f(y)\right| \leq (x-y)^{2}

for all real xx and yy. Prove that ff is constant.

?
Problem 1.5.2

Suppose f′(x)>0f^{\prime }(x) > 0 in (a,b)(a, b). Prove that ff is strictly increasing in (a,b)(a, b), and let gg be its inverse function. Prove that gg is differentiable, and that

g′(f(x))=1f′(x)(a<x<b) g^{\prime }(f(x)) = \frac{1}{f^{\prime }(x)} \quad (a < x < b)
?
Problem 1.5.3

Suppose gg is a real function on R1\mathbb {R}^{1}, with bounded derivative (say ∣g′∣≤M\left|g^{\prime }\right| \leq M). Fix ε>0\varepsilon > 0, and define f(x)=x+εg(x)f(x) = x+\varepsilon g(x). Prove that ff is one-to-one if ε\varepsilon is small enough. (A set of admissible values of ε\varepsilon can be determined which depends only on MM).

?
Problem 1.5.4

If

C0+C12+⋯+Cn−1n+Cnn+1=0 C_{0}+\frac{C_{1}}{2}+\cdots +\frac{C_{n-1}}{n}+\frac{C_{n}}{n+1} = 0

where C0,…,CnC_{0}, \ldots , C_{n} are real constants, prove that the equation

C0+C1x+⋯+Cn−1xn−1+Cnxn=0 C_{0}+C_{1} x+\cdots +C_{n-1} x^{n-1}+C_{n} x^{n} = 0

has at least one real root between 0 and 1.

?
Problem 1.5.5

Suppose ff is defined and differentiable for every x>0x > 0, and f′(x)→0f^{\prime }(x) \rightarrow 0 as x→+∞x \rightarrow +\infty. Put g(x)=f(x+1)−f(x)g(x) = f(x+1)-f(x). Prove that g(x)→0g(x) \rightarrow 0 as x→+∞x \rightarrow +\infty.

?
Problem 1.5.6

Suppose

?
(a)

ff is continuous for x≥0x \geq 0,

(b)

f′(x)f^{\prime }(x) exists for x>0x > 0,

(c)

f(0)=0f(0) = 0,

(d)

f′f^{\prime } is monotonically increasing.

Put

g(x)=f(x)x(x>0) g(x) = \frac{f(x)}{x} \quad (x > 0)

and prove that gg is monotonically increasing.

Problem 1.5.7

Suppose f′(x),g′(x)f^{\prime }(x), g^{\prime }(x) exist, g′(x)≠0g^{\prime }(x) \neq 0, and f(x)=g(x)=0f(x) = g(x) = 0. Prove that

lim⁡t→xf(t)g(t)=f′(x)g′(x) \lim _{t \rightarrow x} \frac{f(t)}{g(t)} = \frac{f^{\prime }(x)}{g^{\prime }(x)}

(This holds also for complex functions).

?
Problem 1.5.8

Suppose f′f^{\prime } is continuous on [a,b][a, b] and ε>0\varepsilon > 0. Prove that there exists δ>0\delta > 0 such that

∣f(t)−f(x)t−x−f′(x)∣<ε \left|\frac{f(t)-f(x)}{t-x}-f^{\prime }(x)\right| < \varepsilon

whenever 0<∣t−x∣<δ,a≤x≤b,a≤t≤b0 < \left|t-x\right| < \delta , a \leq x \leq b, a \leq t \leq b. (This could be expressed by saying that ff is uniformly differentiable on [a,b][a, b] if f′f^{\prime } is continuous on [a,b][a, b]). Does this hold for vector-valued functions too?

?
Problem 1.5.9

Let ff be a continuous real function on R1\mathbb {R}^{1}, of which it is known that f′(x)f^{\prime }(x) exists for all x≠0x \neq 0 and that f′(x)→3f^{\prime }(x) \rightarrow 3 as x→0x \rightarrow 0. Does it follow that f′(0)f^{\prime }(0) exists?

?
Problem 1.5.10

Suppose ff and gg are complex differentiable functions on (0,1)(0,1), f(x)→0,g(x)→0f(x) \rightarrow 0, g(x) \rightarrow 0, f′(x)→A,g′(x)→Bf^{\prime }(x) \rightarrow A, g^{\prime }(x) \rightarrow B as x→0x \rightarrow 0, where AA and BB are complex numbers, B≠0B \neq 0. Prove that

lim⁡x→0f(x)g(x)=AB \lim _{x \rightarrow 0} \frac{f(x)}{g(x)} = \frac{A}{B}

Compare with Example 5.18. Hint:

f(x)g(x)={f(x)x−A}⋅xg(x)+A⋅xg(x) \frac{f(x)}{g(x)} = \left\{ \frac{f(x)}{x}-A\right\} \cdot \frac{x}{g(x)}+A \cdot \frac{x}{g(x)}

Apply Theorem 5.13 to the real and imaginary parts of f(x)/xf(x) / x and g(x)/xg(x) / x.

?
Problem 1.5.11

Suppose ff is defined in a neighborhood of xx, and suppose f′′(x)f^{\prime \prime }(x) exists. Show that

lim⁡h→0f(x+h)+f(x−h)−2f(x)h2=f′′(x) \lim _{h \rightarrow 0} \frac{f(x+h)+f(x-h)-2 f(x)}{h^{2}} = f^{\prime \prime }(x)

Show by an example that the limit may exist even if f′′(x)f^{\prime \prime }(x) does not. Hint: Use Theorem 5.13.

?
Problem 1.5.12

If f(x)=∣x∣3f(x) = \left|x\right|^{3}, compute f′(x),f′′(x)f^{\prime }(x), f^{\prime \prime }(x) for all real xx, and show that f(3)(0)f^{(3)}(0) does not exist.

?
Problem 1.5.13

Suppose aa and cc are real numbers, c>0c > 0, and ff is defined on [−1,1][-1,1] by

f(x)={xasin⁡(∣x∣−c)( if x≠0)0( if x=0) f(x) = \begin{cases} x^{a} \sin \left(\left|x\right|^{-c}\right) & (\text{ if } x \neq 0) \\ 0 & (\text{ if } x = 0)\end{cases}

Prove the following statements:

?
(a)

ff is continuous if and only if a>0a > 0.

(b)

f′(0)f^{\prime }(0) exists if and only if a>1a > 1.

(c)

f′f^{\prime } is bounded if and only if a≥1+ca \geq 1+c.

(d)

f′f^{\prime } is continuous if and only if a>1+ca > 1+c.

(e)

f′′(0)f^{\prime \prime }(0) exists if and only if a>2+ca > 2+c.

(f)

f′′f^{\prime \prime } is bounded if and only if a≥2+2ca \geq 2+2 c.

(g)

f′′f^{\prime \prime } is continuous if and only if a>2+2ca > 2+2 c.

Problem 1.5.14

Let ff be a differentiable real function defined in (a,b)(a, b). Prove that ff is convex if and only if f′f^{\prime } is monotonically increasing. Assume next that f′′(x)f^{\prime \prime }(x) exists for every x∈(a,b)x \in (a, b), and prove that ff is convex if and only if f′′(x)≥0f^{\prime \prime }(x) \geq 0 for all x∈(a,b)x \in (a, b).

?
Problem 1.5.15

Suppose a∈R1a \in \mathbb {R}^{1}, ff is a twice-differentiable real function on (a,∞)(a, \infty ), and M0,M1,M2M_{0}, M_{1}, M_{2} are the least upper bounds of ∣f(x)∣,∣f′(x)∣,∣f′′(x)∣\left|f(x)\right|,\left|f^{\prime }(x)\right|,\left|f^{\prime \prime }(x)\right|, respectively, on (a,∞)(a, \infty ). Prove that

M12≤4M0M2 M_{1}^{2} \leq 4 M_{0} M_{2}

Hint: If h>0h > 0, Taylor's theorem shows that

f′(x)=12h[f(x+2h)−f(x)]−hf′′(ξ) f^{\prime }(x) = \frac{1}{2 h}[f(x+2 h)-f(x)]-h f^{\prime \prime }(\xi )

for some ξ∈(x,x+2h)\xi \in (x, x+2 h). Hence

∣f′(x)∣≤hM2+M0h \left|f^{\prime }(x)\right| \leq h M_{2}+\frac{M_{0}}{h}

To show that M12=4M0M2M_{1}^{2} = 4 M_{0} M_{2} can actually happen, take a=−1a = -1, define

f(x)={2x2−1(−1<x<0)x2−1x2+1(0≤x<∞) f(x) = \begin{cases} 2 x^{2}-1 & (-1 < x < 0) \\ \frac{x^{2}-1}{x^{2}+1} & (0 \leq x < \infty )\end{cases}

and show that M0=1,M1=4,M2=4M_{0} = 1, M_{1} = 4, M_{2} = 4. Does M12≤4M0M2M_{1}^{2} \leq 4 M_{0} M_{2} hold for vector-valued functions too?

?
Problem 1.5.16

Suppose ff is twice-differentiable on (0,∞),f′′(0, \infty ), f^{\prime \prime } is bounded on (0,∞)(0, \infty ), and f(x)→0f(x) \rightarrow 0 as x→∞x \rightarrow \infty. Prove that f′(x)→0f^{\prime }(x) \rightarrow 0 as x→∞x \rightarrow \infty.

Hint: Let a→∞a \rightarrow \infty in Exercise 15.

?
Problem 1.5.17

Suppose ff is a real, three times differentiable function on [−1,1][-1,1], such that

f(−1)=0,f(0)=0,f(1)=1,f′(0)=0 f(-1) = 0, \quad f(0) = 0, \quad f(1) = 1, \quad f^{\prime }(0) = 0

Prove that f(3)(x)≥3f^{(3)}(x) \geq 3 for some x∈(−1,1)x \in (-1,1). Note that equality holds for 12(x3+x2)\frac{1}{2}\left(x^{3}+x^{2}\right). Hint: Use Theorem 5.15, with α=0\alpha = 0 and β=±1\beta = \pm 1, to show that there exist s∈(0,1)s \in (0,1) and t∈(−1,0)t \in (-1,0) such that

f(3)(s)+f(3)(t)=6 f^{(3)}(s)+f^{(3)}(t) = 6
?
Problem 1.5.18

Suppose ff is a real function on [a,b],n[a, b], n is a positive integer, and f(n−1)f^{(n-1)} exists for every t∈[a,b]t \in [a, b]. Let α,β\alpha , \beta, and PP be as in Taylor's theorem (5.15). Define

Q(t)=f(t)−f(β)t−β Q(t) = \frac{f(t)-f(\beta )}{t-\beta }

for t∈[a,b],t≠βt \in [a, b], t \neq \beta, differentiate

f(t)−f(β)=(t−β)Q(t) f(t)-f(\beta ) = (t-\beta ) Q(t)

n−1n-1 times at t=αt = \alpha, and derive the following version of Taylor's theorem:

f(β)=P(β)+Q(n−1)(α)(n−1)!(β−α)n f(\beta ) = P(\beta )+\frac{Q^{(n-1)}(\alpha )}{(n-1)!}(\beta -\alpha )^{n}
?
Problem 1.5.19

Suppose ff is defined in (−1,1)(-1,1) and f′(0)f^{\prime }(0) exists. Suppose −1<αn<βn<1-1 < \alpha_{n} < \beta_{n} < 1, αn→0\alpha_{n} \rightarrow 0, and βn→0\beta_{n} \rightarrow 0 as n→∞n \rightarrow \infty. Define the difference quotients

Dn=f(βn)−f(αn)βn−αn D_{n} = \frac{f\left(\beta _{n}\right)-f\left(\alpha _{n}\right)}{\beta _{n}-\alpha _{n}}

Prove the following statements:

?
(a)

If αn<0<βn\alpha_{n} < 0 < \beta_{n}, then lim⁡Dn=f′(0)\lim D_{n} = f^{\prime }(0).

(b)

If 0<αn<βn0 < \alpha_{n} < \beta_{n} and {βn/(βn−αn)}\left\{ \beta_{n} /\left(\beta_{n}-\alpha_{n}\right)\right\} is bounded, then lim⁡Dn=f′(0)\lim D_{n} = f^{\prime }(0).

(c)

If f′f^{\prime } is continuous in (−1,1)(-1,1), then lim⁡Dn=f′(0)\lim D_{n} = f^{\prime }(0).

Give an example in which ff is differentiable in (−1,1)(-1,1) (but f′f^{\prime } is not continuous at 0) and in which αn,βn\alpha_{n}, \beta_{n} tend to 0 in such a way that lim⁡Dn\lim D_{n} exists but is different from f′(0)f^{\prime }(0).

Problem 1.5.20

Formulate and prove an inequality which follows from Taylor's theorem and which remains valid for vector-valued functions.

?
Problem 1.5.21

Let EE be a closed subset of R1\mathbb {R}^{1}. We saw in Exercise 22, Chap. 4, that there is a real continuous function ff on R1\mathbb {R}^{1} whose zero set is EE. Is it possible, for each closed set EE, to find such an ff which is differentiable on R1\mathbb {R}^{1}, or one which is nn times differentiable, or even one which has derivatives of all orders on R1\mathbb {R}^{1}?

?
Problem 1.5.22

Suppose ff is a real function on (−∞,∞)(-\infty , \infty ). Call xx a fixed point of ff if f(x)=xf(x) = x.

?
(a)

If ff is differentiable and f′(t)≠1f^{\prime }(t) \neq 1 for every real tt, prove that ff has at most one fixed point.

(b)

Show that the function ff defined by

f(t)=t+(1+et)−1 f(t) = t+\left(1+e^{t}\right)^{-1}

has no fixed point, although 0<f′(t)<10 < f^{\prime }(t) < 1 for all real tt.

(c)

However, if there is a constant A<1A < 1 such that ∣f′(t)∣≤A\left|f^{\prime }(t)\right| \leq A for all real tt, prove that a fixed point xx of ff exists, and that x=lim⁡xnx = \lim x_{n}, where x1x_{1} is an arbitrary real number and

xn+1=f(xn) x_{n+1} = f\left(x_{n}\right)

for n=1,2,3,…n = 1,2,3, \ldots

(d)

Show that the process described in (c) can be visualized by the zig-zag path

(x1,x2)→(x2,x2)→(x2,x3)→(x3,x3)→(x3,x4)→⋯ \left(x_{1}, x_{2}\right) \rightarrow \left(x_{2}, x_{2}\right) \rightarrow \left(x_{2}, x_{3}\right) \rightarrow \left(x_{3}, x_{3}\right) \rightarrow \left(x_{3}, x_{4}\right) \rightarrow \cdots
Problem 1.5.23

The function ff defined by

f(x)=x3+13 f(x) = \frac{x^{3}+1}{3}

has three fixed points, say α,β,γ\alpha , \beta , \gamma, where

−2<α<−1,0<β<1,1<γ<2. -2 < \alpha < -1, \quad 0 < \beta < 1, \quad 1 < \gamma < 2.

For arbitrarily chosen x1x_{1}, define {xn}\left\{ x_{n}\right\} by setting xn+1=f(xn)x_{n+1} = f\left(x_{n}\right).

?
(a)

If x1<αx_{1} < \alpha, prove that xn→−∞x_{n} \rightarrow -\infty as n→∞n \rightarrow \infty.

(b)

If α<x1<γ\alpha < x_{1} < \gamma, prove that xn→βx_{n} \rightarrow \beta as n→∞n \rightarrow \infty.

(c)

If γ<x1\gamma < x_{1}, prove that xn→+∞x_{n} \rightarrow +\infty as n→∞n \rightarrow \infty.

Thus β\beta can be located by this method, but α\alpha and γ\gamma cannot.

Problem 1.5.24

The process described in part (c) of Exercise 22 can of course also be applied to functions that map⁡(0,∞)\operatorname {map}(0, \infty ) to (0,∞)(0, \infty ).

Fix some α>1\alpha > 1, and put

f(x)=12(x+αx),g(x)=α+x1+x f(x) = \frac{1}{2}\left(x+\frac{\alpha }{x}\right), \quad g(x) = \frac{\alpha +x}{1+x}

Both ff and gg have α\sqrt{\alpha } as their only fixed point in (0,∞)(0, \infty ). Try to explain, on the basis of properties of ff and gg, why the convergence in Exercise 16, Chap. 3, is so much more rapid than it is in Exercise 17. (Compare f′f^{\prime } and g′g^{\prime }, draw the zig-zags suggested in Exercise 22).

Do the same when 0<α<10 < \alpha < 1.

?
Problem 1.5.25

Suppose ff is twice differentiable on [a,b], f(a)<0,f(b)>0,f′(x)≥δ>0f(a) < 0, f(b) > 0, f^{\prime }(x) \geq \delta > 0, and 0≤f′′(x)≤M0 \leq f^{\prime \prime }(x) \leq M for all x∈[a,b]x \in [a, b]. Let ξ\xi be the unique point in (a,b)(a, b) at which f(ξ)=0f(\xi ) = 0.

Complete the details in the following outline of Newton's method for computing ξ\xi.

?
(a)

Choose x1∈(ξ,b)x_{1} \in (\xi , b), and define {xn}\left\{ x_{n}\right\} by

xn+1=xn−f(xn)f′(xn) x_{n+1} = x_{n}-\frac{f\left(x_{n}\right)}{f^{\prime }\left(x_{n}\right)}

Interpret this geometrically, in terms of a tangent to the graph of ff.

(b)

Prove that xn+1<xnx_{n+1} < x_{n} and that

lim⁡n→∞xn=ξ \lim _{n \rightarrow \infty } x_{n} = \xi
(c)

Use Taylor's theorem to show that

xn+1−ξ=f′′(tn)2f′(xn)(xn−ξ)2 x_{n+1}-\xi = \frac{f^{\prime \prime }\left(t_{n}\right)}{2 f^{\prime }\left(x_{n}\right)}\left(x_{n}-\xi \right)^{2}

for some tn∈(ξ,xn)t_{n} \in \left(\xi , x_{n}\right).

(d)

If A=M/2δA = M / 2 \delta, deduce that

0≤xn+1−ξ≤1A[A(x1−ξ)]2n 0 \leq x_{n+1}-\xi \leq \frac{1}{A}\left[A\left(x_{1}-\xi \right)\right]^{2 n}

(Compare with Exercises 16 and 18, Chap. 3).

(e)

Show that Newton's method amounts to finding a fixed point of the function gg defined by

g(x)=x−f(x)f′(x) g(x) = x-\frac{f(x)}{f^{\prime }(x)}

How does g′(x)g^{\prime }(x) behave for xx near ξ\xi?

(f)

Put f(x)=x1/3f(x) = x^{1 / 3} on (−∞,∞)(-\infty , \infty ) and try Newton's method. What happens?

Problem 1.5.26

Suppose ff is differentiable on [a,b],f(a)=0[a, b], f(a) = 0, and there is a real number AA such that ∣f′(x)∣≤A∣f(x)∣\left|f^{\prime }(x)\right| \leq A\left|f(x)\right| on [a,b][a, b]. Prove that f(x)=0f(x) = 0 for all x∈[a,b]x \in [a, b]. Hint: Fix x0∈[a,b]x_{0} \in [a, b], let

M0=sup⁡∣f(x)∣,M1=sup⁡∣f′(x)∣ M_{0} = \sup \left|f(x)\right|, \quad M_{1} = \sup \left|f^{\prime }(x)\right|

for a≤x≤x0a \leq x \leq x_{0}. For any such xx,

∣f(x)∣≤M1(x0−a)≤A(x0−a)M0 \left|f(x)\right| \leq M_{1}\left(x_{0}-a\right) \leq A\left(x_{0}-a\right) M_{0}

Hence M0=0M_{0} = 0 if A(x0−a)<1A\left(x_{0}-a\right) < 1. That is, f=0f = 0 on [a, x0x_{0} ]. Proceed.

?
Problem 1.5.27

Let ϕ\phi be a real function defined on a rectangle RR in the plane, given by a≤x≤ba \leq x \leq b, α≤y≤β\alpha \leq y \leq \beta. A solution of the initial-value problem

y′=ϕ(x,y),y(a)=c(α≤c≤β) y^{\prime } = \phi (x, y), \quad y(a) = c \quad (\alpha \leq c \leq \beta )

is, by definition, a differentiable function ff on [a,b][a, b] such that f(a)=c,α≤f(x)≤βf(a) = c, \alpha \leq f(x) \leq \beta, and

f′(x)=ϕ(x,f(x))(a≤x≤b) f^{\prime }(x) = \phi (x, f(x)) \quad (a \leq x \leq b)

Prove that such a problem has at most one solution if there is a constant AA such that

∣ϕ(x,y2)−ϕ(x,y1)∣≤A∣y2−y1∣ \left|\phi \left(x, y_{2}\right)-\phi \left(x, y_{1}\right)\right| \leq A\left|y_{2}-y_{1}\right|

whenever (x,y1)∈R\left(x, y_{1}\right) \in R and (x,y2)∈R\left(x, y_{2}\right) \in R. Hint: Apply Exercise 26 to the difference of two solutions. Note that this uniqueness theorem does not hold for the initial-value problem

y′=y1/2,y(0)=0 y^{\prime } = y^{1 / 2}, \quad y(0) = 0

which has two solutions: f(x)=0f(x) = 0 and f(x)=x2/4f(x) = x^{2} / 4. Find all other solutions.

?
Problem 1.5.28

Formulate and prove an analogous uniqueness theorem for systems of differential equations of the form

yJ′=ϕJ(x,y1,…,yk),yJ(a)=cJ(j=1,…,k). y_{J}^{\prime } = \phi _{J}\left(x, y_{1}, \ldots , y_{k}\right), \quad y_{J}(a) = c_{J} \quad (j = 1, \ldots , k).

Note that this can be rewritten in the form

y′=ϕ(x,y),y(a)=c \mathbf{y}^{\prime } = \mathbf{\phi }(x, \mathbf{y}), \quad \mathbf{y}(a) = \mathbf{c}

where y=(y1,…,yk)\mathbf{y} = \left(y_{1}, \ldots , y_{k}\right) ranges over a kk-cell, ϕ\mathbf{\phi } is the mapping of a (k+1)(k+1)-cell into the Euclidean kk-space whose components are the functions ϕ1,…,ϕk\phi_{1}, \ldots , \phi_{k}, and c\mathbf{c} is the vector (c1,…,ck)\left(c_{1}, \ldots , c_{k}\right). Use Exercise 26, for vector-valued functions.

?
Problem 1.5.29

Specialize Exercise 28 by considering the system

yj′=yJ+1(j=1,…,k−1)yk′=f(x)−∑j=1kgJ(x)yJ \begin{aligned} y_{j}^{\prime } & = y_{J+1} \quad (j = 1, \ldots , k-1) \\ y_{k}^{\prime } & = f(x)-\sum _{j = 1}^{k} g_{J}(x) y_{J} \end{aligned}

where f,g1,…,gkf, g_{1}, \ldots , g_{k} are continuous real functions on [a,b][a, b], and derive a uniqueness theorem for solutions of the equation

y(k)+gk(x)y(k−1)+⋯+g2(x)y′+g1(x)y=f(x) y^{(k)}+g_{k}(x) y^{(k-1)}+\cdots +g_{2}(x) y^{\prime }+g_{1}(x) y = f(x)

subject to initial conditions

y(a)=c1,y′(a)=c2,…,y(k−1)(a)=ck y(a) = c_{1}, \quad y^{\prime }(a) = c_{2}, \quad \ldots , \quad y^{(k-1)}(a) = c_{k}
?