Hunter Liu's Website

12. Some Final Practise Problems

≪ 11. A Generalisation of the Implicit Function Theorem | Table of Contents

I put together a handful of practise problems for the upcoming final. You can access them in pdf format if you want, but I’ll provide all the problems with some solutions and commentary in web format below.

Problem 1. The Babylonian Method

Define the sequence of functions {fn(x)}n=0\left\lbrace f_n(x) \right\rbrace _{n=0}^{\infty} on [1,)\left[ 1,\infty \right) by f0(x)=xf_0(x) = x and fn+1(x)=12(fn(x)+xfn(x)).f _{n+1}(x) = \frac{1}{2}\left( f_n(x) + \frac{x}{f_n(x)} \right). Show that for any compact set K[1,)K\subseteq \left[ 1,\infty \right), {fn(x)}\left\lbrace f_n(x) \right\rbrace converges uniformly on KK. Does {fn(x)}\left\lbrace f_n(x) \right\rbrace converge uniformly on [1,)\left[ 1,\infty \right)?

Hint
Try applying Dini’s theorem. How can you verify the conditions?
Outline of Proof

I’ll only give an outline of the proof, as I think the details of each step are relatively straightforward. As stated in the above hint, we should attempt to use Dini’s theorem.

  1. Show that for any fixed xx, one has fn(x)xf_n(x) \geq \sqrt x for all xx. This can be done by induction and computing the derivative of the function g(y)=12(y+xy)g(y) = \frac{1}{2}\left( y+\frac{x}{y} \right).
  2. For any fixed xx, use the contraction mapping principle to show that fn(x)xf_n(x) \to \sqrt x as nn\to\infty.
  3. Show that for any fixed xx, the sequence {fn(x)}n=1\left\lbrace f_n(x) \right\rbrace _{n=1}^{\infty} is nonincreasing. This can be done with another inductive argument.

These three steps set up the conditions of Dini’s theorem, and from there one gets convergence on compact subsets.

To see that the sequence does not converge uniformly on [1,)\left[ 1,\infty \right), one should show (again using an inductive argument) that limxfn(x)=2n\lim _{x\to\infty} f_n(x) = 2 ^{-n} for all nn. Morally speaking, this says that fnf_n grows like a linear function of slope 2n2 ^{-n}, which (for fixed nn) grows much faster than x\sqrt x in the long run.

Some Remarks

This is based on the Babylonian method for computing squareroots, also known as Heron’s method. One way of interpreting it is that it’s just running Newton’s method on the function (\sqrt x).

The point of this problem is (partially) to remind everyone about the conditions of Dini’s theorem, particularly the condition that the domain is compact. This example is an example of Dini’s theorem failing when the domain is not compact!

Problem 2. Orthogonality of Even and Odd Functions

  1. Let f:RRf: \mathbb{R}\to \mathbb{R} be continuous, and suppose that for every odd function ϕC0(R)\phi \in C _{0}^{\infty}(\mathbb{R}) (i.e., ϕ(x)=ϕ(x)\phi (x) = - \phi (-x) for all xx) one has f(x)ϕ(x)dx=0.\int f(x) \phi (x) dx = 0. Prove that f(x)=f(x)f(x) = f(-x) for all xx.
  2. Let fC0(R)f\in C _{0}^{\infty}(\mathbb{R}), and suppose one has f(x)exp(ax2)dx=0\int f(x) \exp \left( ax^2 \right) dx = 0 for all aRa\in \mathbb{R}. Show that ff is odd, i.e. f(x)=f(x)f(x) = -f(-x) for all xx.

Hint
For part 2, perform a change of variables to show that 0(f(x)+f(x))exp(ax2)dx=0\int _{0}^{\infty} \left( f(x)+f(-x) \right) \exp \left( ax^2 \right) dx = 0 for all aRa\in \mathbb{R}. Then, argue that this implies f(x)+f(x)=0f(x)+f(-x) = 0 for all xx.
Solution (Part 1)

For part 1, the idea is that the integral can “detect” whenever f(x)f(x)f(x) \neq f(-x). To make precise what this means, we have for any odd function ϕC0(R)\phi \in C _{0}^{\infty}(\mathbb{R}) that f(x)ϕ(x)dx=0(f(x)f(x))ϕ(x)dx.\int _{-\infty}^{\infty} f(x) \phi (x) dx = \int _{0}^{\infty} \left( f(x) - f(-x) \right) \phi (x) dx. This can be done by breaking up the integral into positive and negative domains, then performing a change of variables to get 0f(x)ϕ(x)dx=0f(x)ϕ(x)dx=0f(x)ϕ(x)dx.\int _{-\infty}^{0} f(x) \phi (x) dx = - \int _{\infty}^{0} f(-x) \phi (-x) dx = - \int _{0}^{\infty} f(-x) \phi (x) dx. Thus, we may reframe the assumptions to saying that 0(f(x)f(x))ϕ(x)dx=0\int _{0}^{\infty} \left( f(x)-f(-x) \right) \phi (x) dx = 0 for any ϕC0([0,))\phi \in C _{0}^{\infty} \left( \left[ 0,\infty \right) \right) satisfying ϕ(0)=0\phi (0)=0 (this is necessary by the odd-ness of ϕ\phi ).

If f(y)f(y)0f(y)-f(-y) \neq 0 for some fixed y>0y>0 (this cannot happen for y=0y=0), then f(x)f(x)0f(x)-f(-x)\neq 0 for x(yϵ,y+ϵ)x\in \left( y-\epsilon , y + \epsilon \right) with ϵ\epsilon sufficiently small. Take ϕ\phi to be a nonnegative bump function supported on this interval, and this yields a contradiction. Thus f(y)f(y)=0f(y) -f(-y) = 0 for all y>0y > 0, and the claim follows.

Solution (Part 2)

We would like to make the same argument as in part 1; performing the same change of variables and using the fact that exp(ax2)\exp \left( ax^2 \right) is even for any aRa\in \mathbb{R}, we have 0(f(x)+f(x))exp(ax2)dx=0\int _{0}^{\infty} \left( f(x)+f(-x) \right)\exp\left( ax^2 \right) dx = 0 for all aRa\in \mathbb{R}. Fix some M>0M>0 such that the support of ff is contained in [M,M]\left[ -M, M \right]. Then, truncating the integral yields 0M(f(x)+f(x))exp(ax2)dx=0\int _{0}^{M} \left( f(x)+f(-x) \right)\exp\left( ax^2 \right) dx = 0 for all aRa\in \mathbb{R}.

We now apply Stone-Weierstrass. Let AA be the set of functions of the form ϕ(x)=n=1Ncnexp(anx2),\phi (x) = \sum _{n=1}^{N} c_n \exp \left( a_nx^2 \right), where NN is a natural number and an,cnRa_n,c_n\in \mathbb{R}. AA contains all constant functions, it is a real subalgebra of C([0,M])C \left( \left[ 0,M \right] \right), and it separates points when restricted to [0,M]\left[ 0,M \right]. Thus, by Stone-Weierstrass, AA is dense in C([0,M])C\left( \left[ 0,M \right] \right).

Note that 0M(f(x)+f(x))ϕ(x)dx=0\int _{0}^{M} \left( f(x)+f(-x) \right)\phi (x) dx = 0 for all ϕA\phi \in A by assumption and by the linearity of the integral. But at the same time, we have for any ψC([0,M])\psi \in C \left( \left[ 0, M \right] \right) and any ϵ>0\epsilon > 0 there exists some ϕϵA\phi _ \epsilon \in A such that supx[0,M]ψ(x)ϕϵ(x)<ϵ\sup _{x\in \left[ 0,M \right]} \left\lvert \psi (x) - \phi _ \epsilon (x) \right\rvert < \epsilon . Then, we get 0M(f(x)+f(x))ψ(x)dx=0M(f(x)+f(x))(ψ(x)ϕϵ(x))dx,\int _{0}^{M} \left( f(x)+f(-x) \right) \psi (x) dx = \int _{0}^{M} \left( f(x)+f(-x) \right) \left( \psi (x) - \phi _ \epsilon (x) \right) dx, and this is bounded in magnitude by ϵ0Mf(x)+f(x)dx.\epsilon \cdot \int _{0}^{M} \left\lvert f(x)+ f(-x) \right\rvert dx. Taking ϵ0\epsilon \to 0 shows that 0M(f(x)+f(x))ψ(x)dx=0\int _{0}^{M} \left( f(x)+f(-x) \right) \psi (x) dx = 0 for all ψC([0,M])\psi \in C \left( \left[ 0, M \right] \right). By the argument in part 1, it follows that f(x)+f(x)=0f(x) + f(-x) = 0 for all x[0,M]x\in \left[ 0, M \right].

Remark

The point of this problem is primarily to present a somewhat surprising application of Stone-Weierstrass.

More broadly, there is a recurring theme in analysis wherein some properties or quantities defined in terms of integrals are only well-understood for a certain class of functions (e.g., on smooth functions). In order to study these properties on a broader class of functions, one must perform some kind of approximation. Both mollifiers and this application of Stone-Weierstrass are great examples of this theme!

A second less significant point of this problem is that the space of continuous functions can be decomposed into an even and odd part: given a function ff, 12(f(x)+f(x))\frac{1}{2} \left( f(x)+f(-x) \right) and 12(f(x)f(x))\frac{1}{2}\left( f(x)-f(-x) \right) are even and odd functions respectively that sum to ff. Moreover, this is an “orthogonal decomposition” with respect to the inner product f,g=f(x)g(x)dx.\left\langle f,g \right\rangle=\int f(x) g(x) dx. This problem demonstrates the “orthogonality” of this decomposition!

Problem 3. Weierstrass M-test for Products

Let {fn}\left\lbrace f_n \right\rbrace be a sequence of bounded continuous functions RR\mathbb{R}\to \mathbb{R}. Let Mn=supxRfn(x)M_n = \sup _{x\in \mathbb{R}} \left\lvert f_n(x) \right\rvert, and suppose n=1Mn\sum _{n=1}^{\infty} M_n converges. Prove that F(x)=n=1(1+fn(x))=limNn=1N(1+fn(x))F(x) = \prod _{n=1}^{\infty} \left( 1+f_n(x) \right) = \lim _{N\to\infty} \prod _{n=1}^{N} \left( 1+f_n(x) \right) converges for each xx and is continuous.

Solution

The setup of the problem (and the title I added) should be reminiscent of the Weierstrass M-test; however, this deals with a product rather than a sum. We should therefore take logarithms to convert the product into a sum!

First, we may assume without loss of generality that Mn<1M_n < 1 for all nn. In order for n=1Mn<\sum _{n=1}^{\infty} M_n < \infty, there must be some N0N_0 such that nN0n \geq N_0 implies Mn<1M_n < 1. Then, we get F(x)=n=1N01(1+fn(x))n=N0(1+fn(x)).F(x) = \prod _{n=1}^{N_0 - 1} \left( 1+ f_n(x) \right)\cdot \prod _{n=N_0}^{\infty} \left( 1+f_n(x) \right). From here, we need only show that the latter infinite product is continuous, as the first term is a finite product of continuous functions and hence continuous.

The point of this rediction is that Mn<1M_n < 1 for all nn implies 1+fn(x)>01+f_n(x) > 0 for all nn and xx. This allows us to actually take logarithms. We consider log(n=1N(1+fn(x)))=n=1Nlog(1+fn(x)).\log \left( \prod _{n=1}^{N} \left( 1+f_n(x) \right) \right) = \sum _{n=1}^{N} \log \left( 1+f_n(x) \right). Taking a second-order Taylor expansion of log(1+y)\log(1+y) around y=0y=0 yields log(1+y)=y12y21(1+ξ)2,\log \left( 1+y \right) = y - \frac{1}{2}y^2 \cdot \frac{1}{(1+\xi) ^2}, where ξ\xi is some number between 00 and yy. Hence, we get for each nn and every xx that log(1+fn(x))Mn+12Mn21(1Mn)2.\left\lvert \log \left( 1+f_n(x) \right) \right\rvert \leq M_n + \frac{1}{2} M_n^2 \cdot \frac{1}{\left( 1-M_n \right)^2}. This is summable: we know by assumption that n=1Mn<\sum _{n=1}^{\infty} M_n < \infty. Moreover, eventually Mn<12M_n < \frac{1}{2}, so eventually 1(1Mn)2<2\frac{1}{\left( 1-M_n \right)^2} < 2. Thus 12Mn21(1Mn)2<\sum \frac{1}{2}M_n^2 \cdot \frac{1}{\left( 1-M_n \right)^2}< \infty, where here Mn<1    Mn2<MnM_n < 1 \implies M_n^2 < M_n justifies the summability of Mn2M_n^2.

Hence, log(n=1N(1+fn(x)))=n=1N=log(1+fn(x))\log\left( \prod _{n=1}^{N} \left( 1+f_n(x) \right) \right) = \sum _{n=1}^{N}=log \left( 1+f_n(x) \right) converges to a continuous function as NN\to\infty by the Weierstrass M-test. Since exp\exp is continuous everywhere, we have that exp(n=1Nlog(1+fn(x)))=n=1N(1+fn(x))\exp \left( \sum _{n=1}^{N} \log \left( 1+f_n(x) \right) \right) = \prod _{n=1}^{N} \left( 1+f_n(x) \right) converges to a continuous function as NN\to\infty, as desired.

Remark
The point of this problem was, on one hand, to remember that the Weierstrass M-test is overpowered, but on the other hand, to demonstrate an application of Taylor expansions. The Taylor expansion is a critical step here, as one needs to verify the summability of suplog(1+fn(x))\sup \left\lvert \log \left( 1+f_n(x) \right) \right\rvert. This supremum is NOT going to be log(1+Mn)\log \left( 1+M_n \right); rather, it will be controlled by log(1Mn)\left\lvert\log \left( 1-M_n \right)\right\rvert, and this ends up being greater than MnM_n!

Problem 4.

Let 0<α10 < \alpha \leq 1. Recall the space of α\alpha -Hölder continuous functions on [0,1]\left[ 0,1 \right], denoted Cα([0,1])C^\alpha \left( \left[ 0,1 \right] \right), the set of continuous functions f:[0,1]Rf:\left[ 0,1 \right]\to \mathbb{R} satisfying fCα:=supx[0,1]f(x)+supxyf(x)f(y)xyα<.\left\lVert f \right\rVert _{C^\alpha }:= \sup _{x\in \left[ 0,1 \right]} \left\lvert f(x) \right\rvert + \sup _{x\neq y} \frac{\left\lvert f(x)-f(y) \right\rvert}{ \left\lvert x-y \right\rvert ^\alpha }< \infty. Let S={fCα([0,1]):f(0)=0}S = \left\lbrace f\in C^ \alpha \left( \left[ 0,1 \right] \right) : f(0) = 0 \right\rbrace. Show that SS is a closed subset of Cα([0,1])C^ \alpha \left( \left[ 0,1 \right] \right). Is SS compact?

Remark
The problem as stated is kind of a triviality. I completely botched the problem statement to tell you the truth. I think something more appropriate would be, let S={fCα([0,1]):fCα1,f(0)=0}.S = \left\lbrace f \in C ^{\alpha }\left( \left[ 0,1 \right] \right) : \left\lVert f \right\rVert _{C^ \alpha } \leq 1, f(0) = 0 \right\rbrace. Show that SS is a compact subset of C([0,1])C \left( \left[ 0,1 \right] \right) with respect to the uniform norm. The point is to illustrate that boundedness at a single point plus equicontinuity is enough to use Ascoli’s theorem.

Problem 5.

Let H={(x,y)R2:x,y0,x2+y21}.\mathbb{H} = \left\lbrace \left( x,y \right)\in \mathbb{R}^2 : x, y \geq 0, x^2+y^2 \leq 1 \right\rbrace. Prove that for any ϵ>0\epsilon > 0 and any continuous function f:HRf: \mathbb{H}\to \mathbb{R} there exists a function g(x,y)g\left( x,y \right) of the form g(x,y)=m=0Nn=0Namnx2my2ng\left( x,y \right)=\sum _{m=0}^{N}\sum _{n=0}^{N} a _{mn} x ^{2m} y ^{2n} for some natural number NN and real numbers amna _{mn} satisfying sup(x,y)Hg(x,y)f(x,y)<ϵ.\sup _{(x, y)\in \mathbb{H}} \left\lvert g\left( x,y \right)-f\left( x,y \right) \right\rvert < \epsilon . Does the result still hold if H\mathbb{H} is replaced by D={(x,y)R2:x2+y21}?\mathbb{D} = \left\lbrace (x, y)\in \mathbb{R}^2 : x^2+y^2 \leq 1 \right\rbrace ?

Partial Solution

You should recognise this as applying Stone-Weierstrass to C(H;R)C\left( \mathbb{H}; \mathbb{R} \right)! Verify that the conditions are met.

The result no longer holds when H\mathbb{H} is replaced with D\mathbb{D}. Consider f(x,y)=xf(x, y) = x. Let ϵ=12\epsilon = \frac{1}{2}, and suppose a g(x,y)g\left( x,y \right) of the given form exists satisfying sup(x,y)Df(x,y)g(x,y)<ϵ.\sup _{(x,y)\in \mathbb{D}}\left\lvert f(x,y)-g(x, y) \right\rvert < \epsilon . Let A=g(12,0)=g(12,0)A = g\left( \frac{1}{2}, 0 \right) = g\left( -\frac{1}{2}, 0 \right). Then, since f(12,0)=12f\left( \frac{1}{2},0 \right)=\frac{1}{2} and f(12,0)=12f\left( -\frac{1}{2},0 \right)=-\frac{1}{2}, we have 12A<12 and 12A<12,\left\lvert \frac{1}{2}-A\right\rvert < \frac{1}{2} \textrm{ and } \left\lvert -\frac{1}{2}-A \right\rvert < \frac{1}{2}, which is impossible.

In particular, Stone-Weierstrass fails because the subalgebra of “even polynomials” in xx and yy no longer separates points.

Problem 6. UCLA Basic Exam, Fall 2021

Let ana_n be any sequence of real numbers. Show that the sequence of functions fn:[0,1]Rf_n: \left[ 0,1 \right]\to \mathbb{R} defined by fn(x)=0xexp(t86cos2(ant))dtf_n(x) = \int _{0}^{x} \exp \left( t^8-6\cos^2 \left( a_nt \right) \right) dt has a subsequence that converges uniformly on [0,1]\left[ 0,1 \right].

Solution

We have for any xx that fn(x)=exp(x86cos2(anx))e\left\lvert f_n’(x) \right\rvert = \exp \left( x^8-6\cos^2\left( a_nx \right) \right) \leq e by the fundamental theorem of calculus. Here, we used the monotonicity of exp\exp and the fact that x[0,1]x\in \left[ 0,1 \right] to get this upper bound.

Note that fn(0)=0f_n(0)=0 for all nn. By the mean value theorem, we have for all xx and yy that fn(x)fn(y)exy\left\lvert f_n(x)-f_n(y) \right\rvert \leq e \cdot \left\lvert x-y \right\rvert for any nn. In particular, taking y=0y=0 yields fn(x)exe\left\lvert f_n(x) \right\rvert \leq e \cdot \left\lvert x \right\rvert \leq e for all nn and for all x[0,1]x\in \left[ 0,1 \right]. Since {fn}\left\lbrace f_n \right\rbrace is equicontinuous and uniformly bounded, we conclude by Ascoli’s theorem that it has a uniformly converging subsequence.

Remark

Problems like this may look scary, but the complicated integrand is an intimidation tactic. Ascoli’s theorem is pretty much the only tool that can give uniformly converging subsequences of functions, so one should expect some kind of equicontinuity to pop out.

The main takeaway from this problem is establishing uniform boundedness. Since fn(0)=0f_n(0)=0 for all nn, and since they were all equicontinuous, we were able to get this for free. More generally, if you know that a sequence of equicontinuous functions is bounded at a single point, you can apply the same argument above to get uniform boundedness!

Problem 7. UCLA Basic Exam, Fall 2020

Let SS be a subset of Rn\mathbb{R}^n. Prove that the following are equivalent:

  1. For each pSp\in S, there exists an open subset VRnV\subseteq \mathbb{R}^n containing pp, and open subset URn1U\subseteq \mathbb{R} ^{n-1}, and an injective C1C^1 function r:URnr:U\to \mathbb{R}^n such that r(U)=VSr(U) = V\cap S and DrDr is injective on UU.
  2. For each pSp\in S, there exists an open neighbourhood VRnV\subseteq \mathbb{R}^n of pp and a C1C^1 function f:VRf:V\to \mathbb{R} such that DfDf is nonzero on VSV\cap S and VS=f1({0})V\cap S = f ^{-1}\left( \left\lbrace 0 \right\rbrace \right).

Hint
Think of the implicit function theorem!

Shoutout to Hayden for helping with the solution in office hours (:

Solution (1 implies 2)

Let pSp\in S, and let r,U,Vr, U, V be as in the problem statement. Let qUq\in U such that r(q)=pr(q)=p.

Since rr has injective derivative, the columns of DrDr must be linearly independent from at least one of the standard basis vectors e1,,ene_1,\ldots, e_n. Suppose without loss of generality that the columns of DrDr are linearly independent from ene_n. Define the function F:U×RRnF: U\times \mathbb{R} \to \mathbb{R}^n via F(x1,,xn)=r(x1,,xn1)+xnen.F\left( x_1,\ldots, x_n \right) = r \left( x_1,\ldots, x _{n-1} \right) + x_n \cdot e_n. Then, we have that the first n1n-1 columns of DF(q,0)\left. DF\right\rvert_{(q, 0)} are just Drq\left. Dr\right\rvert_{q} while the last column of DF(q,0)\left. DF\right\rvert_{(q, 0)} is simply ene_n. Thus, DF(q,0)\left. DF\right\rvert_{(q,0)} has nn linearly independent columns, and it is invertible. By the inverse function theorem, there is an open neighbourhood VV’ of pp, an open subset UUU’\subseteq U, and some interval II containing 00 such that F:U×IVF : U’\times I\to V’ is a C1C^1 bijection with C1C^1 inverse. Let F1:VU×IF ^{-1} : V’\to U’\times I be this inverse, and write its components as F1=(f1,,fn)F ^{-1} = \left( f_1,\ldots, f_n \right).

Since F1FF ^{-1}\circ F is the identity map, we in particular have fnF=fn(r(x1,,xn1)+xnen)=xn.f_n \circ F = f_n \left( r\left( x_1,\ldots, x _{n-1} \right) + x_n e_n \right) = x_n. Thus, fn(y1,,yn)=0f_n\left( y_1,\ldots, y_n \right) = 0 precisely when (y1,,yn)\left( y_1,\ldots, y_n \right) is in the image of rr. That is to say, fn1({0})=VSf_n ^{-1} \left( \left\lbrace 0 \right\rbrace \right) = V’\cap S, the image of rr.

Solution Sketch (2 implies 1)

This is the classic implicit function theorem!

Fix pSp\in S, and let VV be an open neighbourhood of pp and f:VRf:V\to \mathbb{R} as in the problem statement. Since Df0Df\neq 0 at pp, at least one partial derivative of ff is nonzero at pp. We may assume without loss of generality that fxn(p)0\frac{\partial f}{\partial x_n}(p)\neq 0.

By the implicit function theorem, there exists an open neighbourhood VVV’\subseteq V of pp, an open subset URn1U\subseteq \mathbb{R} ^{n-1}, and a C1C^1 function ϕ:UR\phi : U\to \mathbb{R} such that f(x1,,xn1,ϕ(x1,,xn1))=0f\left( x_1,\ldots, x _{n-1}, \phi \left( x_1,\ldots, x _{n-1} \right) \right) = 0 on UU.

Then, we simply define r(x1,,xn1)=(x1,,xn1,ϕ(x1,,xn1)).r\left( x_1,\ldots, x _{n-1} \right) = \left( x_1,\ldots, x _{n-1}, \phi \left( x_1,\ldots, x _{n-1} \right) \right).

There are two things to verify:

  1. r(U)=VSr(U) = V’\cap S, and
  2. DrDr is injective everywhere on UU. These cannot be verified from the conclusion of the implicit function theorem directly; however, replicating the proof of the implicit function theorem (i.e. shoehorning an application of the inverse function theorem) and retaining the additional information there will get you all the way to the end.