MSC Final Yr Project-Linear Functional Analysis-SD
MSC Final Yr Project-Linear Functional Analysis-SD
MSC Final Yr Project-Linear Functional Analysis-SD
PRELIMINARIES
1.1 Introduction:
Functional analysis has its origin in ordinary and partial differential equa-
tions, and in the beginning of the 20th century it started to form a discipline
of its own via integral equations. However, for a long time there were doubts
wether the mathematical theory was rich enough. Despite the efforts of
many prominent mathematicians, it was not sure if there were sufficiently
many functionals to support a good theory, and it was not until 1920 that
the question was finally settled with the celebrated HahnBanach theorem.
Seen from the modern point of view, functional analysis can be consid-
ered as a generalization of linear algebra. However, from a historical point of
view, the theory of linear algebra was not developed enough to provide a ba-
sis for functional analysis at its time of creation. Thus, to study the history
of functional analysis we need to investigate which concepts of mathematics
that needed to be completed in order to get a theory rigorous enough to
support it. Those concepts turn out to be functions, limits and set theory.
1
For a long time, the definition of a function was due to Euler in his In-
troduction in Analysis Infinite term from 1748 which read: A function of a
variable quantity is an analytic expression composed in any way whatsoever
of the variable quantity and numbers or constant quantities.. For the pur-
pose of this report, it is enough to say that the entire focus of this definition
is on the function itself, and the properties of this particular function. What
lead to the success of functional analysis was that the focus was lifted from
the function, and shifted to the algebraic properties of sets of functions The
algebraization of analysis. The process of algebraization led mathematicians
to study sets of functions where the functions are nothing more than abstract
points in the set.
At the same time as the theory is very concrete and applicable to phys-
ical problems, it can be presented in a very abstract way. Some proofs and
results are significantly simplified by introducing the axiom of choice, Zorns
lemma or the Baire category theorem some of the most abstract concepts in
set theory. The main theorems are
2
the material and establish the notation that we will use. We do not attempt
to motivate or explain this material, and any reader who has not met this
material before should consult an appropriate textbook for more information.
Section 1.2 discusses the basic results from linear algebra that will be re-
quired. The material here is quite standard although, in general, we do not
make any assumptions about finite-dimensionality except where absolutely
necessary. Section 1.3 discusses the basic ideas of metric spaces. Metric
spaces are the appropriate setting in which to discuss basic analytical con-
cepts such as convergence of sequences and continuity of functions. The
ideas are a natural extension of the usual concepts encountered in elemen-
tary courses in real analysis. In general metric spaces no other structure is
imposed beyond a metric, which is used to discuss convergence and continu-
ity. However, the essence of functional analysis is to consider vector spaces
(usually infinite-dimensional) which are metric spaces and to study the in-
terplay between the algebraic and metric structures of the spaces, especially
when the spaces are complete metric spaces.
This project will introduce the methods of linear functional analysis. Our
basic goal here is to perform analysis on infinite-dimension vector spaces.
Because not all of our linear algebra properties hold for infinite spaces, we
3
extend ideas like the length of a vector into an abstract setting: the norm.
Much like in real and complex analysis, we will give additional structures to
certain spaces to yield special properties. Through different examples, we
will gain an understanding of normed and inner product spaces, bounded
linear operators, compact metric space.
Here, we will recall some essential concepts from Linear Algebra for use
throughout the project. We will be working with the sets R, C and N. Note
that R and C are both algebraic fields, and when giving examples, theorems,
or definitions that apply equally to RR and C, we will simply use F to denote
either set.
(i) x + y = y + x, x + (y + z) = (x + y) + z;
(iii) for all x ∈ V , there exists a unique -x ∈ V such that x + (-x) = (-x)
+ x = 0;
4
vector addition and scalar multiplication as V .
Rather than proving Definition 1.2.1 (i)-(v) for U, we can use the sub-
space test:
Let U be a non-empty subset of a vector space V . For all α ∈ F and x , y
∈ U , if
(i) x + y ∈ U ;
(ii) αx ∈ U
x = α1 v1 + α2 v2 + ....... + αk vk ∈ V ;
for any scalars α1 , α2 , ........., αk .
(v) The set Fk is a vector space over F, and the set of vectors
ê1 = (1, 0, 0, ....., 0), ê2 = (0, 1, 0, ......., 0)..........êk = (0, 0, 0, ......, 1)
5
forms a basis for Fk , known as the standard basis.
Metric spaces are an abstract setting for the discussion of concepts from
analysis (such as convergence and continuity). The basic tool used here is the
notion of a distance function, or a metric, which we will define in this section.
(ii) d(x , y) = 0 ⇔ x = y;
6
and we often say the metric space M” rather than (M,d).
(i) A is bounded if there exists a number B > 0 such that d(x,y) < B for
all x,y ∈ A.
(ii) A is open if for all x ∈ A, there exists an < 0 such that Bx () =
{y ∈ M : d(x, y) < } ⊂ A. We call Bx () the open ball with radius centered
at x.
7
(vi) A is dense in M if A = M.
(v) A is dense if and only if for any element x ∈ M, there exists a sequence
{yn } in A such that yn → x
8
A. A set A ⊂ M is relatively compact if A is compact.
So far we have seen only the uniform metric on C[a, b], but there are other
Rb
metrics that are defined by integrals. If a f (x)dx is the usual Riemann
integral of f ∈ C[a, b], then for 1 ≤ p < ∞, the function dp : C[a, b] × C[a, b] →
R defined by
Z b p1
dp (f, g) = |f (x) − g(x)|p dx
a
9
P
(i) ∅,X ∈ ;
P P
(ii) S ∈ ⇒X S∈ ;
, n = 1, 2, ......., ⇒ ∪∞
P P
(iii) Sn ∈ n=1 Sn ∈ )
P
A set S ∈ is said to be measurable.
P
Definition 1.4.2: Let X be a set and be a σ-algebra of subsets of X.
P +
A function µ : → R is a measure if it has the following properties:
(i) µ(∅) = 0;
P
(ii) µ is countably additive. In other words, if Sj ∈ , j = 1,2,.... are
pairwise disjoint sets, then
∞
! ∞
[ X
µ Sj = µ(Sj )
j=1 j=1
P
The triple (X, , µ) is called a measure space.
P P
Definition 1.4.3: Let (X, , µ) be a measure space. Then a set S∈
with µ(S) = 0 is said to have measure zero. Also, a given property P(x) is
said to hold almost everywhere if the set {x : P (x) is f alse} has measure
zero.
P
Definition 1.4.4: Let X = N, c be the class of all subsets of N,Pand
for any S ⊂ N, define µc (S) to be thePnumber of elements of S. Then c is
a σ-algebra and µc is a measure on c calledPthe counting measure on N.
Note that the only set of measure zero in (N, c , µc ) is the empty set.
P
Definition
P 1.4.5: Let X = R, L be a σ-algebra,
P and µL be a measure
P L , such that any finite interval I = [a,b] ∈ L and µL (I) = `(I). Then
on
L is called the Lebesgue measure and the sets in are Lebesgue measurable.
P
Note that the sets of measure P zero in (R, L , µL ) are the sets A with
the following property: for any >0, there exists a sequence of intervals
Ij ⊂ R, j = 1, 2,......., such that
10
S∞ P∞
A⊂ j=1 Ij and j=1 `(Ij ) <
φ = kj=1 αj X Sj
P
P
for some k ∈ N where αj ∈ R and Sj ∈ , j = 1,......, k. If is non-negative
and simple, then the integral of over X with respect to µ is defined by
Z k
X
φdµ = αj µ(Sj )
X j=1
+
We do allow µ(Sj ) = ∞ here, and use the algebraic rules of R from the
beginning of this section to evaluate (since φ is non-negative, we will not
encounter any problems like ∞ − ∞). The value of the integral may be ∞.
P
Definition 1.4.7: Let (X, , µ) be a measure space. Then a function f
: X → R is measurable if, for every α ∈ R,
P
{x ∈ X : f (x) > α} ∈
11
Chapter 2
LINEAR FUNCTIONAL ANALYSIS
These are the same linearity properties used in the definition of a linear
mapping; indeed, a real linear functional is simply a special case of a linear
mapping where the range space is R. Complex-valued linear functionals can
also be defined. Well almost always consider only real linear functionals, and
will often simply call them linear functionals. Here are some examples.
R1
1. l(u) = 0 u(x)dx is a Linear Functional on the space of integrable
functions on [0,1].
12
by computing the action of l on each basis vector.
Example
R1 2.1.3: We will find the matrix representation for the functional
l(u) = −1 u(x)dx defined on P 2 , the space of quadratic polynomials. Any
vector Ru(x) ∈ P 2 can be written as a Linear Combination of basis vectors,
2
u(x) = i=0 ui φi (x). Apply l to this vector and find
2
X Z 1
l(u) = ui φi (x)dx
i=0 −1
R1
Define the 1×3 matrix A with elements A1j = −1 φj (x)dx . Then l(u) = Au
where u is the vector of coefficients in the representation of u in the basis
{φi }. Notice that the matrix A depends on the basis used. For example, if
we use the Vandermonde basis {1, x, x2 } we have
2
A=[2 0 3
]
A=[2 0 0]
l(u) = cT u = c.u = uT c.
13
a(u + w, v) = a(u, v) + a(w, v) ∀u,w ∈ U, v ∈ V
a(u, v + w) = a(u, v) + a(u,w), ∀ u ∈ U, v,w ∈ V
a(au, v) = aa(u, v) ∀α ∈ R, u ∈ U, v ∈ V
a(u, av) = aa(u, v) ∀α ∈ R, u ∈ U, v ∈ V.
Note that these are two of the properties defining a real inner product. There-
fore, every real inner product is a real bilinear functional; however, it is not
the case that every bilinear functional is an inner product.
14
symmetric, then its matrix representation will be symmetric. Notice that a
symmetric functional can be represented by a non-symmetric matrix if dif-
ferent bases are chosen for U and V.
uT Au ≥ 0 ∀u 6= 0
which after using AK =λK and the orthogonality of the eigenvectors can be
reduced to X
λi u2i ≥ 0 ∀u 6= 0
i
This will be true iff we have λi > 0 for all i. Thus, a positive definite bilinear
functional has positive definite eigenvalues.
Thus there exists a real number c such that for all x ∈ D(f ),
|f (x)| ≤ ckxk
15
Furthermore, the norm of f is,
!
f (x)
kf k = sup
x∈D(f ),x6=0 kxk
!
kf k = sup |f (x)|
x∈D(f ),kxk=1
where
a = t0 < t1 < < tn = b
is a partition of [a, b].
16
Then ∃ I ∈ R s.t. ∀ > 0 ∃ δ > 0 s.t.
and
kgk = V ar(f ).
It follows from this definition that a convex functional does not take
negative values; for,
Example 2.4.2: The absolute values |(x)| of a linear functional, and also
norm khk of an element.
17
Chapter 3
REPRESENTATION OF BOUNDED LINEAR FUNCTIONALS
IN C(X)
3.1 Introduction:
Let X be a compact metric space. The symbol BX will denote the Borel
σ-algebra of X; i.e., BX is the smallest σ-algebra of subsets of X which con-
tains all compact sets.
18
(i) a compact metric space is totally bounded, i,e,. for any ∈> 0 it is
possible to cover X by finitely many sets with diamater less than ∈; and
Bj,k = Bj,m0j for m0j ≤ k ≤ n2 . In other words, we may assume that in the la-
beling of Bj,k , the range of the second index k is over the finite index set 1, , n2
and independent of the first index j. Using (i) repeatedly, an easy induction
argument shows that we may, for each q, find a positive integer nq and closed
sets Bj1 ,j2 ,,jq : 1 ≤ ji ≤ ni of diameter at most 1q such that (a) X = ∪nj=1
1
Bj ,
nq
and (b) Bj1 ,j2 ,,jq−1 = ∪jq =1 Bj1 ,j2 ,···,jq for each j1 , j2 , · · · , jq−1 .
19
positive linear functional on C(2N ), which is assumed as in normalised form
so that τ (1) = 1. Let
and
kτ̃ k = kτ k
20
= τ (1)
= τ̃ (p∗ (1))
|τ̃ k = τ̃ (1).
Now deducing Lemma 3.2.1 that τ̃ is a positive linear functional on C(2N ).
Concluding from the already proved special case of the theorem for 2N that
there exists Ra positive (in fact probability) measure ν defined on B2N such
that τ̃ (g) = 2N gdν. Hence, we see from the ’change of variable formula’ that
τ (f ) = τ̃ (p∗ (f ))
Z
= p∗ (f )dν
2N
Z
= f ◦ pdν
2N
Z
= f d(ν ◦ p−1 )
X
−1
hence with µ = ν ◦ p , we see that τ is indeed given by integration against
µ.
To complete the proof, we only need to establish uniqueness. For this,
we first assert that if τ is given by integration against µ, then
Since Z Z
IK ≤ f ⇒ µ(K) = IK dµ ≤ f dµ = τ (f )
21
and in particular, µ(K) is no smaller than the infimum .
(i) A is a Gσ set i.e., there exists a sequence Un of open sets such that
A = ∩n Un ;
22
Q disjoint. Then, let C = ∪n Cn , so we may identify
sets Cn are pairwise
C
Y = [0, 1] with n Yn . Writing πn for the natural projection mapping of Y
onto Yn . Defining F : X → Y by requiring that πn ◦ F = Fn , and defining
En0 = πn−1 (En ). The definitions show that F is continuous, En0 ∈ BY , so that
∪n En0 ∈ BY and
proof:Let
Bπ = π −1 (E) : E ∈ BY , and
23
(3) If (Yn , πn ) : n = 1, 2, · · · ⊂ C, then there exists (Y, pi) ∈ C such that
(Yn , πn ) ≤ (Y < π)∀n.
as required.
As for uniqueness, it is seen, exactly as in the compact metric case, that
equation (3.2.4) is valid for every compact Gδ set K.
Here let us assume that X0 is a locally compact Hausdorff space which can
be written as
Let us call a positive measure µ defined on BX0 inner regular if: (i)
µ(K) < ∞ for every compact Gδ subset K of X0 , and (ii) µ(E) = sup µ(K) :
K a compact Gδ subset of E.
24
Proof:Let K be a compact Gδ subset of X 0 , and suppose K = ∩n Un ,, with
Un open. We may, and do, assume without loss of generality that Un has
compact closure and that Un+1 ⊂ Un . For each n, pick a continuous function
φn : X → [0, 1] such that 1Un+1 ≤ φn ≤ 1Un ,
The construction implies that
0 ≤ φn+1 = φn φn+1 ≤ φn
Assertion: Suppose now that f ∈ C(K) and f ≥ 0. Suppose f˜ ∈ Cc (X0 ) is
a non-negative extension of f - i.e., f˜|K = f . Then limn→∞ → τ (f˜φn ) exists
and this limit depends only on f and is independent of the choices of any of
Un , φn , f˜.
25
thereby completing the proof of the assertion.
τK (f ) = lim τ (f˜φn )
n
Notice that the collection A of compact Gδ sets is a directed set with respect
to the ordering defined by
K ≤ L ⇔ K ⊂ Int(L)
26
Z
= f d(µL )|K.
K
Finally, for any set E ∈ BX0 , notice that E ∩ K ∈ BK ∀K ∈ A and
that µK (E ∩ K) : K ∈ A is a non-decreasing net of real numbers which must
converge to a number - call it µ(E) - in [0, ∞]. Note that
µ(E) = sup µK (E ∩ K)
k∈A
∞
a
= sup ( En ∩ K)
K∈A
n=1
∞
X
= sup µK (En ∩ K)
K∈A n=1
N
X
= sup sup µK (En ∩ K)
K∈A N n=1
N
X
= sup sup µK (En ∩ K)
N K∈A n=1
N
X
= sup lim µK (En ∩ K)
N K∈A n=1
N
X
= sup lim µK (En ∩ K)
N K∈A
n=1
N
X
= sup µ(En )
N
n=1
∞
X
= µ(En ).
n=1
27
and hence µ is indeed countably additive, i.e., a measure defined on BX0 .
Let us defer, for a moment, the proof of inner regularity of our µ, and verify,
instead, that there is at most one inner regular measure µ related to a τ as
in the theorem. By inner regularity, it suffices to observe that
so indeed
µ(E) = sup µ(C).
C⊂E,C compact Gδ
The proof of the theorem is complete, modulo that of the following proposi-
tion and its corollary.
28
Lemma 3.3.2, if A is any Baire subset of X, then there exists a compact
matric space Y , a Borel subset E ⊂ Y and a continuous map f : X → Y
such that A = f −1 (E). Applying Proposition 3.4.2 to the measure ν = µ◦f −1
defined on BY , to find compact sets Cn ⊂ E such that ν(E) = supn ν(Cn ).
Noticing that Kn = f −1 (Cn ) is a closed, hence compact. Clearly Gδ subset
of X such that Kn ⊂ A and concluding that
µ(A) = ν(E)
= sup ν(Cn )
n
= sup µ(Kn ).
n
29
Chapter 4
LINEAR OPERATORS
Since we’ve covered some properties of normed spaces, we can now talk
about functions mapping from one normed space into another. The sim-
plest to work with of these maps will be linear (recall the definition of a
linear transformation: a function T : V → W such that for all α, β ∈ F and
x, y ∈ V , T(αx + βy) =αT (x) + βT (y)), and the most important will be con-
tinuous. We will give examples, as well as look at the space of all continuous
linear transformations. First however, we will give alternate characteriza-
tions of continuity for linear transformations.
(ii) T is continuous;
(iii) T is continuous at 0;
(iv) there exists a real number k > 0 such that kT (x)k ≤ k whenever x
∈ X and kxk ≤ 1;
(v) there exists a real number k > 0 such that kT (x)k ≤ kxk for all x ∈ X.
30
So using part (v) of Theorem 4.1.1 with k = 1, we see that T is continu-
ous, and also that this was a much easier way of proving continuity than the
epsilon-delta methods that we are used to.
Notice that this definition is part (v) of Theorem 4.1.1, hence we can
use the words continuous and bounded interchangeably when talking about
linear transformations. However, this use of the word bounded is different
than our conventional definition for functions from R → R. For example,
the linear transformation T : R → R defined by T(x) = x is bounded by
Definition 4.1.4, but obviously not bounded in the usual sense.
Definition 4.1.5: Let X and Y be normed linear spaces. Then the set
of all continuous linear transformations from X to Y is denoted B(X; Y ).
Elements of this set are called bounded linear operators (or sometimes just
operators).
Lemma 4.1.6: Let X and Y be normed linear spaces, and S,T ∈ B(X,Y)
with kS(x)k ≤ k1 kxk and kT (x)k ≤ k2 kxk for all x ∈ X and some real num-
bers k1 , k2 > 0. Let λ ∈ F. Then
(i) k(S + T )(x)k ≤ (k1 + k2 )kxk for all x ∈ X;
(ii) k(λS)(x)k ≤ |λ|k1 kxk for all x ∈ X;
(iii) B(X,Y) is a linear subspace of L(X,Y), and so B(X,Y) is a vector space.
Proof.
(i) For x ∈ X,
k(S + T )(x)k = kS(x) + T (x)k ≤ kS(x)k + kT (x)k ≤ k1 kxk + k2 kxk =
(k1 + k2 )kxk:
(ii) For x ∈ X,
k(λS)(x)k = |λ|kS(x)k ≤ |λ|k1 kxk
31
: (iii) First, B(X; Y ) is not empty because we can always define We see that
(S + T) and (λS) are bounded by Theorem 4.1.1 (v), and so are elements
of B(X,Y). Thus parts (i) and (ii) satisfy the subspace test, so B(X,Y) is a
linear subspace of L(X,Y) (and hence is a vector space).
For the next definition, recall that if X and Y are normed spaces then the
Cartesian product X × Y is also a normed space.
We just saw that B(X,Y) is a vector space, so we will now look to define
a norm. It is important to note that proofs here may have three different
norms from different spaces in the same equation. However, we will use the
symbol k.k as usual for all three norms, as it will be easy to determine which
norm we are referring to based on the space that the element is from. We
should also note that for a normed linear space X, the set of bounded linear
operators from X to X will simply be denoted B(X).
Lemma 4.2.1: Let X and Y be normed spaces and define k.k : B(X,Y)
→ R by kT k = sup{kT (x)k : kxk ≤ 1}. Then k.k is a norm on B(X,Y), so
B(X,Y) is a normed space.
Proof. Before checking the axioms of a norm for k.k, we must note the
following consequence of Theorem 4.1.1:
32
(ii) Note that the zero transformation is defined by T(x) = 0 for all x ∈
X. Then
kT k = 0 ⇐⇒ kT xk = 0∀x ∈ X
⇐⇒ T x = 0∀x ∈ X
⇐⇒ T is the zero transf ormation :
(iii) Since kT (x)k ≤ kT kkxk, we know that k(λT )(x)k ≤ |λ|kT kkxk for all
x ∈ X by Lemma 4.1.6 (ii), hence kλT k ≤ |λ|kT k. If λ = 0, then clearly
kαT k = |λ|kT k and we are done. So assume λ 6= 0. Then
kλT k = |λ|kT k :
33
we get limx→∞ (S(xn ) − S(yn )) = 0, hence limn→∞ S(xn ) = limn→∞ S(yn ).
In the next theorem, we explore what conditions are required for B(X,Y)
to be a Banach Space.
Given the conditions from the definition, if X, Y , and Z are not all the
same, the fact that we can de
ne ST does not necessarily mean that we can define TS. However, if X
= Y = Z, both products will be defined, but generally TS 6= ST. Another
notation point to make is that if X is a normed space and T ∈ B(X), the
product TT will be denoted T 2 , and the product of T with itself n times will
be denoted T n .
One can see it is easy to find the norm of this type of operator. Note that
on every normed space, there is at least one isometry, as we see next.
34
isometrically isomorphic.
Lemma 4.3.6: If two normed linear spaces X and Y are isomorphic, then:
(i) dimX < ∞ ⇐⇒ dimY < ∞ (in which case, dimX = dimY );
35