1.11. SOME TOPICS FROM ANALYSIS 29
Corollary 1.11.4 If ai j ≥ 0, then ∑∞j=r ∑
∞i=r ai j = ∑i, j ai j the last symbol meaning for
Nr the integers larger than or equal to r,
sup
{∑
(i, j)∈Sai j where S is a finite subset of Nr×Nr
}
Proof: ∑(i, j)∈S ai j ≤∑∞j=r ∑
∞i=r ai j and so ∑i, j ai j ≤∑
∞j=r ∑
∞i=r ai j. Let λ <∑
∞j=r ∑
∞i=r ai j.
Then there exists M such that ∑Mj=r ∑
∞i=r ai j = ∑
∞i=r ∑
Mj=r ai j > λ . Now there is N such that
λ < ∑Ni=r ∑
Mj=r ai j < ∑i, j ai j. Since λ is arbitrary, it follows that ∑
∞j=r ∑
∞i=r ai j ≤ ∑i, j ai j ■
These theorems are special cases of Fubini’s theorem in Lebesgue integration as isshown later.
Corollary 1.11.5 If ∑i, j∣∣ai j∣∣ < ∞, then ∑
∞i=r ∑
∞j=r ai j = ∑
∞j=r ∑
∞i=r ai j. Here ai j are
complex numbers.
Proof: First note that ∑∞j=r ai j,∑
∞j=1 Reai j,∑
∞j=1 Imai j exist. This is because, for bi j =
ai j,Reai j, Imai j,∣∣∣∑q
j=p bi j
∣∣∣ ≤ ∑∞j=p∣∣ai j∣∣ which is small if p and q > p are large enough
because ∑ j∣∣ai j∣∣ exists. Thus the partial sums form a Cauchy sequence and therefore, these
converge. This follows from the assumption that R and C are complete which means thatCauchy sequences converge. Now also, for the same bi j, if q > p, then∣∣∣∣∣ q
∑i=p
∞
∑j=r
bi j
∣∣∣∣∣≤ ∞
∑i=p
∣∣∣∣∣ ∞
∑j=r
bi j
∣∣∣∣∣≤ ∞
∑i=p
∞
∑j=r
∣∣ai j∣∣
which is small if p is large enough because ∑∞i=r ∑
∞j=r∣∣ai j∣∣ < ∞. Thus the partial sums
form a Cauchy sequence and so ∑∞i=r ∑
∞j=r bi j exists. Similarly ∑
∞i=r ∑
∞j=r bi j exists. Now∣∣ai j
∣∣+Reai j ≥ 0. Thus
∞
∑i=r
∞
∑j=r
∣∣ai j∣∣+Reai j =
∞
∑j=r
∞
∑i=r
∣∣ai j∣∣+Reai j
Thus, from the definition of the infinite sums,
∞
∑i=r
∞
∑j=r
∣∣ai j∣∣+ ∞
∑i=r
∞
∑j=r
Reai j =∞
∑j=r
∞
∑i=r
∣∣ai j∣∣+ ∞
∑j=r
∞
∑i=r
Reai j
Subtracting that which is known to be equal from both sides leads to the following equation:∑
∞i=r ∑
∞j=r Reai j = ∑
∞j=r ∑
∞i=r Reai j. A similar equation holds by the same reasoning for
Imai j in place of Reai j. Then this implies that ∑∞i=r ∑
∞j=r ai j = ∑
∞j=r ∑
∞i=r ai j. ■
1.11.1 lim sup and lim inf
Sometimes the limit of a sequence does not exist. For example, if an = (−1)n , thenlimn→∞ an does not exist. This is because the terms of the sequence are a distance of 1apart. Therefore there can’t exist a single number such that all the terms of the sequenceare ultimately within 1/4 of that number. The nice thing about limsup and liminf is thatthey always exist. First here is a simple lemma and definition.