RMT Course Notes
RMT Course Notes
J. P. Keating
December 19, 2023
1
Contents
1 Overview 5
1.1 Random rotations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.2 Sample covariance matrices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
1.3 Systems of linear equations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.4 Complex quantum systems . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
1.5 Stability of high-dimensional dynamical systems . . . . . . . . . . . . . . . . . . . . . . 7
1.6 Principal Component Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
1.7 Complex networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.8 Machine learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
1.9 Connections with other areas of mathematics . . . . . . . . . . . . . . . . . . . . . . . . 8
1.10 Further reading and remarks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
2
9 Some connections with other areas of mathematics 63
9.1 Longest increasing subsequences . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 63
9.2 Stochastic growth models, random tilings, and random paths . . . . . . . . . . . . . . . 64
9.3 Zeros of the Riemann zeta-function . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 64
3
Preface
These notes accompany the Part C course on Random Matrix Theory, C7.7. It is a pleasure to thank
Michael Curran, Johannes Forkel, Bhargavi Jonnadula, Isao Sauzedde, and Mo Dick Wong for their
help in preparing them. I would be grateful for comments, suggestions, and for reports of typos and
errors.
J. P. Keating
December 2021
4
1 Overview
Matrices play a central role in mathematics and its applications. Just as one considers the properties
of probability measures defined on a space of real or complex variables, it is therefore also natural to
seek to associate probability measures with spaces of matrices. We shall be interested in the properties
of such random matrices, and in applications of Random Matrix Theory to predict what one should
expect in ‘typical’ situations involving linear algebra.
Historically, questions in Random Matrix Theory (RMT) have arisen in a number of different
mathematical contexts. We shall start by reviewing briefly a selection of these, by way of motivation
and a gentle introduction to some of the key themes that will be explored later in more detail.
and
Σij = E(X (i) − µi )(X (j) − µj ) (1.2)
for 1 ≤ i, j ≤ p.
Now let X1 , X2 , . . . , Xn be n i.i.d. p × 1 random vectors with distribution Np (0, Σ). In many
situations in data science, mathematical finance, and statistics one encounters problems of this kind
1 More generally, orthogonal matrices generate linear isometries; the orthogonality of O preserves the dot product
5
where Σ is not known and where one wants to find it. From the data given, the sample covariance
matrix
n
1X
σn = Xk XkT (1.3)
n
k=1
1
σn = X̃ X̃ T . (1.4)
n
Random matrices having this form are known as Wishart random matrices, after John Wishart,
who introduced them in 1928 [20].
Ax = b (1.5)
for the n-dimensional vector x, given an m × n matrix A and an m-dimensional vector b, when m and
n are large. One important consideration is: if b is not specified precisely, how does this imprecision
affect the accuracy with which x can be determined? The condition number is the maximum ratio
of the relative error in x to the relative error in b. A natural way to measure the size of these errors
equates the condition number to the ratio of the largest and smallest singular values of A, or in the
case when A is normal2 , the ratio of the maximal and minimal absolute values of the eigenvalues of A.
In 1947 John von Neumann and Herman Goldstine [15] asked what the condition number would be
for a ‘typical’ large matrix and initiated the study of condition numbers of random matrices, taking the
elements of A to be i.i.d. normal3 random variables. This subject has a long and interesting history,
which is beautifully reviewed in [7]. In particular, the distribution of values taken by the condition
number is related to the distribution of the largest and smallest eigenvalues of the associated random
matrices.
6
1.5 Stability of high-dimensional dynamical systems
Let x(t) be an n-dimensional vector satisfying
dx
= −λIx (1.6)
dt
where λ is a positive constant and I is the n × n identity matrix. This system has a stable fixed point
at x = 0. Clearly in (1.6) the different components of x are uncoupled (because I is diagonal). The
question is: if one now introduces random coupling between these components, does this make the fixed
point more or less stable? Specifically, what is the stability of the system
dx
= −λIx + Ax (1.7)
dt
where A is a random matrix?
This question was first raised by Robert May (Lord May of Oxford) in 1972 in a famous paper [11]
on population dynamics. In that context, it is called the May model. Then the components of x
represent the differences of the populations of various species from some equilibrium values. If the
species do not interact, then it is assumed that the equilibrium values are stable. It had long been
assumed that adding random interactions would make the equilibrium populations more stable when n
is taken to be large. May asked whether this was indeed the case and analysed the situation using the
simple model system (1.7).
Obviously the question of stability is related to knowing the expected size of the eigenvalues of A
when n is large.
This question arises in many other contexts as well, for example in the dynamics of neural models
and on complex networks.
The maximum value uT σn u can take is the largest eigenvalue4 of σn , and this occurs when u is the
corresponding eigenvector.
Clearly this can be extended so that one can project onto the subspace spanned by the eigenvectors
corresponding to the m largest eigenvalues. How large should m be taken? The idea is to compare the
eigenvalues to those of the random matrix Σ defined by (1.2), taken to be a null model, and to keep
those that differ significantly and so represent non-random features of the data. One therefore needs to
know how the eigenvalues of a random Wishart matrix are distributed.
Returning to the problem of comparing Y with X1 , X2 , . . . , Xn , it is obviously natural to seek to
do this in the subspace where the vectors X1 , X2 , . . . , Xn exhibit maximum variability, because this
is where their differences are largest. This can be thought of as enacting ‘feature selection’ in many
4 The eigenvalues of σn are real because the matrix is clearly real and symmetric.
7
applications. The reduction in the dimension of the space where the comparison is made increases the
efficiency of the search considerably.
For an overview of this and similar applications (e.g. to mathematical finance, image analysis, etc)
see [8] and [4].
#{π ∈ Sn : ln ≤ m}
P(ln ≤ m) = . (1.9)
n!
What is the asymptotics of this distribution as n → ∞? Remarkably, it is the same as the asymptotics
of the distribution of the largest eigenvalue of a random complex Hermitian n × n matrix, despite the
fact that there is no matrix in the problem.
5 This matrix is related to the discrete Laplacian acting on the vertex set.
8
A second example concerns the Riemann zeta-function
X∞
1
ζ(s) = s
. (1.10)
n=1
n
The sum converges in Res > 1, and the zeta function has an analytic continuation to all s (except for
s = 1, where it has a pole). The Riemann Hypothesis asserts that all of the zeros of ζ(s) with non-zero
imaginary parts lie on the line Res = 1/2. How are the zeros distributed along the line? Like random
points, or are their positions correlated? It turns out that they are correlated, and all of the evidence
we have suggests that the correlations between them are the same as those between the eigenvalues of
large complex Hermitian random matrices, despite the fact that again there is no obvious matrix in the
problem.
Moreover, the same correlations have been found in the distances between parked cars in London,
and the gaps between bus arrivals in the Mexican city of Cuernavaca.
Finally, many of the calculations in random matrix theory have deep connections with ideas and
results in other areas of mathematics, including combinatorics and topology.
• M. Potters & J.-P. Bouchad, A First Course in Random Matrix Theory for Physicists, Engineers
and Data Scientists (Cambridge University Press)
• G. Livan, M. Novaes & P. Vivo, Introduction to Random Matrices (Springer Briefs in Mathematical
Physics)
• E.S. Meckes, The Random Matrix Theory of the Classical Compact Groups (Cambridge University
Press)
• G.W. Anderson, A. Guionnet & O. Zeitouni, An Introduction to Random Matrices (Cambridge
Studies in Advanced Mathematics)
• M.L. Mehta, Random Matrices (Elsevier, Pure and Applied Mathematics Series)
• G. Akemann, J. Baik & P. Di Francesco, The Oxford Handbook of Random Matrix Theory
(Oxford University Press)
• Z. Bai & J.W. Silverstein, Spectral Analysis of Large Dimensional Random Matrices (Springer).
It is worth remarking that random matrix theory is mathematically an extremely broad subject.
Papers and books on the subject vary considerably in style and intended readership, from analysis
and probability theory to engineering, theoretical physics, and data science. They therefore assume
different background knowledge and differ in levels of abstraction and notions of rigour. These notes
will attempt to chart a middle course, focusing on the main ideas and using a mixture of techniques,
hopefully to give a sense of the various viewpoints that have influenced the development of the subject.
9
2 Examples of random matrix ensembles
Motivated by the examples described in the previous section, we start by defining explicitly the random
matrix ensembles that will be studied in this course6 . Here an ensemble is a space of matrices endowed
with a probability measure.
We start with some general notation. We say that an n × n matrix M is symmetric if Mij is real
∗
and Mij = Mji , and that it is Hermitian if Mij is complex and Mij = Mji , where ∗ denotes complex
conjugation. We denote Sn = {n × n symmetric matrices} and Hn = {n × n Hermitian matrices}.
The Lebesgue measure on Sn is by definition the product of the Lebesgue measures on the linearly
independent entries of M :
Y Yn
dM = dMij dMii . (2.1)
1≤i<j≤n i=1
Similarly on Hn :
Y n
Y
dM = d(ReMij )d(ImMij ) dMii . (2.2)
1≤i<j≤n i=1
with respect to Lebesgue measure on the cone of symmetric positive definite matrices. Here
Yp
n n j−1
Γp ( ) = π p(p−1)/4 Γ − . (2.5)
2 j=1
2 2
10
1), and (ii) Mii are i.i.d. real random variables with distribution N (0, 2) (i.e. Gaussian with zero mean
and variance 2).
Hence, the probability measure on the entries of M ∈ Sn is
n
Y Y
1 1 2 1 1 2 1 1 2
√ e− 4 Mii √ e− 2 Mij dM = n/2 n(n+1)/4
e− 4 TrM dM. (2.6)
i=1
4π 1≤i<j≤n
2π 2 (2π)
The following is one of the most important properties of the GOE. Let O be a non-random n × n
orthogonal matrix (i.e. OOT = I) and let M be an n × n GOE matrix. Then the distribution of M is
the same as that of OM OT ; that is, the GOE is invariant under conjugation by all orthogonal matrices8 .
To prove this, note first that
To see this directly, note that the Hilbert-Schmidt norm of M is precisely TrM 2 , which we have just
seen is invariant under conjugation by O. The map M 7→ OM OT is therefore an isometry and so its
Jacobian determinant is 1. Alternatively one can compute the Jacobian by hand and confirm this by
explicit calculation.
The only ensemble of symmetric random matrices whose entries are independent (up to the symmetry
constraint) and whose distribution is invariant under conjugation by all orthogonal matrices is the
GOE – so the orthogonal invariance is a special property of the Gaussian nature of the matrices. One
can easily construct matrix ensembles that are invariant under conjugation by all orthogonal matrices
but in which the matrix elements are not statistically independent.
and it is invariant under conjugation by all non-random unitary matrices U ; i.e. for U an n × n unitary
matrix (i.e. U U † = I), M and U M U † have the same distribution9 . As in the case of the GOE, to prove
this, note that
Tr[U M U † ]2 = Tr[U M 2 U † ] = Tr[M 2 U † U ] = TrM 2 , (2.10)
and that it follows from calculating the Jacobian of the transformation that
Again, this may be viewed as a consequence of the fact that TrM 2 is the Hilbert-Schmidt norm of M ,
and so conjugation by a unitary matrix is an isometry.
8 This is the reason for the name Gaussian Orthogonal Ensemble.
9 This is the reason for the name Gaussian Unitary Ensemble.
11
The only ensemble of Hermitian random matrices whose entries are independent (up to the symmetry
constraint) and whose distribution is invariant under unitary conjugation is the GUE. One can easily
construct matrix ensembles that are invariant under unitary conjugation but in which the matrix
elements are not statistically independent.
Note that the GOE and GUE measures may, up to a normalization constant, be written in the
form10 β 2
e− 4 TrM dM (2.12)
where for the GOE β = 1 and for the GUE β = 2.
It is also worth noting that the GOE matrix elements are real and the GUE matrix entries are
complex. There is a third Gaussian ensemble, which we will not have time to discuss, for which the
matrix elements are quaternions. This is called the Gaussian Symplectic Ensemble and is invariant
under conjugation by all symplectic matrices.
12
3 The semicircle law for Wigner random matrices
Our goal in this section is to take the first steps in understanding how the eigenvalues of Wigner
random matrices are distributed. As before, let M denote an n × n matrix with real or complex entries
such that for 1 ≤ i ≤ j ≤ n the entries Mij are independent, M = M † in the case when the entries are
complex, and M = M T when the entries are real. Clearly M depends on n, but we will not record this
explicitly, unless it is necessary to do so. We shall assume11 that EMij = 0 and
Exercise Recall the proof that for complex Hermitian matrices (and so as a special case real
symmetric matrices) the eigenvalues are all real.
• The main idea is to compare the moments of the semicircle law (3.3) with the corresponding
spectral moments, i.e. to consider the case when f (x) = xk .
• The computation of the spectral moments maps onto a problem in combinatorics, leading to a
proof that they coincide with the moments of (3.3) in the limit when n → ∞.
11 These assumptions can be relaxed in various ways but are sufficient for our purposes here. Following the steps in the
proof may be easier if one has in mind the weaker condition that E[|Mij |2 ] = 1/n; the difference will not be important to
us.
13
0.6
0.5
0.4
���� ��
0.3
0.2
0.1
0.0
-1.0 -0.5 0.0 0.5 1.0
Figure 1: The spectral density of a single GOE matrix of dimension 2000 compared to the Wigner
semicircle law.
0.6
0.5
0.4
���� ��
0.3
0.2
0.1
0.0
-1.0 -0.5 0.0 0.5 1.0
Figure 2: The spectral density obtained by averaging over 100 GOE matrices of dimension 2000
compared to the Wigner semicircle law.
14
0.6
0.5
0.4
���� ��
0.3
0.2
0.1
0.0
-1.0 -0.5 0.0 0.5 1.0
Figure 3: The spectral density of a single GUE matrix of dimension 2000 compared to the Wigner
semicircle law.
0.6
0.5
0.4
���� ��
0.3
0.2
0.1
0.0
-1.0 -0.5 0.0 0.5 1.0
Figure 4: The spectral density obtained by averaging over 100 GUE matrices of dimension 2000
compared to the Wigner semicircle law.
15
• We first show this for convergence in expectation.
• A variance calculation then implies almost sure convergence.
where, in passing from the fourth to the fifth line, we used the binomial expansion and the fact that
only one term in this expansion gives a non-zero contribution when integrated.
The numbers
1 2m
Cm = (3.6)
m+1 m
are known as the Catalan numbers. They satisfy
2m 2m
Cm = − , (3.7)
m m+1
with C0 = 1, and they are all integers12 . The sequence of Catalan numbers begins 1, 1, 2, 5, 14, 42,
132, 429, 1430, 4862, 16796, 58786, 208012, 742900, 2674440, 9694845, . . . .
Note that it follows from (3.6) that Cm ≤ 4m .
The Catalan numbers play an important role in combinatorics because they count various interesting
objects, ranging from lattice paths to geometric constructions in polygons. See, for example, [10, 17].
We now describe briefly one such connection.
12 This is straightforward to see from (3.7) or from (3.8).
16
For k ∈ N, the set Dk of Dyck paths is the set of paths of length 2k starting at 0 and ending at 0
with increments ±1 and which remain non-negative13 . Then |Dk | = Ck .
To prove this, let A denote the set of walks of length 2k with increments ±1 which start at 0 and
end at -2, and similarly let B denote the set of all walks of length 2k with increments ±1 which start
at 0 and end at 0. Then |Dk | = |B| − |A|, which may be seen in the following way. Let C denote the
set of walks of length 2k with increments ±1 which start at 0 and end at 0, but which hit -1 at some
intermediate point. Obviously |Dk | = |B| − |C|. However, |C| = |A| because the respective paths are in
bijection: for a walk in C, let j be the last visit to −1; reflecting the portion of the path after j about
−1 gives a unique path
terminating at −2 with the same set of visits to −1.
Clearly |B| = 2kk , because B consists of k steps +1 and k steps −1 in some order, and |A| = k+1 ,
2k
Alternatively, consider a Dyck path of length 2(k + 1). Let 2(m + 1) denote the first ‘time’ this
path hits 0. We can break the path into two pieces: the section up to time 2(m + 1) and the section
after this time. The path up to time m is itself a Dyck path, as is the path afterwards. If we denote
|Dn | = dn , then clearly
Xk
dk+1 = dm dk−m , (3.10)
m=0
because there are dm dk−m paths which first hit 0 at time 2(m + 1), and d0 = 1. Hence dk satisfies the
recurrence relation (3.8).
Then (
1 0 if k is odd
lim TrM k = (3.13)
n→∞ n Ck otherwise
2
17
√ √
First, we set µij = nMij , and denote µ = nM . Then
n
X
1 k 1
E TrM = E[µi1 i2 µi2 i3 . . . µik i1 ]. (3.14)
n i
n1+k/2
1 ,i2 ,...,ik =1
Note that for all sets of indices, E[µi1 i2 µi2 i3 . . . µik i1 ] is uniformly bounded by Bk . Each set of indices
corresponds to a sequence i1 i2 . . . ik i1 , which can be thought of as a closed connected path on the set
of vertices {i1 , i2 , . . . , ik } with edges corresponding to pairs of consecutive indices ij ij+1 and with the
convention that ik+1 = i1 . We denote the graph with this set of vertices and edges G(i1 ,i2 ,...,ik ) . Clearly
the graph is connected. One can think of the paths as closed walks on this graph. Crucially, because
the matrix entries are independent, centred random variables, E[µi1 i2 µi2 i3 . . . µik i1 ] = 0 for all paths
except those for which every edge is traversed at least twice, possibly in reverse. There can therefore
be at most k/2 unique edges and hence at most k/2 + 1 distinct vertices in paths giving a non-zero
contribution to the expectation value.
For a sequence i1 i2 . . . ik i1 we define its weight w to be the number of distinct indices. The terms
making a non-zero contribution to (3.14) have w ≤ k/2 + 1. Two sequences i1 i2 . . . ik i1 and i01 i02 . . . i0k i01
are termed equivalent if there exists a bijection on the set {1, 2, . . . , n} mapping each ij to i0j . Sequences
that are equivalent have essentially the same weight and their contributions to (3.14) are asymptotically
the same. Note that the total number of distinct equivalent classes depends on k but is independent of
n, because each class has a representative where all i1 i2 . . . ik are in {1, 2, . . . , k}.
The next step is to show that those paths with weight w < k/2 + 1 make a contribution to (3.14)
that vanishes in the limit as n → ∞. As noted above, E[µi1 i2 µi2 i3 . . . µik i1 ] is uniformly bounded by
Bk . For a given index sequence i1 i2 . . . ik i1 of weight w, the number of sequences equivalent to it
is n(n − 1)(n − 2) . . . (n − w + 1) ≤ nw . The contribution of the terms in this equivalence class to
(3.14) is therefore ≤ Bk nw−k/2−1 and if w < k/2 + 1 this tends to zero as n → ∞. Therefore, because
the number of distinct equivalent classes is independent of n, the total contribution from paths with
w < k/2 + 1 tends to zero in the limit, and when k is even it does so at least as fast as 1/n.
It follows that the only sequences making a non-zero contribution to (3.14) in the limit n → ∞ are
those for which w = k/2 + 1. When k is odd this equation has no solution, because w is an integer.
Hence when k is odd the left hand side of (3.14) tends to zero in the limit n → ∞.
Consider now the case when k is even and w = k/2 + 1. In this case the graphs we need to consider
are connected, have k/2 + 1 vertices and k/2 distinct edges. They are therefore trees.
To see this note that for any finite connected graph G = (V, E) consisting of a set of vertices V and
a set of edges E,
|V | ≤ |E| + 1, (3.15)
with equality if and only if G is a tree. If G is a tree, it follows easily by induction that |E| = |V | − 1.
If G is not a tree, let T = (V, E 0 ) denote a spanning tree of G; i.e. a tree which has the same vertices as
G and for which E 0 ⊆ E. Then |E| ≥ |E 0 | = |V | − 1. If |E| = |V | − 1 then we would have |E| = |E 0 |,
and so G = T .
When k is even and w = k/2 + 1, the sequence i1 i2 . . . ik i1 therefore corresponds to a closed path on
a tree that traverses each edge exactly twice, once in each direction. This means that for any 1 ≤ j ≤ k
ij+1 6= ij . Hence in (3.14) only off-diagonal matrix entries contribute, and these are precisely paired, so
each appears squared. Therefore, using the fact that14 E|µij |2 ∼ 1 for i = 6 j, and that the off-diagonal
matrix entries are independent, we have
Recall that for a given index sequence i1 i2 . . . ik i1 of weight w, the number of sequences equivalent to it
is n(n − 1)(n − 2) . . . (n − w + 1), and that we now have w = k/2 + 1, so that this number grows like
n1+k/2 , as n → ∞ which exactly cancels the factor multiplying the expectation in (3.14).
14 When f (n)/g(n) → 1 as n → ∞ we write f (n) ∼ g(n).
18
The problem has therefore reduced to that of counting the number of sequences i1 i2 . . . ik i1 corre-
sponding to paths of length k on the tree with k/2 + 1 vertices and k/2 distinct edges, each traversed
twice. Such paths are called non-crossing. We can perform this count in the following way. As a
given path is traversed, record at each edge on it whether that edge has been traversed before, or
not. If it is being traversed for the first time, term it open, if it is being traversed for the second
(and last) time, term in closed. For each non-crossing path of length k we associate a sequence, called
the path sequence, whose jth entry is the number of open edges minus the number of closed edges
in the path i1 i2 . . . ij+1 . Now we reach the main point: this sequence starts with a 1 and ends with
a 0, and successive terms differ by ±1. For example, for the path corresponding to the set of edges
({1, 2}, {2, 3}, {3, 2}, {2, 4}, {4, 5}, {5, 4}, {4, 6}, {6, 4}, {4, 2}, {2, 1}), the edges are respectively open,
open, closed, open, open, closed, open, closed, closed, closed, and the associated sequence is 1, 2, 1, 2,
3, 2, 3, 2, 1, 0. If we attach a label 0 at the start, then these sequences are clearly in bijection with the
set of Dyck paths of length k.
Collecting together what we have shown so far, when k is even
1
lim ETrM k = #{path sequences of length k}
n→∞ n
= #{Dyck paths of length k}
= Ck/2 , (3.17)
and when k is odd, the limit is zero. This proves Theorem 2 for convergence in expectation.
We next indicate how to prove almost sure convergence to the same limit. The strategy here is,
having computed the expectation value of the moments, now to compute the variance. We will see that
the variance vanishes as n → ∞ sufficiently fast that a sequence of matrices with increasing size will
converge to the mean almost surely. This is proved by appealing to the Borel-Cantelli lemma. It is an
example of a phenomenon known as concentration of measure that plays an important role in RMT.
The variance is 2 2
1 k 1 k 1 k
var TrM = E TrM − E TrM (3.18)
n n n
and so
n
X n
X
1 k 1
var TrM = 2+k E[µi1 i2 µi2 i3 . . . µik i1 µj1 j2 µj2 j3 . . . µjk j1 ]
n n i1 ,i2 ,...,ik =1 j1 ,j2 ,...,jk =1
As in the calculation of the expectation value of the moments above, one can analyse this sum in
terms of paths on a graph. In the case of the first term on the right hand side of (3.19), the vertices of
the graph in question are labelled by {i1 , i2 , . . . , ik , j1 , j2 , . . . , jk }. For this graph to contribute to the
sum, it must be connected15 , otherwise the first term factorises and is exactly cancelled by the second
term. As before, each edge must appear at least twice and must be traversed an even number of times.
From the arguments above, the terms making a non-zero contribution to (3.19) have w ≤ k + 1.
The fact that the summand is uniformly bounded implies that the variance tends to zero at least as
fast as 1/n. However, we shall need a better bound, and we can find one as follows. For the reasons
explained in the previous calculation, the largest contribution is expected to come from paths with
w = k + 1, which is when the graph is a tree and each edge appears exactly twice, traversed once in
each direction. However, in this case no such terms exist. To see this note that for a pair {i1 , i2 , . . . , ik }
and {j1 , j2 , . . . , jk } to make a non-zero contribution, they must have at least one edge in common;
otherwise the first term in (3.19) factorizes and is cancelled by the second term. However, if each edge
is to appear exactly twice in the i-path or the j-path, this is impossible unless the graph has a closed
cycle; and this is a contradiction, because the graph is a tree.
15 and so i1 = j1
19
It follows that there are no contributing paths with w = k + 1, and so in fact the variance tends to
zero as n → ∞ at least as fast as 1/n2 .
We now apply Chebychev’s inequality, which asserts that for a random variable X with zero mean
and variance σ 2
σ2
P(|X| ≥ δ) ≤ 2 (3.20)
δ
for any δ > 016 . In our case, the fact that the variance tends to zero at least as fast as 1/n2 then means
that for any δ > 0
1 k 1 k αk
P TrM − E TrM > δ ≤ 2 2 (3.21)
n n δ n
where αk is a uniform bound on the summand in (3.19).
The Borel-Cantelli lemma asserts that if E1 , E2 , . . . is a sequence of events in some probability
space, and if the sum of their probabilities is finite, i.e. if
∞
X
P(En ) < ∞, (3.22)
n=1
then
P(lim sup En ) = 0 (3.23)
n→∞
16 Chebychev’s inequality follows from Markov’s inequality: P(|X|2 > (δσ)2 ) ≤ E[|X|2 ]/(δσ)2 .
17 This explains why the straightforward bound, 1/n, was not good enough for our purposes and why we needed the
stronger bound (3.21) .
20
We also define
n
1X
µ̄(x) := E Θ(λj − x). (3.29)
n j=1
and Z Z
1
|x|p dµM (x) ≤ x2p dµM (x), (3.32)
|x|>B Bp
which follows by multiplying the integrand by xp /B p .
Hence Z ! Z
p 1 2p 1 ETrM 2p
P |x| dµM (x) > ≤ E x dµM (x) = . (3.33)
|x|>B B p B p n
We have shown above that the right hand side converges to Cp /B p , and so, for n sufficiently large,
using the fact that Cp ≤ 4p ,
Z ! p
p 1 4
P |x| dµM (x) > ≤ . (3.34)
|x|>B B
In the range of integration, |x|p is strictly increasing, and so the left hand side increases as p increases.
However, the right hand side decreases as p increases. This is only possible if the limsup of the sequence
on the left is actually 0, as was to be shown.
We return now to proving that Theorem 2 extends to all bounded continuous functions f (x), making
use of this Lemma. Let f (x) be a (fixed) bounded continuous function, fix B > 4 and δ > 0. By the
triangle inequality,
Z Z Z Z
f (x)dµM (x) − f (x)dσ(x) ≤ f (x)dµM (x) − pδ (x)dµM (x)
Z Z
+ pδ (x)dµM (x) − pδ (x)dσ(x)
Z Z
+ pδ (x)dσ(x) − f (x)dσ(x) , (3.35)
21
By design of (3.25), the last term is identically zero. In the first term we can use the triangle inequality
Z Z Z Z
f (x)dµM (x) − pδ (x)dµM (x) ≤ |f (x) − pδ (x)|dµM (x) + |f (x) − pδ (x)|dµM (x).
|x|≤B |x|>B
(3.37)
Hence
Z Z Z !
P f (x)dµM (x) − pδ (x)dµM (x) > δ/3 ≤ P |f (x) − pδ (x)|dµM (x) > δ/6
|x|≤B
Z !
+P |f (x) − pδ (x)|dµM (x) > δ/6 . (3.38)
|x|>B
Again, it follows from (3.25) that the first term is identically zero.
We are therefore left with
Z Z Z Z
P f (x)dµM (x) − f (x)dσ(x) > δ ≤ P pδ (x)dµM (x) − pδ (x)dσ(x) > δ/3
Z !
+P |f (x) − pδ (x)|dµM (x) > δ/6 . (3.39)
|x|>B
We have already shown that the first term tends to zero as n → ∞. In the second term, because f (x)
is bounded and pδ (x) is a polynomial, we have |f (x) − pδ (x)| ≤ c|x|k for some positive constant c and
some integer k. Therefore
Z ! Z !
P |f (x) − pδ (x)|dµM (x) > δ/6 ≤P c|x|k dµM (x) > δ/6 . (3.40)
|x|>B |x|>B
It follows from Lemma 3 that as n → ∞, the lim sup of the righthand side is 0, concluding the proof of
Theorem 2.
We note finally that establishing Theorem 2 implies that the measure dµM (x) almost surely converges
weakly to the measure dσ(x) when n → ∞.
22
3.4 Applications
The semicircle law has applications in settings where real-symmetric or complex-Hermitian matrices
arise and can be modelled by random matrices. As noted in the introduction, many problems in
population dynamics, modelling random neural networks, etc, reduce to the following mathematical
question.
Let x(t) be an n-dimensional vector satisfying
dx
= −λIx (3.43)
dt
where λ is a positive constant and I is the n × n identity matrix. This system has a stable fixed point
at x = 0. Clearly in (3.43) the different components of x are uncoupled (because I is diagonal). The
question is: if one now introduces random couplings between these components, does this make the
fixed point more or less stable? Specifically, what is the stability of the system
dx
= −λIx + Ax (3.44)
dt
where A is a random matrix. What, for example, should one expect if |λ| is large compared to the
typical size of the elements of A?
In population dynamics, this is called the May model. Then the components of x represent
the differences of the populations of various species from some equilibrium values and A represents
interactions between the different species.
Now, if A is a real-symmetric random matrix in which the mean-square size of the matrix entries
(i.e.√the interactions)
√ is 1, it is a consequence of the semicircle law that the eigenvalues of A lie between
−2 n and 2 n with increasing probability as n grows. We expect to find eigenvalues over the whole
of this range, but very few outside it. And any outside it will not be far from it. So when n > λ2 /4
we expect to see a transition in the dynamics from exponential stability to exponential instability. In
large random neural networks, this question of stability is related to a transition in the dynamics from
ordered to ‘chaotic’.
If A is not symmetric, so the matrix entries are independent random variables, the circular law
implies a similar transition occurs for large enough systems. In this case the stability also depends on
the eigenvectors, which no longer need be (and typically are not) orthogonal, so the details are more
complicated, but the qualitative picture is the same.
Now, one can question whether it is reasonable to model the interactions as i.i.d. random variables
with the same variance. In population dynamics, some species pairs interact far more strongly than
others. For example, lions interact strongly with zebras, wildebeests, and impalas (and the interaction
is clearly not symmetric!), but barely at all with butterflies or fish. There are food chains and these
give rise to complex networks. Building this topological structure into population models is a significant
area of research involving random matrices with structured correlations between the matrix entries
and where the matrices may be rather sparse. It is also an important area of research in neuroscience,
where again the connectivity matrix for neural pathways is both highly structured and also stochastic.
Finally, we remark that this discussion relates to linear stability. Extending it to nonlinear stability
analysis is currently an active area of research.
23
4 Gaussian random matrices
In the previous section we calculated the spectral moments for general Wigner random matrices. We
now look at the special case when the matrix elements have a Gaussian distribution. In this case we
can go more deeply into the formula embodied in Theorem 2. Recall that Wigner’s theorem relates the
moments to the Catalan numbers in the limit as n → ∞, and that this is proved by linking them to
counts of certain non-crossing paths on graphs. In this limit they therefore have an interpretation in
terms of counting topologically defined objects. We shall see that for Gaussian random matrices this
may be viewed as part of a bigger picture.
To start with, we need to explain a formula that will prove useful in analysing the expectation value
on the right-hand side of (3.14).
Hence Z (
∞
n 1 n −y 2 /2 0 if n is odd
E[X ] = √ y e dy = (4.2)
2π −∞ (n − 1)!! if n is even
where, when m is odd, m!! = m(m − 2)(m − 4) . . . 1. Therefore E[X n ] is equal to the number of ways
of splitting n objects into disjoint pairs. For example E[X 4 ] = 3, corresponding to the 3 ways to split
the numbers 1, 2, 3, 4 into disjoint pairs (i.e in this case [(1, 2)(3, 4)], [(1, 3)(2, 4)], [(1, 4)(2, 3)]).
We label the different ways of splitting n objects into disjoint pairs by π and the set of all pairings
by P2 (n), so #P2 (n) = (n − 1)!! when n is even and zero otherwise.
The following is then a straightforward application of (4.2) due to Isserlis in 1918 and Wick in 1950
(and many others).
Theorem 4. Let Y1 , . . . , Yp be independent standard Gaussian random variables and consider x1 , . . . , xn ∈
{Y1 , . . . , Yp }. Then X Y
E[x1 x2 . . . xn ] = E[xi xj ]. (4.3)
π∈P2 (n) (i,j)∈π
Importantly, the covariances in the Wick formula can be computed straightforwardly from (4.2):
(
1 if xi = xj
E[xi xj ] = (4.4)
0 if xi 6= xj .
Note that because it is linear in the variables x1 , . . . , xn , this√formula applies in exactly the same way
to standard complex Gaussian random variables Z = (X +iY )/ 2, where X and Y are independent real
standard Gaussian random variables. In this case E[Z] = E[Z 2 ] = 0 and E[|Z|2 ] = 1, and if Z1 , . . . , Zp
are independent complex standard Gaussian random variables then for z1 , . . . , zn ∈ {Z1 , . . . , Zp },
E[z1 z2 . . . zk ] is equal to the number of parings which connect zi with its complex conjugate.
Historically, Isserlis introduced this formula in the context of statistical analysis. It was later
re-introduced by Wick to count Feynman diagrams in Quantum Field Theory and it tends now to be
associated with his name.
24
4.2 The genus expansion for Gaussian random matrices
Recall that the spectral moments are given by
X n
1 k 1
E TrM = E[µi1 i2 µi2 i3 . . . µik i1 ]. (4.5)
n i ,i ,...,i
n1+k/2
1 2 k =1
In the previous section we analysed this for general Wigner matrices and found that when n → ∞ the
leading order asymptotics may be calculated by counting non-crossing paths. If we now specialize to
complex Hermitian Gausssian random matrices, for example, we can apply Wick’s theorem to analyse
this expression much more explicitly.
We have from Wick’s theorem that
X Y
E[µi1 i2 µi2 i3 . . . µik i1 ] = E[µia ,ia+1 µib ,ib+1 ] (4.6)
π∈P2 (k) (a,b)∈π
Y k
Y
δia ,ib+1 δia+1 ,ib = δia ,iπ(a)+1 . (4.8)
(a,b)∈π a=1
If we introduce the shift notation γ(a) = a + 1 mod k on the set {1, 2, . . . , k}, so that γ ∈ Sk is a
permutation with cycle (1, 2, . . . , k), then we have that
X n
X k
Y
1 1
E TrM k = δia ,iγπ(a) . (4.9)
n n1+k/2 a=1
π∈P2 (k) i1 ,i2 ,...,ik =1
One can think of the indices {i1 , i2 , . . . , ik } as a function i : {1, . . . , k} → {1, . . . , n}. Then
k
(
Y 1 if i is constant on the cycles of γπ
δia ,iγπ(a) = (4.10)
a=1
0 otherwise.
18 Recall that for standard complex normal random variables, we have to pair a random variable in Wick’s theorem
with its complex conjugate, and that the matrices we are dealing with are Hermitian.
25
Equation (4.12) is an exact formula for the spectral moments of M . To understand its structure,
note first that if k is odd then P2 (k) is empty and so the corresponding spectral moment is identically
zero. We therefore now set k = 2m, so that
X
1 2m
E TrM = n#(γπ)−m−1 . (4.13)
n
π∈P2 (2m)
This sum is known as the genus expansion, because there is an interpretation of #(γπ) that combines
geometric and topological ideas, which we now explain.
We start by drawing a 2m-gon and labelling its vertices in cyclic order v1 , v2 , . . . , v2m . We can then
label its edges by the vertices they connect; so for i = 1, . . . , 2m − 1, ei = vi vi+1 , and e2m = v2m v1 .
A pairing π ∈ P2 (2m) corresponds to an association between pairs of edges, which can then be glued
together to form a compact surface. If this is done so that when vi vi+1 is glued to vj vj+1 , vi is glued
to vj+1 , and vi+1 to vj , then the surface that results is orientable. So, for example, if π(1) = 3 one
identifies e1 and e3 by gluing v1 to v4 and v2 to v3 . We term this the "tail-to-head" convention.
Consider now the surface S̃π obtained by this gluing procedure. The number of distinct vertices in
the image Gπ of the 2m-gon in S̃π is precisely #(γπ). To see this, note that ei is glued to eπ(i) , and so
vi is glued to vγπ(i) for each i ∈ {1, . . . , 2m}. The edge eγπ(i) is glued to eπγπ(i) and so vγπ(i) , which is
now the tail of the edge in question, gets glued to vγπγπ(i) etc. Continuing on this way, we see that vi
ends up being identified with precisely those vj for which j = (γπ)l (i) for some l ∈ N. Therefore the
cycles of γπ count the number of distinct vertices after gluing.
The Euler characteristic of S̃π , χ(S̃π ), is an even integer which may be defined as follows: if G is
any embedded polygonal complex in S̃π , then
χ(S̃π ) = (number of vertices in G) − (number of edges in G) + (number of faces of G). (4.14)
Now, any orientable compact surface is homeomorphic to a g-holed torus for some g ≥ 0 (the g = 0
case is the sphere). The topological invariant g is known as the genus of the surface. It is a theorem of
Cauchy that the Euler characteristic is 2 minus twice the genus, and so
χ(S̃π ) = 2 − 2g(S̃π ). (4.15)
The embedded complex in S̃π that we constructed above has one face, m edges, and #(γπ) vertices,
and so
2 − 2g(S̃π ) = χ(S̃π ) = #(γπ) − m + 1. (4.16)
We therefore have, finally, that
X X
1
E TrM 2m = n−2g(S̃π ) = τg (m)n−2g (4.17)
n
π∈P2 (2m) g≥0
where
τg (m) = #{genus-g surfaces obtained by gluing together pairs of edges of a 2m-gon}. (4.18)
2m
This remarkable formula therefore implies that averaging TrM over the GUE leads to a method for
counting the number of genus-g surfaces obtained by gluing together pairs of edges of a 2m-gon!
We see immediately that since g ≥ 0,
1
lim E TrM 2m = τ0 (m) = #{spheres obtained by gluing together pairs of edges of a 2m-gon}
n→∞ n
(4.19)
and so we see that by Wigner’s theorem
#{spheres obtained by gluing together pairs of edges of a 2m-gon} = Cm (4.20)
where Cm is the m-th Catalan number.
This is the simplest of a wide and important variety of examples where random matrix theory
connects with enumerative topology.
26
5 The Marchenko-Pastur law for Wishart random matrices
The Marchenko-Pastur19 law is the analogue for Wishart random matrices of the Wigner semicircle law
for Hermitian matrices.
1
σn = XX T ∈ Rp×p (5.1)
n
and denote by 0 ≤ λ1 ≤ λ2 ≤ · · · ≤ λp the eigenvalues of σn .
Defining the random spectral distribution by
p
1X
µσ (x) := Θ(λj − x), (5.2)
p j=1
The additional factor (1 − γ −1 )δ(x) which needs to be added to the right-hand side of (5.3) when
γ > 1 is explained by the fact that, since the rank of σn is the smaller of p and n, there are then
approximately p − n zero eigenvalues which will contribute a mass of (1 − γ −1 ) at 0 in the limiting
measure.
Note that when γ = 1, a− = 0 and a+ = 4, and that then (5.3) coincides with the semicircle law
under the mapping x → x2 .
We illustrate the Marchenko-Pastur law by showing the results of numerical experiments. These
involved generating random matrices σn , plotting histograms of the eigenvalues, and comparing with
(5.3). Figure 5 shows the result when p = 103 and n = 104 , compared to (5.3) with γ = 0.1. Similarly
Figure 6 shows the result when p = 1000 and n = 2000, compared to (5.3) with γ = 0.5.
One can prove the Marchenko-Pastur formula in a similar way to the proof of the semicircle law
already described. The main steps are:
• proving that the spectral moments converge in expectation to the moments of the limiting
deterministic Marchenko-Pastur distribution when n → ∞;
• showing that the variance vanishes in the limit when n → ∞, and then using the Borel-Cantelli
lemma to conclude that the moments converge almost surely;
• demonstrating that the distribution is determined by its moments.
19 Sometimes written Marčenko-Pastur.
27
1.2
1.0
0.8
0.6
0.4
0.2
0.0
0.6 0.8 1.0 1.2 1.4 1.6
Figure 5: Eigenvalue density when p = 103 and n = 104 , compared to (5.3) with γ = 0.1.
28
0.8
0.6
0.4
0.2
0.0
0.0 0.5 1.0 1.5 2.0 2.5 3.0
Figure 6: Eigenvalue density when p = 1000 and n = 2000, compared to (5.3) with γ = 0.5.
We will describe the proof of the first step: the convergence of the spectral moments to those of
the limiting deterministic Marchenko-Pastur distribution in expectation. The second and third steps
follow very similar lines to the corresponding ones in the proof of the semicircle law and so we shall not
repeat them here. We focus on the case when γ ≤ 1.
√
The moments of the Marchenko-Pastur distribution are, recalling that a− = (1 − γ)2 and
√ 2
a+ = (1 + γ) , given by
Z a+
1 p
α̃k = xk (a+ − x)(x − a− )dx
a− 2πγx
X γ r k k − 1
k−1
= . (5.4)
r=0
r+1 r r
To see this note that a− + a+ = 2(1 + γ) and that a− a+ = (1 − γ)2 , and hence
Z 2 p
1 √
α̃k = ( γy + 1 + γ)k−1 4 − y 2 dy. (5.5)
2π −2
√
Expanding ( γy + 1 + γ)k−1 binomially in powers of y, and using the formula for the moments of the
semicircle law and Vandermonde’s identity
Xk
m+n m n
= (5.6)
k r=0
r k−r
29
The goal is to show that
p k
1X k 1 1
E λ = E Tr XX T (5.7)
p i=1 i p n
where f (x) = O(g(x)), with g(x) strictly positive for sufficiently large values of x, means |f (x)| ≤ Cg(x)
for some constant C > 0 and for all sufficiently large x.
Hence if G(r, k) denotes the number of different shapes of double trees with r + 1 i-vertices and
k − r j-vertices, we have
p k−1
1X k X r
E λi = γ G(r, k)(1 + O(1/n)). (5.11)
p i=1 r=0
30
In order to do this we establish a bijection with a set of paths of 2k steps, or equivalently a set of
sequences, much as we did in the case of the semicircle law. In this case the paths (or sequences) are
generated as follows. Take (
{−1, 0} if m is odd
sm ∈ (5.13)
{0, 1} if m is even,
and take s2k = 0. We then consider all sequences of steps sm such that: (i) for any t = 1, 2, . . . , 2k
t
X
sm ≥ 0, (5.14)
m=1
that is, the path never crosses 0; (ii) #{m : sm = 1} = #{m : sm = −1} = r, that is, there are exactly
r positive steps and r negative steps; and hence (iii)
2k
X
sm = 0. (5.15)
m=1
To see that this set of sequences is in one-to-one correspondence with the set of double trees that
we wish to count, we start by constructing a mapping from sequences of this kind to double trees in
the following way. If m is odd and sm = 0 go from the i-vertex to a new j-vertex, and if sm = −1 go
back to the adjacent, previously-constructed j-vertex. If m is even and sm = 1, go from a j-vertex to a
new i-vertex, and if sm = 0 go back to an adjacent, previously-constructed i-vertex.
In the reverse direction, consider a path on the double tree as described above, starting at an
i-vertex. After an even number 2m of edge crossings one sits at an i-vertex. If this vertex is new, that
is, if it is being visited for the first time, then set s2m = +1, and otherwise set s2m = 0. After an odd
number 2m − 1 of edge crossings one must sit at a j-vertex, having just left an i-vertex. If this edge
crossing is the last exit from the i-vertex in question, set s2m−1 = −1, and otherwise set s2m−1 = 0. It
is easy to see that this construction gives sequences satisfying properties (ii) and (iii) set out above.
We need, therefore, to check (i). We do this by establishing a contradiction. Let us suppose we have
P2t−1 P2t−2
a first t such that m=1 sm = −1. This requires m=1 sm = 0 and s2t−1 = −1. Now, we could use
the sequence up to 2t − 2 to construct a double tree, and having s2t−1 = −1 would then mean not
establishing a new vertex, but instead going back to one previously created. This however, contradicts
already having built a double tree.
In order to evaluate G(r, k), we therefore need to count the number of sequences {sm }2k m=1 . We
begin by counting sequences that do not necessarily satisfy constraint (i). Recall that s2k = 0. Since
s2k 6= +1 , we have to count the number of ways of allocating r numbers +1 to k − 1 positions, and r
numbers −1 to k positions. The total number of sequences not necessarily satisfying constraint (i) is
therefore k−1 r
k
r .
We now count the number of sequences that fail to satisfy (i). For each of these there must exist
P2t−1
a first t such that m=1 sm = −1. Given this, construct a new sequence {s0m }2k m=1 in the following
way. Set s0m = sm for m = 1, 2, . . . , 2t − 1, and s02k = 0. For t ≤ j ≤ k − 1 put (s02j , s02j+1 ) =
(1, −1) if (s2j , s2j+1 ) = (1, −1), (s02j , s02j+1 ) = (0, 0) if (s2j , s2j+1 ) = (0, 0), (s02j , s02j+1 ) = (1, 0) if
(s2j , s2j+1 ) = (0, −1), and (s02j , s02j+1 ) = (0, −1) if (s2j , s2j+1 ) = (1, 0). The set of sequences {sm }2k m=1
that fail to satisfy (i) is in bijection with the set of sequences {s0m }2k m=1 , but the latter can be counted
straightforwardly to be the number of ways ofk choosing
r − 1 out of k − 1 +1s, and r + 1 out of k −1s.
The number of ways of doing this is k−1 r−1 r+1 . Hence the number of sequences satisfying all of the
conditions, and hence G(r, k), is
k−1 k k−1 k 1 k k−1
− = . (5.16)
r r r−1 r+1 r+1 r r
31
5.2 Applications
Many applications of mathematics involve matrices that are rectangular, not square. In these cases
one is often interested in the singular values. The Marchenko-Pastur law describes the distribution of
singular values when the matrix entries are taken at random.
In data science, we have already seen that the empirical correlations between data points can be
represented as a matrix. These can be analysed through the spectrum of the sample correlation matrix
and so the Marchenko-Pastur law gives a ‘null hypothesis’ against which to test the spectrum, enabling
one to identify the directions (eigenvectors) associated with statistically significant correlations, in the
same way that one might test one-dimensional data against a normal distribution.
An example of this is in Principal Component Analysis, where one wants to identify the effective
dimensionality of the subspace representing the main variation in the data. A rule of thumb for how
many of the largest eigenvalues should be retained is to focus on those lying outside the support of the
Marchenko-Pastur distribution, or those near the edge if these is an unexpected density of them, as
these are most likely to represent non-random features.
For an overview covering a wide range of applications see [8], and for specific applications to
mathematical finance (where this is as an important technique), see [3, 9].
Finally, in many algorithms in numerical linear algebra, the rate of convergence is determined by
the largest singular values, and the Marchenko-Pastur law determines where these are expected to lie
(at the edge of the support).
32
6 Stieltjes and R-transforms
6.1 The Stieltjes transform and the semicircle law
Let µ be a non-negative finite measure on R.
Definition. The Stieltjes transform of µ is, for z ∈ C\R
Z
1
gµ (z) = dµ(x). (6.1)
R x − z
R
If all of the moments of µ, mk = R xk dµ(x), are bounded20 , then for sufficiently large z
Z ∞
1 1 X mk
gµ (z) = − dµ(x) = − (6.2)
R z(1 − x/z) z zk
k=0
Note for future reference that it follows from this formula that if Imz > 0, then ImgµM (z) > 0. Also,
if µM is compactly supported, then as z → ∞
1
gµM (z) ∼ − . (6.4)
z
When µ is the measure corresponding to the semicircle law (3.3),
Z 2 Z Z 2π
1 1 p 1 π 2 2 1 2
gσ (z) = 4 − x dx =
2 sin ydy = sin2 ydy. (6.5)
2π −2 x − z π 0 2 cos y − z 2π 0 2 cos y − z
33
(We remark in passing that for the Marchenko-Pastur distribution, the formula analogous to (6.8) is
and the Stieltjes transform of the Marchenko-Pastur distribution is the solution of this equation
satisfying Img(z) > 0 when Imz > 0.)
Importantly, the Stieltjes transform can be inverted in the following way. Let us define a sub-
probability measure to be a measure µ on R such that µ(R) ≤ 1. For such a measure consider an
interval [a, b] such that µ{a} = µ{b} = 0. Then
Z b
1
µ[a, b] = lim Imgµ (x + iη)dx. (6.10)
η→0 a π
The proof of this inversion formula follows from interchanging the order of integration in
Z b Z b Z ∞
1 1 η
Imgµ (x + iη)dx = dµ(λ)dx. (6.11)
a π −∞ (λ − x) + η
2 2
a π
This gives
Z b Z ∞
1
Imgµ (x + iη)dx = V (λ)dµ(λ) (6.12)
a π −∞
where
1 b−λ a−λ 1 η(b − a)
V (λ) = arctan − arctan = arctan . (6.13)
π η η π (b − λ)(a − λ) + η 2
As η → 0, V (λ) → 1 for λ ∈ (a, b), V (a) = V (b) → 1/2, and V (λ) → 0 otherwise. Since V (λ) is
uniformly bounded and, for any η, V (λ) ∼ η/λ2 as λ → ∞, it can be majorized uniformly in η by a
positive integrable function. Hence it follows from the dominated convergence theorem that
Z ∞
V (λ)dµ(λ) → µ[a, b]. (6.14)
−∞
Note that this means that if two sub-probability measures µ and ν have gµ = gν , then µ = ν.
The Stieltjes transform provides an alternative route to proving both the Wigner semicircle law and
the Marchenko-Pastur law that avoids the combinatorics and path-counting of the proofs described
earlier in these notes; instead the Stieltjes transform approach is more rooted in analysis and probability
theory. We sketch here the proof of the semicircle law for a specific class of Wigner random matrices –
those with Gaussian entries. The proof can be extended to Wigner random matrices in general, but
this is an important class of examples and specialising will allow us to introduce new techniques that
provide some shortcuts.
We start with
1 1 1
gµM (z) = Tr := TrGM (z) (6.15)
n M − zI n
where GM is termed the resolvent of M . For this calculation we will specialise to the case where M is
a real symmetric matrix with entries that are i.i.d. Gaussian random variables with EMij = 0 and
2
EMij = 1/n. (Note the scaling of the variance, which is the one √ that leads to the semicircle law when
n → ∞ and which corresponds to scaling the eigenvalues with 1/ n with respect to when the variance
is 1.) Clearly
1
EgµM (z) = ETrGM (z). (6.16)
n
We now use the fact, which follows straightforwardly from the definition of the resolvent, that
34
and so, setting A = −M
1 1
GM (z) = − I + M GM (z). (6.18)
z z
Another consequence of (6.17) , which follows from setting, for a fixed pair i and j, Aij = Aji =
and Auv = 0 otherwise and then taking the limit as → 0, is that
∂(GM )uv
= −(GM )ui (GM )jv − (GM )uj (GM )iv . (6.19)
∂Mij
We note now that if x is a normal random variable with mean zero and variance σ 2 , then for any
function f that is differentiable and grows no faster than a polynomial, it follows from integrating by
parts that Exf (x) = σ 2 Ef 0 (x).
Combining the last results together, we then have that
1 1 1
ETrGM (z) = − + ETr(M GM )
n z nz
1 1 X
=− + E (Mij (GM )ji )
z nz ij
1 1 X ∂(GM )ji
=− + 2 E
z n z ij ∂Mij
1 1 X
=− + 2 E [−(GM )ji (GM )ij − (GM )jj (GM )ii ]
z n z ij
" 2 #
1 1 2
1 1
= − − 2 E TrGM − E TrGM . (6.20)
z n z z n
when n → ∞.
Hence we have that
1 1
EgµM (z) = − − E gµM (z)2 + E(z, n) (6.22)
z z
where for any z, E(z, n) → 0 as n → ∞. 2
We now want to establish that we can replace E gµM (z)2 with (EgµM (z)) , with an error that
tends to zero as n → ∞. Note that gµM (z) depends on n, because M is an n × n matrix. In the
following calculation the n-dependence will be important, so we record that dependence explicitly,
augmenting the notation to read gµMn (z). The strategy will be to show that replacing Mn by an
(n − 1) × (n − 1) minor, Mn−1 , does not change the Stieltjes transform appreciably when n is large –
i.e. that gµMn−1 (z) is close to gµMn (z). This will allow us to use an estimate to establish that gµMn (z)
lies sufficiently close to E gµMn (z) for us to prove what we need.
(n)
Let z = a + ib, with b > 0. We denote the eigenvalues of Mn by {λj }nj=1 and the eigenvalues of
(n−1) n−1
Mn−1 by {λj }j=1 . Now, Cauchy’s Interlace Theorem21 implies that the eigenvalues of Mn and
21 Cauchy’s Interlace Theorem may be stated as follows. Let A be an n × n Hermitian matrix with eigenvalues
35
(n) (n−1) (n)
those of Mn−1 interlace, that is λj ≤ λj ≤ λj+1 for j = 1, . . . , n − 1. Hence the difference
n−1
X n
X
b b
(n−1)
− (n)
(6.23)
j=1 (λj − a)2 + b2 j=1 (λj − a)2 + b2
(n) (n−1) (n) (n−1) (n−1) (n)
is bounded in n , because (x−a)b2 +b2 has finite total variation and λ1 , λ1 , λ2 , λ2 , . . . , λn−1 , λn
forms a partition. The same conclusion holds if one replaces the numerators in the summands with
(n−1) (n)
λj − a and λj − a respectively. It follows that
1
gµMn (z) = gµMn−1 (z) + O . (6.24)
n
gµMn (z) is therefore said to be stable in n. Note as well that the right-hand side of this equation
depends only on the top left (n − 1) × (n − 1) minor of M and is independent of its nth row and nth
column. We can therefore apply the following inequality, due to McDiarmid.
Lemma 6 (McDiarmid’s inequality). Let x1 , . . . , xn be independent random variables taking values in
ranges R1 , . . . , Rn and let F : R1 × · · · × Rn → C be a function having bounded differences, so that,
there exist constants c1 , . . . , cn such that for all i,
for all large n. Therefore gµMn (z) − E[gµMn (z)] → 0 almost surely for all z with Imz > 0.
Note that one can view (6.27) and (6.30) as examples of concentration of measure in the context of
the Stieltjes transform.
36
6.2 The R-transform
As noted previously, −gµ (z) is sometimes referred to as the Green function. The function Bµ (z) that is
the formal inverse of the Green function, i.e. the function which satisfies
37
7 Eigenvalue statistics for GOE, GUE, CUE
In this section we will focus on matrices from the GOE, the GUE, and the CUE. We start with the
GOE and the GUE and turn to the CUE at the end of the section.
We have seen that GOE and GUE matrices satisfy the semicircle law, so that if we take the
eigenvalues of a GOE or a GUE matrix√(in which the matrix elements have a variance independent of
the matrix size n) and scale them by 1/ n then the support of the spectrum is almost surely [−2, 2] in
the limit n → ∞ with a density in that interval given by the semicircle distribution.
The question we wish to address now is: how are the eigenvalues distributed on the scale of their
mean spacing? This is a much smaller scale than that for which the semicircle law holds. It might be
assumed that if the matrix elements are i.i.d. random variables, then the eigenvalues will also behave
like i.i.d. random variables on this scale; that is, that they behave like a Poisson point process. We
shall see, however, that this is not the case, and that instead the eigenvalues are strongly correlated in
an interesting and significant way. This is an important feature of random matrices.
[λ(b − a)]k
P(N (a, b) = k) = exp[−λ(b − a)]. (7.1)
k!
Moreover, the numbers of points in any finite collection of disjoint intervals are independent of each
other.
The probability density PPoiss (s) that the spacing between two nearest-neighbouring points is s may
be computed as follows. Let us fix a point at one end of an interval of length s. PPoiss (s)ds is then the
probability that the interval is empty, and that there is a point in the next infinitesimal interval of
length ds. This is
PPoiss (s)ds = exp[−λs]λds. (7.2)
Clearly Z ∞
PPoiss (s)ds = 1. (7.3)
0
If now we choose to set the mean spacing to be 1, i.e.
Z ∞
sPPoiss (s)ds = 1, (7.4)
0
this corresponds to setting λ = 1, in which case PPoiss (s) = e−s . Hence the probability to find
nearest-neighbouring random points a distance s apart is maximal at s = 0 and decreases as s increases.
We shall later want to compare this to how the eigenvalues of GOE and GUE matrices are distributed.
38
Theorem 7. The average of f (λ1 , . . . , λn ) over the GUE and GOE can be expressed as the multiple
integral
Z ∞ Z ∞ Y β P 2
E[f (λ1 , λ2 , . . . , λn )] = c(β)
n · · · f (λ1 , . . . , λn ) |λi − λj |β e− 4 i λi dλ1 . . . dλn (7.6)
−∞ −∞ i<j
(1) (2)
where β = 1 for the GOE, β = 2 for the GUE, and cn and cn are normalization constants.
We remark that the normalization constants can be evaluated to be:
n
Y
1
(β)
= (2π)n/2 β −n/2−βn(n−1)/4 [Γ(1 + β/2)]−n Γ(1 + βj/2) (7.7)
cn j=1
although we shall not make explicit use of this fact and do not include the proof here.
In the case of the GUE, the idea behind the proof of Theorem 7 is based on the observation that
any Hermitian matrix M can be diagonalized by a unitary transformation; that is, we can write
M = U DU † , where D is diagonal and U is unitary. The idea is then to change variables from the
matrix elements of M to the matrix elements of U and D. Because the GUE measure is invariant
under unitary transformations, the matrix elements of U can be integrated out trivially, leaving just
the matrix elements of D, which are the eigenvalues λ1 , . . . , λn .
We first note that when the eigenvalues of M are distinct, the decomposition M = U DU † is
unique up to (i) permuting the eigenvalues, and (ii) multiplying U by a diagonal matrix with entries
eiθ1 , eiθ2 , . . . , eiθn , and that this holds almost surely in the GUE (and the GOE). To see this, observe
first that the joint distribution of the entries of M has a smooth density. Since the eigenvalues are
continuous functions of the matrix entries, and because the event of two eigenvalues coinciding has
codimension ≥ 1 in the n-dimensional variety of eigenvalues, it follows that the eigenvalues are almost
surely distinct 22 . So we can ignore this situation.
Let y1 , . . . , yn , w1 , . . . , wn(n−1)
be the local parameters on (Rn /Sn ) × (U (n)/Tn ). Our goal now is
∂Mij ∂Mij 2
to compute the Jacobian det ∂yα , ∂wβ . To this end we write M as an element of Rn , setting
M11 M22 M
φ(M ) = √ , √ , . . . , √nn , ReM12 , ImM12 , ReM13 , ImM13 , . . . , ReMn−1,n , ImMn−1,n . (7.8)
2 2 2
It is easily seen that
1 1
|φ(M )|2 = Tr[M 2 ] = Tr[(U M U † )2 ] = |φ(U M U † )|2 (7.9)
2 2
for any n × n unitary matrix U , because the trace is invariant under unitary conjugation. Consequently,
2 2
the linear transformation τU : Rn → Rn , τU (y) = φ(U † φ−1 (y)U ) is isometric; that is det τU = 1.
Hence
∂Mij ∂Mij ∂Mij ∂Mij
det , = det τU , . (7.10)
∂yα ∂wβ ∂yα ∂wβ
Clearly we can also think of τU as acting on matrices X according to τU (X) = τU (φ(X)). Now,
∂M ∂D † ∂D
τU = τU U U = . (7.11)
∂yi ∂yi ∂yi
22 An alternative proof of this uses the fact that the zero set of any polynomial in k variables has zero Lebesgue measure
in Rk . There are degenerate eigenvalues if and only if the characteristic polynomial of M , det(M − xI), and its derivative
have a common zero. A necessary and sufficient condition for this is that the discriminant i<j (λi − λj )2 vanishes. The
Q
result then follows from the fact that discriminant is itself a polynomial in the entries of M .
39
Note that acting with φ on the right-hand side gives a vector with all n2 coordinates except the ith
equal to zero. We also have that
∂M ∂U ∂U † ∂U ∂U †
τU = τU DU † + U D = U† D+D U. (7.12)
∂wβ ∂wβ ∂wβ ∂wβ ∂wβ
∂U ∂U †
U† + U = 0. (7.13)
∂wβ ∂wβ
Therefore, setting Tβ = U † ∂w
∂U
β
∂M
τU = Tβ D − DTβ . (7.14)
∂wβ
Bearing in mind that D is diagonal,
∂M
τU = (Tβ )ij (yj − yi ). (7.15)
∂wβ ij
∂Mij ∂Mij
Therefore, the matrix τU ∂yα , ∂wβ has the following form
In 0n 0n 0n ...
0n Re(T1 )12 (y2 − y1 ) Im(T1 )12 (y2 − y1 ) Re(T1 )13 (y3 − y1 ) . . .
0n Re(T2 )12 (y2 − y1 ) Im(T2 )12 (y2 − y1 ) Re(T2 )13 (y3 − y1 ) . . . (7.16)
.. .. .. .. ..
. . . . .
40
We turn next to the Circular Unitary Ensemble of random unitary matrices M . In this case too
the matrices in question can be diagonalized by a unitary transformation: M = U DU † , where D is
diagonal with entries eiθ1 , eiθ2 , . . . , eiθn . The ensemble itself is, by construction, invariant under unitary
transformations. A calculation that is essentially the same as for the GUE then gives, for a class
function f (θ1 , . . . , θn ), that
Theorem 8. The average of f (θ1 , . . . , θn ) over the CUE can be expressed as the multiple integral
Z 2π Z 2π Y
1
E[f (θ1 , . . . , θn )] = n
··· f (θ1 , . . . , θn ) |eiθj − eiθk |2 dθ1 . . . dθn . (7.18)
(2π) n! 0 0 j<k
(To see this, note that the determinant is a homogeneous polynomial in the variables λ1Q , λ2 , . . . , λn of
degree n(n − 1)/2. It vanishes if any pair of the variables are set equal, so is divisible by i<j (λj − λi ).
This is also a homogeneous polynomial of degree n(n − 1)/2. Therefore the two polynomials are equal up
to a constant multiplier. That this constant has to be one may be seen by comparing any corresponding
terms on the two sides; for example
Q the product of terms on the diagonal of the matrix corresponds to
multiplying the first terms in i<j (λj − λi ).)
It is a second key observation that by combining rows in the determinant we also have
2
p0 (λ1 ) p0 (λ2 ) ... p0 (λn )
p1 (λ1 ) p1 (λ2 ) ... p1 (λn )
Y
|λi − λj |2 = p2 (λ1 ) p2 (λ2 ) ... p2 (λn ) (7.21)
i<j
.. .. .. ..
. . . .
pn−1 (λ1 ) pn−1 (λ2 ) . . . pn−1 (λn )
23 This
Q
is the formula for real Wishart matrices. For complex Wishart matrices the factor i<j |λi − λj | is squared.
41
where pk is a monic polynomial of degree k. Hence the integrand in Theorem 7 is the function we wish
to average, f (λ1 , λ2 , . . . , λn ), multiplied by
1 2 1 2 1 2 2
p0 (λ1 )e− 4 λ1 p0 (λ2 )e− 4 λ2 ... p0 (λn )e− 4 λn
1 2 1 2 1 2
p1 (λ1 )e− 4 λ1 p1 (λ2 )e− 4 λ2 ... p1 (λn )e− 4 λn
1 2 1 2 1 2
p2 (λ1 )e− 4 λ1 p2 (λ2 )e− 4 λ2 ... p2 (λn )e− 4 λn . (7.22)
.. .. .. ..
. . . .
1 2 1 2 1 2
pn−1 (λ1 )e− 4 λ1 pn−1 (λ2 )e− 4 λ2 ... pn−1 (λn )e− 4 λn
This is true for any monic polynomials pk . There is, however, one choice that considerably simplifies
the calculations we shall want to perform: we henceforth take {pk (x)} to be orthogonal with respect to
2
the measure e−x /2 dx. Specifically, setting
1 2 1 2 1 2 2
p0 (λ1 )e− 4 λ1 p0 (λ2 )e− 4 λ2 ... p0 (λn )e− 4 λn
1 2 1 2 1 2
p1 (λ1 )e− 4 λ1 p1 (λ2 )e− 4 λ2 ... p1 (λn )e− 4 λn
1 2 1 2 1 2
ρ(λ1 , . . . , λn ) = c(2)
n
p2 (λ1 )e− 4 λ1 p2 (λ2 )e− 4 λ2 ... p2 (λn )e− 4 λn (7.23)
.. .. .. ..
. . . .
1 2 1 2 1 2
pn−1 (λ1 )e− 4 λ1 pn−1 (λ2 )e− 4 λ2 ... pn−1 (λn )e− 4 λn
we have !
n−1
Y
ρ(λ1 , . . . , λn ) = c(2)
n κ2i det AAT (7.24)
i=1
2 di −x2 /2
pi (x) = (−1)i ex /2
e . (7.28)
dxi
These are known as the Hermite polynomials and are usually denoted Hi (x)24 . We then also have
Z ∞ Z ∞ √
−x2 /2 2
2
κi = 2
pi (x)e dx = xi pi (x)e−x /2 dx = i! 2π. (7.29)
−∞ −∞
We shall use pk (x) and Hk (x) interchangeably, since they are equal.
2
24 In some references the Hermite polynomials are defined to be orthogonal with respect to the measure e−x /2 dx, and
2
in others with respect to the measure e−x dx. We choose the former convention. The latter convention is more common
in the physics literature.
42
The normalized Hermite polynomials κ−1
k Hk (x) form an orthonormal set of functions with respect
−x2 /2
to the weight e : Z ∞
−x2 /2
κ−1 −1
j Hj (x)κk Hk (x)e dx = δjk . (7.30)
−∞
They form an orthonormal basis of the (complex) Hilbert space of functions satisfying
Z ∞
2
|f (x)|2 e−x /2 dx < ∞ (7.31)
−∞
2
The functions φk (x) := κ−1
k Hk (x)e
−x /4
are called the Hermite functions. They satisfy the
differential equation
d2 Ψ 1 2 1
− + x Ψ = (k + )Ψ (7.33)
dx2 4 2
which is the Schrödinger equation of the simple harmonic oscillator.
We note now that the entries of the matrix AT A appearing in (7.24) can be written
n
X n−1
X
AAT ij
= Aik Ajk = φk (λi )φk (λj ). (7.34)
k=1 k=0
The function
n−1
X n−1
1 X 1 2 2
Kn (x, y) = φk (x)φk (y) = √ pk (x)pk (y)e−(x +y )/4 (7.35)
k=0
2π k=0 k!
is known as the Christoffel-Darboux kernel in the theory of orthogonal polynomials. It is the kernel of
the projection onto the span of φ1 , . . . , φn−1 .
We note for later use the following general properties of the Hermite polynomials.
Lemma 10. The Hermite polynomials satisfy
Proof. (7.36) follows from differentiating (7.28). (7.37) follows from expanding xpk (x) in terms of
the basis formed by all of the Hermite polynomials and using (7.27). (7.38) follows by differentiating
(7.36) and then using (7.37). (7.39) follows from multiplying Kn by x − y and then using (7.37); it is
a special case of a general formula known as the Christoffel-Darboux Theorem, which goes back to
Christoffel in 1858 (for more on this see, for example, [16]).
Note that, applying L’Hôpital’s rule, it follows from (7.39) that
n−1
X p2k (x) p0 (x)pn−1 (x) − p0n−1 (x)pn (x)
= n . (7.40)
k! (n − 1)!
k=0
43
We have from (7.39) that for x 6= y
√ φn (x)φn−1 (y) − φn−1 (x)φn (y)
Kn (x, y) = n (7.41)
x−y
and that √
Kn (x, x) = n φ0n (x)φn−1 (x) − φ0n−1 (x)φn (x) . (7.42)
In terms of the Christoffel-Darboux kernel, we have that the right-hand side of (7.24) can be written
as
const. det (Kn (λi , λj )) . (7.43)
It follows from the orthonormality of the Hermite polynomials that
Z ∞
Kn (x, y)Kn (y, z)dy = Kn (x, z). (7.44)
−∞
Then Z ∞
det(Jn )dxn = (r − n + 1) det(Jn−1 ) (7.47)
−∞
R∞
where r = −∞
k(x, x)dx.
Proof. We note first that expanding the determinant gives
Z ∞ Z ∞ X
det(Jn )dxn = sgn(σ)k(x1 , xσ(1) ) . . . k(xn , xσ(n) )dxn
−∞ −∞ σ∈S
n
Z ∞ Xn X
= sgn(σ)k(x1 , xσ(1) ) . . . k(xn , xm )dxn . (7.48)
−∞ m=1 σ:σ(n)=m
In the term m = n, σ runs over all permutations in Sn−1 and so the integral evaluates to r det(Jn−1 ),
because the sign of σ as a permutation in Sn−1 is the same as it is in Sn .
When m < n, let j = σ −1 (n), and take σ̂ ∈ Sn−1 to be given by
(
σ(i), if i 6= j
σ̂(i) = (7.49)
m, if i = j.
The map {σ ∈ Sn : σ(n) = m} −→ Sn−1 , σ 7→ σ̂, is straightforwardly seen to be a bijection, and
sgn(σ̂) = −sgn(σ), because the two permutations differ by a transposition (mn). Therefore
Z ∞ X
sgn(σ)k(x1 , xσ(1) ) . . . k(xn , xm )dxn
−∞ σ:σ(n)=m
Z ∞ X
= sgn(σ)k(x1 , xσ(1) ) . . . k(xn−1 , xσ(n−1) )k(xj , xn )k(xn , xm )dxn
−∞ σ:σ(n)=m
X
= −sgn(σ̂)k(x1 , xσ̂(1) ) . . . k(xn−1 , xσ̂(n−1) )
σ̂∈Sn−1
44
Finally, using the fact that this last equality holds independently of the value of m, the equation in the
statement of the theorem is established.
We now return to Theorem 7. Note that in the notation introduced above, we have for the GUE
that Z ∞ Z ∞
E[f (λ1 , λ2 , . . . , λn )] = ··· f (λ1 , . . . , λn )ρ(λ1 , . . . , λn )dλ1 . . . dλn (7.51)
−∞ −∞
with
ρ(λ1 , . . . , λn ) = c̃n det (Kn (λi , λj )1≤i,j≤n ) (7.52)
where c̃n denotes the constant.
In many situations we shall see that we will want to average functions f that depend only on k < n
eigenvalues. In this case we need to evaluate the integral of ρ over the remaining n − k variables. This
can be achieved using (Gaudin’s) lemma 11.
Lemma 12. For the GUE we have
Z ∞ Z ∞
(n − k)!
··· ρ(λ1 , . . . , λn )dλk+1 . . . dλn = det (Kn (λi , λj )1≤i,j≤k ) . (7.53)
−∞ −∞ n!
Proof. Applying Gaudin’s lemma, and using the fact that r = n for this kernel, because the Hermite
functions are orthonormal, we have immediately that
Z ∞
ρ(λ1 , . . . , λn )dλn = c̃n det (Kn (λi , λj )1≤i,j≤n−1 ) . (7.54)
−∞
It is worth pointing out that this is a rather remarkable result: it asserts that integrating an n × n
determinant, involving a kernel evaluated at all pairs drawn from n variables, over n − k of those
variables, gives a k × k determinant involving the same kernel. Point processes with this property are
called determinantal point processes.
45
These correlation functions have the following interpretation. For any Borel set B,
Z
R1 (x)dx = E[#{eigenvalues in B}] (7.60)
B
and Z Z
R2 (x, y)dxdy = E[#{ordered pairs of eigenvalues in B}] (7.61)
B B
etc. √
Clearly if we rescale the eigenvalues by 1/ n and normalise the 1-point correlation function by 1/n,
we expect to recover the semicircle law from the 1-point correlation function; that is, we expect
1 √ 1 √ √ 1 p
lim √ R1 ( nx) = lim √ Kn ( nx, nx) = 4 − x2 (7.62)
n→∞ n n→∞ n 2π
for x ∈ [−2, 2], and for the limit to give 0 if |x| > 2. This can be shown to be true using asymptotic
formulae for the Hermite polynomials when n → ∞, leading to yet another proof of the semicircle law
for the GUE.
Specifically, let us define √
1
Ξn+p (x) = n 4 φn+p (x n) (7.63)
for p = −2, −1, 0. It follows from the properties of the Hermite polynomials listed above that
r
1 √ √ 2 n−1
√ Kn ( nx, nx) = Ξn−1 (x) − Ξn−2 (x)Ξn (x). (7.64)
n n
The asymptotic formulae we need25 are as follows. First, setting x = 2 cos φ with 0 < φ < π, when
n→∞
1 1 1 π
Ξn+p (x) ∼ √ cos n φ − sin(2φ) + p + φ− (7.65)
π sin φ 2 2 4
uniformly for φ in a compact subset of (0, π). Second, setting |x| = 2 cosh φ with 0 < φ,
uniformly for φ in a compact subset of (0, ∞)26 . Substituting (7.65) into (7.64) gives the semicircle law
in |x| < 2. Since the semicircle law has a total mass of one in (−2, 2), there can be no limiting mass at
x = 2 or in |x| > 2. When |x| > 2 this also follows by substituting (7.66) into (7.64).
Note that (7.42) gives that
1 √ √ √ √ √
√ R1 ( nx) = φ0n ( nx)φn−1 ( nx) − φ0n−1 ( nx)φn ( nx) (7.67)
n
which gives an exact formula for the expectation of the empirical spectral density of a GUE matrix in
terms of the Hermite functions. We illustrate this by showing in Figure 7 the results of a numerical
experiment. This involved generating 10,000 random matrices from the GUE with n = 10, plotting a
histogram of the eigenvalues, and comparing with the exact formula (7.67). For ease of visualisation,
the eigenvalues have each been divided by 2, so the support of the rescaled semicircle that emerges
when n → ∞ is |x| ≤ 1.
√The semicircle law describes the limiting eigenvalue distribution when the eigenvalues are scaled by
1/ n. There are then n scaled eigenvalues lying between -2 and 2, and so their mean separation is
25 These go under the general name Plancherel-Rotach asymptotic formule and can be established via a WKB analysis
of (7.33).
26 Note that when φ > 0, e2φ + 1 − 2φ > 0.
46
0.6
0.5
0.4
0.3
0.2
0.1
0.0
-1.0 -0.5 0.0 0.5 1.0
Figure 7: The spectral density of 10,000 GUE matrices of dimension 10 compared to (7.67).
of order 1/n. We now want to look at correlations on the scale of the mean eigenvalue spacing. We
therefore need to scale the √ √ so that they have constant mean spacing. There are n eigenvalues
eigenvalues √
lying roughly between −2 n and √ 2 n. They therefore have a mean separation that scales
√ like 1/ n
and so we need to rescale them by n to achieve a constant mean spacing. Setting yi = nλi , we need
to consider the n → ∞ asymptotics of
h √ √ ir h ir
det n−1/2 Kn (yi / n, yj / n) := det K̂n (yi , yj ) (7.68)
i,j=1 i,j=1
where, when yi 6= yj ,
√ √ √ √
φn (yi / n)φn−1 (yj / n) − φn−1 (yi / n)φn (yj / n)
K̂n (yi , yj ) = , (7.69)
yi − yj
and √ √ √ √
K̂n (y, y) = φ0n (y/ n)φn−1 (y/ n) − φ0n−1 (y/ n)φn (y/ n). (7.70)
The important result that we now establish is the following one.
Theorem 13. For any fixed x, y
sin(π(x − y))
lim K̂n (x, y) = . (7.71)
n→∞ π(x − y)
This is an immediate consequence of the following lemma.
Lemma 14. For any fixed x and any fixed l
√
lim n1/4 φn−l (x/ n) − π −1/2 cos (x − (n − l)π/2) = 0. (7.72)
n→∞
47
Proof. Let us set m = n − l. Note that
m Z ∞
m x2 /2 dm −x2 /2 m x2 /2 d 2 dz
(−1) e m
e = (−1) e m
e−ixz−z /2 √
dx dx −∞ 2π
Z
1 x2 /2 ∞ 2
=√ e (iz)m e−ixz−z /2 dz (7.73)
2π −∞
and so Z ∞
√ 2 √
n−z 2 /2
n1/4 φm (x/ n) = (2π)−3/4 (m!)−1/2 ex /4n n1/4 (iz)m e−ixz/ dz. (7.74)
−∞
Using Stirling’s formula to evaluate the prefactor and Laplace’s method27 to evaluate the integral when
n → ∞ proves the lemma. (See, for example, Chapter VIII in [16].)
Substituting the asymptotic estimate in the lemma into the formula for K̂n , and using (7.36) and
(7.37) to evaluate the asymptotics of the derivative of φ, then leads to the formula in the theorem.
The theorem means that in the limit when n → ∞ the k-point correlation function of the scaled
eigenvalues at the centre of the spectrum is simply given by the k × k determinant involving the kernel
sin(π(x − y))
. (7.75)
π(x − y)
This is known as the sine kernel. For example, the pair correlation of the scaled eigenvalues is simply
2
sin(π(x − y))
1− . (7.76)
π(x − y)
So, for example, for f (x, y) such that the sum and integral converge,
X Z ∞ Z ∞ 2 !
√ √ sin(π(x − y))
lim f ( nλi , nλj ) = f (x, y) 1 − dxdy. (7.77)
n→∞
ij −∞ −∞ π(x − y)
Note that the quadratic repulsion manifest in Theorem 7 is clear here in (7.76), which, if we set
x − y = w, vanishes like w2 as w → 0. We also remark that for the Poisson point process, the
corresponding formula is obtained by replacing the two-point correlation function (7.76) by 1, because
the points are, by definition, uncorrelated.
We have shown that at the centre of the spectrum (i.e. at the centre of the semicircle) the limiting
correlations are determined by the sine kernel. In fact, the sine kernel can be shown to describe the
local correlations at any point in (−2, 2) provided one normalizes the mean spacing to be unity using
the semicircle density.
to be summed.
48
√
λi = 2 n + αi n−1/6 and looking at correlations between the values taken by α1 , . . . , αn . This involves
studying the asymptotics of
h √ √ ir
det n−1/6 Kn (2 n + αi n−1/6 , 2 n + αj n−1/6 ) . (7.79)
ij=1
Defining √ √
K̃n (x, y) = n−1/6 Kn (2 n + xn−1/6 , 2 n + yn−1/6 ) (7.80)
we have the following theorem describing the n → ∞ asymptotics.
Theorem 15. For any fixed x, y
where Z ∞
1
Ai(x) = cos(t3 /3 + xt)dt (7.82)
π 0
is the Airy function.
This is an immediate consequence of the following lemma
Lemma 16. For any fixed x
√
lim n1/12 φn (2 n + x/n1/6 ) − Ai(x) = 0. (7.83)
n→∞
We only sketch the proof of this lemma. This starts with (7.74). One again seeks to evaluate the
integral by the method of steepest descent. The difference is that in this case the two saddle points lie
so close together that one cannot treat them separately. Instead of expanding to quadratic order, one
has to expand to cubic order. This leads to the Airy function, rather than the usual Gaussian integral.
The Airy function is plotted in Figure 8.
Substituting the asymptotic estimate in the lemma into the formula for K̃n in terms of φ, and using
(7.36) and (7.37) to evaluate the asymptotics of the derivative of φ, then leads to the formula in the
theorem.
The kernel representing the n → ∞ limit of K̃n is known as the Airy kernel. Far away from the
edge on the inside of the semicircle, it reduces to the sine kernel. Away from the edge on the outside of
the semicircle, it decays exponentially.
49
0.4
0.2
-15 -10 -5 5 10
-0.2
-0.4
We define
n
Y
GI (t) = E (1 − tII (λi )), (7.87)
i=1
so that D0 (I) = GI (1). It is easy to see that −G0I (1) = D1 (I), and that more generally
(−1)m (m)
Dm (I) = GI (1). (7.88)
m!
GI (t) is therefore the generating function for Dm (I).
To calculate GI (t), we expand the product over the eigenvalues to get28
X X
GI (t) = 1 − tE II (λi ) + t2 E II (λi )II (λj ) − . . .
i i≤j
Z Z Z2 Z Z Z
t t3
= 1 − t R1 (x1 )dx1 + R2 (x1 , x2 )dx1 dx2 − R3 (x1 , x2 , x3 )dx1 dx2 dx3 + . . .
I 2 I I 3! I I I
X∞ Z Z
(−t)k
=1+ · · · det (Kn (xi , xj ))1≤i,j≤k dx1 . . . dxk . (7.89)
k! I I
k=1
The last equation can be viewed as defining the Fredholm determinant of the operator with kernel
Kn (x, y) acting on L2 (I):
∞
X Z Z
(−t)k
det (I − tKn (x, y)) := 1 + · · · det (Kn (xi , xj ))1≤i,j≤k dx1 . . . dxk . (7.90)
k! I I
k=1
28 Note the the expansion is valid because the rank of Kn is at most n.
50
In the theory of Fredholm
R determinants29 an operator Rwith kernel K(x, y) acts on a function f
according to (Kf )(x) = K(x, y)f (y)dy. When Tr(K) = K(x, x)dx exists, then K is called trace
class and one can calculate the Fredholm determinant in a number of (equivalent) ways:
∞
!
X tm m
det (I − tKn (x, y)) = exp − TrK (7.91)
m=1
m
Hence
√ one can calculate Pn (s) from the Fredholm determinant. When the eigenvalues are scaled by
n, then when n → ∞ the limiting spacing distribution is the second derivative of the Fredholm
determinant of the sine kernel30 . This distribution is often called the Gaudin-Mehta distribution
We illustrate this by showing in Figure 9 the results of a numerical experiment. This involved
generating 10,000 random matrices from the GUE with n = 10, plotting a histogram of the normalized
distances between neighbouring pairs of eigenvalues, and comparing with the Fredholm determinant of
the sine kernel.
The analysis of Dm (I) extends immediately to the edge of the spectrum, with, in this case, the
kernel in (7.89) and (7.90) being the Airy kernel. Rather than the spacing distribution, the natural
question in this case is: what is the distribution of the largest eigenvalue of a GUE matrix? Let λmax
denote the largest eigenvalue and set
exists. Clearly P(λmax < t) is simply the probability that the interval (t, ∞) contains no eigenvalues,
and so
F (max) (s) = det(I − KAiry ) (7.96)
where
Ai(x)Ai0 (y) − Ai0 (x)Ai(y)
KAiry = (7.97)
(x − y)
acting on L2 ((s, ∞)).
29 We limit ourselves to stating results in the theory of Fredholm determinants without proof, and without setting out
the theory systematically. For an introductory exposition see, forexample, [12].
30 The Fredholm determinant of the sine kernel is equal to exp
R πs σ(x;t)
0 x
dx where σ is the solution of the Painlevé
V equation (xσ 00 )2 + 4(xσ 0 − σ)(xσ 0 − σ + (σ 0 )2 ) = 0 with σ(x; t) ∼ − πt x as x → 0, but showing this is beyond the scope
of the present course.
51
0.75
density
0.50
0.25
0.00
0 1 2 3
spacing
Figure 9: The spacing distribution between neighbouring eigenvalues of 10,000 GUE matrices of
dimension n = 10 compared to the the Fredholm determinant of the sine kernel. (Plot kindly provided
by Johannes Forkel.)
52
0.4
0.3
0.2
0.1
0.0
-5 -4 -3 -2 -1 0 1
√
Figure 10: (λmax − 2 n)n1/6 for 10,000 GUE matrices of size n = 1000.
In this case too F (max) (s) can be expressed in terms of a solution of a second order nonlinear
o.d.e. which is another of the Painlevé equations. Specifically,
Z ∞
(max) 2
F (s) = exp − (x − s)q(x) dx (7.98)
s
where q is a solution of the Painlevé II equation q 00 (x) − xq(x) + 2q(x)3 = 0 with q(x) ∼ Ai(x) as
x → ∞. This is called the Tracy-Widom distribution.
We illustrate this by showing in Figure 10 the results of a numerical experiment, which involved
generating
√ 10,000 random matrices from the GUE with n = 1000, plotting a histogram of (λmax −
2 n)n1/6 , and comparing with the Tracy-Widom distribution.
53
In these determinants j = 1, 2, . . . , n and p = 0, 1, . . . , n − 1, or, equivalently, p = − 12 (n − 1), − 12 (n −
1) + 1, . . . , 12 (n − 1). Hence
Y h i
|eiθj − eiθk |2 = (2π)n det S̃n (θj − θk ) (7.100)
j,k=1,...,n
j<k
with
1
2 (n−1)
X
1 1 sin(nθ/2)
S̃n (θ) = eipθ = . (7.101)
2π 2π sin(θ/2)
p=− 12 (n−1)
We can therefore apply Gaudin’s lemma, but now with integrals over [0, 2π). Trivially,
Z 2π
S̃n (0)dθ = n (7.103)
0
and so Gaudin’s lemma yields, exactly as for the GUE, that the k-point correlation function is
h i
Rk (θ1 , . . . , θk ) = det S̃n (θi − θj ) . (7.104)
i,j=1,...,k
This is again a k × k determinant, but now with a simpler kernel. It is easy to see that
n
R1 (θ) = S̃n (0) = (7.105)
2π
which is the analogue of the semicircle law in this setting – the eigenvalues have a constant average
density around the unit circle – and that
n 2 2
R2 (θ1 , θ2 ) = − S̃n (θ1 − θ2 ) . (7.106)
2π
Now crucially, observe that if we scale the eigenvalues to have unit mean spacing, this corresponds
n
to setting φk = 2π θk . Making this substitution in S̃n and rescaling by 2π/n, we see that
1 sin(π(φj − φk ) sin(π(φj − φk )
lim S̃n (2π(φj − φk )/n) = lim = (7.107)
n→∞ n n→∞ n sin(π(φj − φk )/n) π(φj − φk ))
i.e. the limit gives precisely the sine kernel we found for the GUE. Hence, even though the statistics are
different when n is finite, in the limit when n → ∞ the local statistics of the GUE and CUE are the
same.
We illustrate this by showing in Figure 11 the results of a numerical experiment. This involved
generating 200 random matrices from the CUE with n = 200, plotting a histogram of the distances
between all pairs of eigenvalues, and comparing with the 2 × 2 determinant involving the sine kernel.
The method of orthogonal polynomials works as well for the GOE, but is a little more complicated in
that case. It works for complex Wishart matrices, when the orthogonal polynomials are the generalized
Laguerre polynomials. In the case of real Wishart matrices, as for the GOE, the method also applies,
but it is a little more complicated.
54
1.00
0.75
density
0.50
0.25
0.00
0 1 2 3 4
distances
Figure 11: The two-point correlation function of the eigenvalues of 200 CUE matrices of dimension
200 compared to the 2 × 2 determinant involving the sine kernel. (Plot kindly provided by Johannes
Forkel.)
55
7.8 Universality
Given that the GUE and the CUE exhibit the same local statistics on the scale of the mean eigenvalue
spacing in the limit n → ∞ one might ask whether other random matrix ensembles also fall into the
same class. Does the result depend on having simple measures, for example? Or does it rely on having
nice formulae for the measure in terms of the eigenvalues, expressed via Vandermonde determinants?
The answer is that in the large-matrix limit the results are independent of the measure, provided we
have matrices that are essentially complex and Hermitian (unitary matrices can be thought of as the
exponentials of complex Hermitian matrices). So complex Hermitian Wigner random matrices all have
the same limit, once some mild conditions are satisfied, no matter what the measure one applies to the
matrix elements, and for most measures one doesn’t have nice expressions in terms of the eigenvalues.
Similarly, real-symmetric matrices form a different universality class, characterised by linear repulsion
between the eigenvalues as opposed to quadratic repulsion. The GOE falls into this class, along with
other real-symmetric Wigner matrices, irrespective of the measure.
Proving universality has been a major theme of research in Random Matrix Theory over the past
15 years.
7.9 Applications
The local spectral statistics of random matrices in the bulk of the spectrum have many applications.
For example, they describe fluctuation statistics in complex quantum systems, including quantum
chaotic systems, atomic spectra and nuclear spectra, and in other complex wave problems, such as
lasers, elastic vibrations, and acoustics etc. They also provide the main method for modelling statistical
properties of quantum dynamics in complex systems, such as in conductivity through disordered media.
Remarkably, GUE spectral statistics also appear to describe correlations between the positions of
parked cars in London, and arrival times of buses in the Mexican city of Cuernavaca.
Knowing the distribution of largest and smallest eigenvalues is important in many contexts in
numerical linear algebra in determining bounds on the efficiency and convergence of algorithms. In
Wishart random matrices the ratio of the extremal eigenvalues determines how errors in the input data
get magnified in solving systems of linear equations, as measured by the condition numbers of the
matrices appearing.
For more on these applications, see the respective chapters in The Oxford Handbook of Random
Matrix Theory [1].
56
8 Dyson Brownian motion
We can express the GOE and GUE measures in terms of the eigenvalues, as embodied in Theorem 7, in
the form
−βW (λ1 ,...,λn )
c(β)
n e (8.1)
where
n
1X 2 X
W (λ1 , . . . , λn ) = λ − ln |λi − λj |. (8.2)
4 j=1 j i<j
One can think of this as a Boltzmann weight, with W (λ1 , . . . , λn ) representing the potential energy
associated with particles located at positions λ1 , . . . , λn and with β playing the role of the inverse
temperature. Hence computing expectations with respect to the RMT measures in this case is the same
as determining the equilibrium thermodynamics of particles moving in one dimension with interactions
described by this energy function.
We now explore the dynamics of the eigenvalues if we allow the matrix elements of a real-symmetric
or complex-Hermitian matrix to vary stochastically with time t. Specifically, let us consider the matrix
M to be a function of t satisfying, for t ≥ 0, the matrix-valued stochastic differential equation
1 1
dM (t) = √ dB(t) − M (t)dt (8.3)
n 2
with initial data M0 . Here in the real-symmetric√case, when β = 1, B(t) is an n × n symmetric matrix
such that Bij (t), for 1 ≤ i < j ≤ n, and Bii (t)/ 2, for 1 ≤ i ≤ n, are independent standard Brownian
motions; and
√ in the complex-Hermitian
√ case, when β = 2, B(t) is an√n × n complex Hermitian matrix
such that 2ReBij (t) and 2ImBij (t), for 1 ≤ i < j ≤ n, and Bii (t)/ 2, for 1 ≤ i ≤ n, are independent
standard Brownian motions. This defines what is known as a matrix-valued Ornstein-Uhlenbeck process.
In terms of the matrix elements of M , this differential equation reads
1 1
dMij (t) = √ dBij (t) − Mij (t)dt (8.4)
n 2
where Bij (t) has variance t in the complex-Hermitian case, while in the real-symmetric case Bij (t) has
variance t when i 6= j and variance 2t when i = j.
The question we seek to address is: if the matrix M evolves in time according to (8.3), what is
the equation satisfied by the eigenvalues λ1 (t), λ2 (t), . . . , λn (t)? First, one might wonder about the
labelling of the eigenvalues if they become degenerate or exchange positions. In fact, if we assume
that the eigenvalues at t = 0 are non-degenerate and if we label them in order of increasing size,
λ1 (0) < λ2 < (0) < · · · < λn (0), then as time evolves it can be shown that the eigenvalues remain
simple and are continuous functions of t, and so the labelling makes sense and is preserved for all t > 0.
The equation governing the time evolution of the eigenvalues might be expected to involve the
eigenvalues and eigenvectors vj (t) ∈ Rn . However, remarkably, this turns out not to be the case: the
eigenvalues satisfy an autonomous system of stochastic differential equations that do not involve the
eigenvectors. This system of SDEs is the following one.
√
2 λ i 1 X 1
dλi = √ dB̃i + − + dt (8.5)
βn 2 n λi − λj
j6=i
where B̃i is a set of real-valued independent standard Brownian motions. The solution of this equation
is known as Dyson Brownian motion with parameter β, after Freeman Dyson, who introduced it in a
seminal paper in 1962.
As noted above, it can be proved (see, for example, section 4.3 in [2]) that there exists a unique
(strong) solution of this equation in the space of continuous functions. Moreover, if the initial conditions
57
are such that all of the eigenvalues are simple at t = 0, then this remains true for all t > 0 – i.e. none
of the eigenvalue processes intersect.
Dyson’s theorem can be stated as follows.
Theorem 17. Let M (t) solve (8.3) in a strong sense. Then its eigenvalue process satisfies (8.5).
Proof.. We denote the eigenvalues of an n × n real-symmetric or complex-Hermitian matrix M by
(λm )1≤m≤n and the corresponding eigenvectors by (vm )1≤m≤n , so that
M vm = λm vm . (8.6)
Note that the eigenvectors are orthonormal, i.e.
†
vm vp = δm,p . (8.7)
Differentiating these equations with respect to Mij yields
∂M ∂vm ∂λm ∂vm
vm + M = vm + λm , (8.8)
∂Mij ∂Mij ∂Mij ∂Mij
†
∂vm † ∂vp
vp + vm =0 (8.9)
∂Mij ∂Mij
for p 6= m, and
†
∂vm
vm = 0. (8.10)
∂Mij
Hence
∂λm † ∂M
= vm vm (8.11)
∂Mij ∂Mij
and for p 6= m
∂M ∂vm ∂vm
vp† vm + vp† M = λm vp† , (8.12)
∂Mij ∂Mij ∂Mij
from which we have that
∂M ∂vm ∂vm
vp† vm + λp vp† = λm vp† . (8.13)
∂Mij ∂Mij ∂Mij
Hence
∂vm X ∂vm X 1
∂M
= vp† vp = vp† vm vp . (8.14)
∂Mij ∂Mij λm − λp ∂Mij
p6=m p6=m
In order to keep the notation as simple as possible, we now focus on the real-symmetric case, when
β = 1. The complex-Hermitian calculation follows exactly the same lines. In the real-symmetric case,
(i)
denoting the ith component of vm by vm , (8.11) becomes
∂λm (i) (j)
= vm vm (2 − δij ), (8.15)
∂Mij
and (8.14) becomes
(k)
∂vm X vp(i) vm
(j) (j) (i)
+ vp vm (1 − δij ) (k)
= vp . (8.16)
∂Mij λm − λp
p6=m
Differentiating the first of these equations and then using the second gives
" #
(i) (k)
∂ 2 λm ∂vm (k) (i) ∂vm
= (2 − δik ) v + vm
∂Mlj ∂Mik ∂Mlj m ∂Mlj
X 1 h i
= (2 − δik ) (vp(j) vm(l)
+ vp(l) vm
(j)
(1 − δjl ))(vp(i) vm
(k)
+ vp(k) vm
(i)
) . (8.17)
λm − λp
p6=m
58
We are now in a position to use the assumption that the matrix elements evolve as an Ornstein-
Uhlenbeck process (8.4), which means that in a time interval of length dt their square scales like dt.
We therefore expand dλm to quadratic order in the dMij 31 . We then get32
X ∂λm 1 X X ∂ 2 λm
dλm = dMik + (dMik )(dMlj ). (8.18)
∂Mik 2 ∂Mlj ∂Mik
i≤k i≤k j≤l
Hence, using the fact that vm is the eigenvector of M with eigenvalue λm , and so
X X X
(i) (k) (i)
vm vm Mik = vm (M vm )(i) = λm (i) 2
|vm | = λm , (8.21)
i,k i i
The key point now is that, looking at the first term in (8.22), we can define
X
(i) (k)
B̃m := vm vm Bik . (8.23)
i,k
= 2δmp dt (8.24)
√
We see therefore that B̃m = 2Bm in distributional sense, where (Bm )nm=1 is the standard Brownian
motion in Rn . This completes the proof in the real-symmetric case. A similar calculation along the
same lines gives the corresponding result when β = 2.
59
Figure 12: A simulation of GOE Dyson Brownian motion when n = 10. (Plot kindly provided by
Johannes Forkel.)
a GOE matrix when β = 1 or a GUE matrix when β = 2. Hence for sufficiently large t the GOE/GUE
is the equilibrium solution which the dynamics reaches, no matter what M0 is taken to be. Put another
way, the GOE/GUE measure is invariant under Dyson Brownian motion, and is the attractor for the
dynamics. It was conjectured by Dyson that this equilibrium is actually reached very quickly, on time
scales of the order of 1/n, and this has subsequently been proved. This fact plays a key role in the
proof of the universality of the spectral statistics.
We illustrate this by showing in Figures 12, 13 and 14 the results of a numerical simulation of the
Ornstein-Uhlenbeck process with, respectively, n = 10, n = 20 and n = 50 for GOE matrices. The
invariance of the GOE under this process is illustrated in Figures 15, 16 and 17, where M0 is taken to
be a GOE matrix in each case, again with, respectively, n = 10, n = 20 and n = 50.
60
Figure 13: A simulation of GOE Dyson Brownian motion when n = 20. (Plot kindly provided by
Johannes Forkel.)
Figure 14: A simulation of GOE Dyson Brownian motion when n = 50. (Plot kindly provided by
Johannes Forkel.)
61
Figure 15: A simulation of GOE Dyson Brownian motion when n = 10, starting from a GOE matrix.
(Plot kindly provided by Johannes Forkel.)
Figure 16: A simulation of GOE Dyson Brownian motion when n = 20, starting from a GOE matrix.
(Plot kindly provided by Johannes Forkel.)
62
Figure 17: A simulation of GOE Dyson Brownian motion when n = 50, starting from a GOE matrix.
(Plot kindly provided by Johannes Forkel.)
#{π ∈ Sn : ln (π) ≤ m}
P(ln ≤ m) = . (9.1)
n!
Then it was proved by Baik, Deift and Johansson in 1998 that
√
ln − 2 n
lim P ≤ s = F (max) (s) = det(I − KAiry ) (9.2)
n→∞ n1/6
where
Ai(x)Ai0 (y) − Ai0 (x)Ai(y)
KAiry = (9.3)
(x − y)
63
acting on L2 ((s, ∞)). Or equivalently,
√ Z ∞
ln − 2 n 2
lim P ≤ s = exp − (x − s)q(x) dx (9.4)
n→∞ n1/6 s
where q is a solution of the Painlevé II equation q 00 (x) − xq(x) + 2q(x)3 = 0 with q(x) ∼ Ai(x) as
x → ∞.
That is, ln has the same limiting distribution as the largest eigenvalue of a random GUE matrix.
X∞
1 Y 1
−1
ζ(s) = = 1 − (9.6)
n=1
ns p
ps
where the product runs over all primes p. It has an analytic continuation to the rest of the complex
plane, except for a pole at s = 1. It is important because it encodes information about the distribution
of the primes. The zeta function has trivial zeros at s = −2n for n ∈ N, and infinitely many other
nontrivial zeros. The Riemann Hypothesis asserts that the nontrivial zeros all lie on the line Res = 1/2;
that is, they are all of the form 1/2 + itn with tn ∈ R.
Let us assume that the Riemann Hypothesis is true and so the numbers tn are all real. The theory
of the zeta function then implies that
T T
#{n : 0 < tn ≤ T } = log + O(log T ) (9.7)
2π 2π
Therefore, setting
tn |tn |
wn = log (9.8)
2π 2π
64
Figure 18: A random tiling, generated by P. Ferrari.
65
Z 1
fˆ(ø ) = f (x)e2ºixø dx (2.5)
°1
has support in (°1, 1). Numerical evidence suggests that Montgomery’s conjecture is correct
[58], see Figure 1.
R[x]
1
0.8
0.6
0.4
0.2
x
0.5 1 1.5 2 2.5 3
Figure 1: Two-point correlation function of the scaled Riemann zeros plotted using 106
zeros Figure
around 19: the 1020 thcorrelation
The 2-point
20
zero, computed
function for by A. Odlyzko,
the Riemann and compared
zeros, computed withforRzeros
by A. Odlyzko 2 (x) from
near to the 10 th, compared to the GUE 2-point correlation function (9.11).
(2.4).
which is precisely the GUE/CUE 2-point correlation function. Montgomery conjectured that this
remains true for all functions f for which the sums converge. This has since been extended to all
k-point correlation functions, where the result and conjecture lead to the k × k determinant of the
sine kernel. It is therefore currently the belief that that all local statistics of the zeros coincide with
those of the GUE/CUE, and this is supported by extensive numerical computations – see for example
Figure 19. Assuming this is true, many interesting properties of the zeta function and the primes can
be calculated using random matrix theory. See the chapter on connections between number theory and
random matrix theory in [1]. This remains a highly active area of research.
References
[1] G. Akemann, J. Baik & P. Di Francesco, The Oxford Handbook of Random Matrix Theory (Oxford
University Press).
66
[2] G.W. Anderson, A. Guionnet & O. Zeitouni, An Introduction to Random Matrices (Cambridge
Studies in Advanced Mathematics).
[3] J.P. Bouchaud & M. Potters, Financial Applications of Random Matrix Theory: a short review,
in The Oxford Handbook of Random Matrix Theory, edited by Gernot Akemann, Jinho Baik, &
Philippe Di Francesco (OUP), ;also available from arXiv:0910.1205
[4] Z. Bai & J.W. Silverstein, Spectral Analysis of Large Dimensional Random Matrices (Springer).
[5] A. Choromanska, M. Henaff, M. Mathieu, G. Ben Arous & Y. LeCun, The loss surfaces of multilayer
networks, Artificial intelligence and statistics, 192–204 (2015).
[6] P. Diaconis & P.J. Forrester, Hurwitz and the origins of random matrix theory in mathematics,
Random Matrices: Theory and Applications, 06, 1730001 (2017); arXiv:1512.09229.
[7] A. Edelman & N. Raj Rao, Random matrix theory, Acta Numerica 14, 233–297 (2005).
[8] I.M. Johnstone, High dimensional statistical inference and random matrices, Proceedings of the
International Congress of Mathematicians, Madrid, Spain, 2006; arXiv:math/0611589.
[9] L. Laloux, P. Cizeau, M. Potters & J.P. Bouchaud, Random matrix theory and financial correlations,
available from [Link]
[10] T. Koshy, Catalan Numbers with Applications, Oxford University Press (2008).
[11] R.M. May, Will a large complex system be stable?, Nature 238, 413-414 (1972).
[12] H.P. McKean, Fredholm Determinants, Central European Journal of Mathematics 9, 205–243
(2011).
[13] E.S. Meckes, The Random Matrix Theory of the Classical Compact Groups,
Cambridge Tracts in Mathematics 218 (CUP, 2019); available online from
[Link]
[14] F. Mezzadri, How to generate random matrices from the classical compact groups, Notices of the
American Mathematical Society 54, 592–604 (2007); arXiv: math-ph/0609050.
[15] J. von Neumann & H. H. Goldstine, Numerical inverting of matrices of high order, Bull. Amer.
Math. Soc. 53, 1021–1099 (1947).
[16] G. Szegö, Orthogonal Polynomials, 4th ed. Providence, RI: Amer. Math. Soc., 42–44, (1975).
[17] R.P. Stanley, Catalan numbers, Cambridge University Press (2015).
[18] K.A. Takeuchi, M. Sano, T. Sasamoto, & H. Spohn, H., Growing interfaces uncover universal
fluctuations behind scale invariance, Scientific Reports, 1: 34 (2011); arXiv:1108.2118
[19] E.P. Wigner, On the distribution of the roots of certain symmetric matrices, Annals of Mathematics
67, 325–327 (1958).
[20] J. Wishart, The Generalised Product Moment Distribution in Samples from a Normal Multivariate
Population, Biometrika 20A, 32–52 (1928).
67