Overview
Marcus, Spielman, and Srivastava solved the Kadison—Singer problem by proving a finite-dimensional vector partition theorem through interlacing families and mixed characteristic polynomials (Marcus, Spielman & Srivastava, 2015). The Annals paper does not attack pure states on operator algebras directly. Instead it proves Weaver’s discrepancy formulation and an Anderson paving formulation, both known to imply Kadison—Singer through earlier reductions (Kadison & Singer, 1959; Anderson, 1979; Weaver, 2004; Casazza et al., 2006).
The central innovation is a deterministic selection principle hidden inside a random construction. A random sum of independent rank-one positive semidefinite matrices has many possible characteristic polynomials. After each leaf polynomial is multiplied by its outcome probability, MSS show that the resulting polynomials form an interlacing family; since positive scalar weights do not change roots, one outcome has largest root no larger than the largest root of the expected characteristic polynomial (Marcus, Spielman & Srivastava, 2015a). The expected polynomial is a mixed characteristic polynomial. Real stability proves it is real-rooted, and a multivariate barrier argument bounds its largest root by .
Kadison—Singer and Paving
Let be the Hilbert space of square-summable complex sequences. Let be the algebra of bounded operators on , and let be the diagonal subalgebra with respect to the standard basis. A state on a -algebra is a positive linear functional of norm one, and a pure state is an extreme point of the convex set of states.
The Kadison—Singer problem asks whether every pure state on has a unique extension to a state on (Kadison & Singer, 1959). This is an operator-algebraic uniqueness question, but the successful proof passes through finite-dimensional matrix paving.
For a matrix and a subset , let be the coordinate projection onto . A paving of is a partition
for which every compressed block
has small operator norm. Anderson’s paving formulation says that for every there is an integer , independent of , such that every zero-diagonal self-adjoint matrix admits a partition with
The crucial phrase is independent of . A partition number depending on dimension would not give the infinite-dimensional consequence. Anderson proved a finite paving route to Kadison—Singer, and MSS use a related formulation due to Casazza, Edidin, Kalra, and Paulsen to obtain explicit paving bounds (Anderson, 1979; Casazza et al., 2007).
The geometric content of paving is easier to see after translating it into vectors. A zero diagonal means that no single coordinate already carries the norm of the matrix. Paving asks whether the coordinates can be colored so that each color class destroys most of the off-diagonal interaction. Weaver’s formulation makes this a statement about splitting a decomposition of the identity.
Weaver’s Vector Partition Form
For vectors , write
for the rank-one positive semidefinite matrix
The identity
means that the vectors form a Parseval frame. Equivalently, for every unit vector ,
Thus the vectors distribute one unit of quadratic energy in every direction.
Weaver’s conjecture is a two-color version with a normalization parameter. It asserts the existence of universal constants and such that the following holds. If
and
for every unit vector , then there is a partition such that
for every unit vector and for (Weaver, 2004). In operator form this says
This is a discrepancy statement, but not scalar discrepancy. Each vector contributes a rank-one matrix, and the goal is to split the matrix sum without allowing either color to retain almost all of the mass in any direction. The small norm assumption prevents a single vector from being an unavoidable obstruction.
MSS prove a stronger -part version. If
then for every positive integer there is a partition
such that
This is the vector partition theorem that drives the paper (Marcus, Spielman & Srivastava, 2015b).
The constants in Weaver’s conjecture follow by setting and . Then
Choosing gives , and
Multiplying back by yields the bound . Hence Weaver’s conjecture holds with
Random Vectors and Deterministic Partitions
The partition theorem is deduced from a random-vector statement. Let be independent random vectors in , each with finite support. Assume
and
Then MSS prove
The conclusion is intentionally only positive probability. Matrix Chernoff inequalities give high-probability norm bounds for random sums of positive semidefinite matrices, but the usual statements pay dimension-dependent or logarithmic losses in regimes relevant to Kadison—Singer (Tropp, 2012). MSS instead prove that at least one outcome is excellent, uniformly in dimension.
The reduction from this random-vector theorem to the partition theorem is useful because it exposes the role of the direct sum. Given , define by placing in the th block and zeros in the other blocks:
Let choose one of the vectors
uniformly at random. Then
and therefore
Moreover
The random-vector theorem gives one assignment with
But for a fixed assignment, the sum is block diagonal. If is the set of indices assigned to block , then the th diagonal block is
Dividing by gives
Thus a deterministic partition is extracted from an existence statement about a random block construction.
Characteristic Polynomials as Spectral Certificates
For a Hermitian matrix , write
The largest eigenvalue of is the largest root of . Since each matrix
is positive semidefinite, controlling its operator norm is exactly controlling the largest root of its characteristic polynomial.
The challenge is that the random sum has many possible outcomes. A direct estimate of
would be too crude. MSS instead study the polynomial
This expected characteristic polynomial is not the characteristic polynomial of the expected matrix. In general,
The expectation keeps track of higher-order spectral information.
The decisive selection principle is this: under the MSS hypotheses, one possible outcome has largest eigenvalue no larger than the largest root of the expected characteristic polynomial. This is false for arbitrary families of polynomials. The reason it holds here is that the probability-weighted outcome polynomials form an interlacing family; the weights are needed for the sums, but they do not affect the roots of individual outcomes.
Interlacing Families
Let be real-rooted polynomials of the same degree with positive leading coefficients. They have a common interlacing if there is a real-rooted polynomial whose roots alternate with the roots of each . The elementary consequence is that if
then at least one has largest root at most the largest root of (Marcus, Spielman & Srivastava, 2015a).
The intuition is that common interlacing imposes a one-dimensional order on the roots. When the polynomials are averaged, the largest root of the sum cannot lie strictly below the largest root of every summand. Therefore one summand is at least as good as the average from the perspective of the largest root.
The paper needs this lemma repeatedly. Suppose the possible outcomes are indexed by a Cartesian product
and let
be the characteristic polynomial of the leaf outcome. For a partial assignment define
The family is an interlacing family if, at every node, the child polynomials have a common interlacing. Iterating the one-step lemma gives a leaf such that
where denotes the largest root.
A useful criterion connects common interlacing to real-rootedness: polynomials of the same degree and positive leading coefficient have a common interlacing if and only if every convex combination
is real-rooted (Dedieu, 1992; Fell, 1980; Chudnovsky & Seymour, 2007). Thus the problem becomes proving real-rootedness for many partial averages of characteristic polynomials.
Mixed Characteristic Polynomials
Let be independent finite-support random column vectors in , and set
MSS prove the identity
The right side depends only on the covariance matrices , not on the full distributions of the . It is called the mixed characteristic polynomial and is denoted
The proof rests on a rank-one determinant identity. For any square matrix and random vector ,
When is invertible, the matrix determinant lemma gives
Taking expectation and using
produces exactly the derivative of at . Singular follows by continuity. Applying this identity one random vector at a time yields the mixed characteristic polynomial formula.
This identity is the algebraic bridge of the proof. It says that random rank-one updates of characteristic polynomials can be averaged by applying differential operators to a deterministic determinant.
Real Stability
A polynomial is stable if
whenever every has positive imaginary part. It is real stable if its coefficients are real. In one variable, real stability is exactly real-rootedness.
The determinant
is real stable when the matrices are positive semidefinite Hermitian. This observation belongs to the Borcea—Branden theory of stable polynomials and mixed determinants (Borcea & Brändén, 2008; Borcea & Brändén, 2010). Stability is then preserved by the operators needed in the MSS proof:
- specializing a variable to a real value,
- differentiating with respect to a variable,
- applying operators of the form in the relevant stable setting.
Consequently
is real-rooted for positive semidefinite .
This real-rootedness does two jobs. First, it makes the expected characteristic polynomial a legitimate object whose largest root can be bounded. Second, it proves the interlacing-family property. A partial average of the probability-weighted leaf characteristic polynomials corresponds to choosing probability weights for some of the finite-support vectors while fixing the previous choices. By the mixed characteristic polynomial identity, that partial average is again a mixed characteristic polynomial, up to a positive scalar factor. Hence it is real-rooted. The convex-combination criterion then gives common interlacings at each node.
Barrier Functions
It remains to bound the largest root of the mixed characteristic polynomial. Let be positive semidefinite Hermitian matrices satisfying
MSS prove
The proof uses a multivariate analogue of the logarithmic derivative
for a univariate real-rooted polynomial . This expression measures how close is to the roots; it becomes large near the largest root.
For a real stable polynomial , say that a point is above the roots of if
for every vector . At such a point define the barrier function in direction by
If the other coordinates are frozen, real stability gives a real-rooted univariate polynomial in , and is the sum of reciprocal distances to those roots.
Now set
Because , the point
is above the roots of . Jacobi’s formula for the derivative of the determinant gives
At this becomes
Write
and choose
The mixed characteristic polynomial can be expressed in the homogeneous form
The task is therefore to apply the operators one by one without letting a root cross the final diagonal point.
The barrier lemma says, schematically, that if is above the roots of a real stable polynomial and the th barrier is safely below , then shifting in the th coordinate by keeps the new point above the roots of
and does not increase the other barriers. The proof uses the monotonicity and convexity of barrier functions above the roots, together with stability-preserving properties of differentiation (Marcus, Spielman & Srivastava, 2015b; Marcus & Srivastava, 2017).
Define
and let have its first coordinates equal to and its remaining coordinates equal to . Induction gives:
- is above the roots of ,
- every barrier is at most .
After all operators have been applied, the point
is above the roots of . Therefore the largest root of the diagonal polynomial
is at most
This calculation is the quantitative heart of the paper. The trace bound controls the initial barriers. The shift is precisely the margin needed so that each differential operator can be applied without losing control of the remaining directions.
Assembly of the Proof
The random-vector theorem follows by combining the preceding mechanisms.
Let
Then
and
The barrier theorem gives
By the mixed characteristic polynomial identity,
By real stability, all partial averages of the probability-weighted leaf characteristic polynomials are real-rooted, so these weighted leaf polynomials form an interlacing family. The interlacing selection theorem then gives one outcome whose characteristic polynomial has largest root at most the largest root of the expected polynomial. Therefore
Because the random variables have finite support, this outcome has positive probability. The vector partition theorem and Weaver’s follow from the block-assignment reduction described above.
Paving Consequences
The same vector partition theorem gives Anderson paving. MSS prove that every zero-diagonal self-adjoint matrix can be paved with
parts so that
for every block (Marcus, Spielman & Srivastava, 2015b). The reduction passes through projection paving: a zero-diagonal self-adjoint matrix is encoded into projections whose diagonal entries are controlled, and the vector partition theorem bounds the compressed pieces. The relevant finite-dimensional projection-paving formulation is due to Casazza, Edidin, Kalra, and Paulsen (Casazza et al., 2007).
For non-self-adjoint zero-diagonal matrices, one decomposes
with and self-adjoint and zero diagonal. Paving and separately and refining the two partitions gives a paving for , with a corresponding change in the number of parts. Thus the self-adjoint theorem supplies the general complex paving statement.
The operator-algebraic conclusion is inherited from the established equivalences. Kadison and Singer connected their uniqueness problem to paving phenomena, Anderson proved finite paving reductions, and Weaver’s vector discrepancy conjecture was known to imply the needed projection paving statement (Kadison & Singer, 1959; Anderson, 1979; Akemann & Anderson, 1991; Weaver, 2004). The contribution of MSS is the finite-dimensional polynomial method that proves the required vector and paving estimates.
Examples and Interpretation
The theorem is dimension-free because it measures the size of each summand by
not by the ambient dimension. This is the correct parameter for a rank-one positive semidefinite matrix: the trace equals its only nonzero eigenvalue.
A simple diagonal example illustrates the distinction between existence and typicality. Suppose many vectors point in coordinate directions, scaled so that
A uniformly random partition can leave a coordinate overloaded, especially when the multiplicities are uneven. A carefully chosen partition can distribute repeated coordinate vectors almost evenly. MSS does not prove that the random partition usually succeeds; it proves that the space of all assignments contains one good leaf, certified by the roots of an average polynomial.
In contrast, for genuinely isotropic random vectors with no coordinate structure, concentration inequalities often do show that random assignments are good with high probability. Those results are powerful, but their constants and logarithmic factors are not the right tool for Kadison—Singer. The MSS method is closer to a refined probabilistic method: randomness generates a finite family, the expected characteristic polynomial summarizes the family, and interlacing selects a deterministic member.
Scope and Limitations
The argument is specialized to sums of independent rank-one positive semidefinite matrices. The rank-one determinant identity is what makes the expected characteristic polynomial depend only on the covariance matrices . Higher-rank analogues require additional ideas and do not follow formally from the same proof.
The result is also existential in the Annals paper. The interlacing theorem proves that a good leaf exists, but it does not by itself give an efficient algorithm for finding the partition. Later work and related algorithmic questions study how to search such families, but the original Kadison—Singer breakthrough is a dimension-free existence proof.
Finally, the proof should not be interpreted as a general concentration theorem. It gives positive probability of an optimal-scale event under finite support and rank-one hypotheses. That is exactly what the paving and vector partition applications need, but it is different from a high-probability tail bound.
Transferable Mechanisms
-
Interlacing can turn an average spectral certificate into a deterministic choice. This mechanism is explicit in the Ramanujan-graph paper and is reused in the Kadison—Singer paper (Marcus, Spielman & Srivastava, 2015a; Marcus, Spielman & Srivastava, 2015b). It is useful whenever the objects to be selected have characteristic polynomials whose partial averages remain real-rooted.
-
Real stability is a robust invariant for preserving real-rootedness under multivariate operations. The MSS proof relies on Borcea—Branden stability theory, and Wagner’s survey explains the broader combinatorial role of stable polynomials (Borcea & Brändén, 2008; Borcea & Brändén, 2010; Wagner, 2011).
-
Differential operators can encode rank-one random updates of determinants. The identity
shows how distributional averaging becomes algebraic manipulation of a determinant (Marcus, Spielman & Srivastava, 2015b). This idea is a useful template for problems where the random object enters through low-rank updates.
-
Barrier functions provide a multivariate root-location method. Instead of expanding the mixed characteristic polynomial, MSS tracks reciprocal distances to roots while applying stability-preserving differential operators (Marcus, Spielman & Srivastava, 2015b; Marcus & Srivastava, 2017). This is a reusable way to convert local trace bounds into global spectral bounds.
-
Small leverage scores are the correct hypothesis for dimension-free matrix partitioning. The condition says no summand has excessive leverage in the identity decomposition. Related spectral sparsification work of Batson, Spielman, and Srivastava shows the same philosophy in a different form: control individual rank-one contributions, then select a sparse or balanced subcollection with spectral guarantees (Batson, Spielman & Srivastava, 2012).
See Also
- on Huang’s sensitivity conjecture proof --- Huang’s proof also turns a combinatorial problem into a sharp eigenvalue statement, but it uses Cauchy interlacing for principal submatrices rather than interlacing families of characteristic polynomials.
- on Sylvester’s determinantal identity and Schweinsian expansion --- The determinant identities there are the classical background for rank-one determinant manipulations and characteristic-polynomial calculations.
- on improved Nyström bounds --- Nyström approximation is another setting where sums and subspaces of positive semidefinite rank-one data are controlled through spectral norm estimates, although the sampling guarantees are probabilistic rather than interlacing-based.