Overview

Marcus, Spielman, and Srivastava solved the Kadison—Singer problem by proving a finite-dimensional vector partition theorem through interlacing families and mixed characteristic polynomials (Marcus, Spielman & Srivastava, 2015). The Annals paper does not attack pure states on operator algebras directly. Instead it proves Weaver’s discrepancy formulation and an Anderson paving formulation, both known to imply Kadison—Singer through earlier reductions (Kadison & Singer, 1959; Anderson, 1979; Weaver, 2004; Casazza et al., 2006).

The central innovation is a deterministic selection principle hidden inside a random construction. A random sum of independent rank-one positive semidefinite matrices has many possible characteristic polynomials. After each leaf polynomial is multiplied by its outcome probability, MSS show that the resulting polynomials form an interlacing family; since positive scalar weights do not change roots, one outcome has largest root no larger than the largest root of the expected characteristic polynomial (Marcus, Spielman & Srivastava, 2015a). The expected polynomial is a mixed characteristic polynomial. Real stability proves it is real-rooted, and a multivariate barrier argument bounds its largest root by .

Kadison—Singer and Paving

Let be the Hilbert space of square-summable complex sequences. Let be the algebra of bounded operators on , and let be the diagonal subalgebra with respect to the standard basis. A state on a -algebra is a positive linear functional of norm one, and a pure state is an extreme point of the convex set of states.

The Kadison—Singer problem asks whether every pure state on has a unique extension to a state on (Kadison & Singer, 1959). This is an operator-algebraic uniqueness question, but the successful proof passes through finite-dimensional matrix paving.

For a matrix and a subset , let be the coordinate projection onto . A paving of is a partition

for which every compressed block

has small operator norm. Anderson’s paving formulation says that for every there is an integer , independent of , such that every zero-diagonal self-adjoint matrix admits a partition with

The crucial phrase is independent of . A partition number depending on dimension would not give the infinite-dimensional consequence. Anderson proved a finite paving route to Kadison—Singer, and MSS use a related formulation due to Casazza, Edidin, Kalra, and Paulsen to obtain explicit paving bounds (Anderson, 1979; Casazza et al., 2007).

The geometric content of paving is easier to see after translating it into vectors. A zero diagonal means that no single coordinate already carries the norm of the matrix. Paving asks whether the coordinates can be colored so that each color class destroys most of the off-diagonal interaction. Weaver’s formulation makes this a statement about splitting a decomposition of the identity.

Weaver’s Vector Partition Form

For vectors , write

for the rank-one positive semidefinite matrix

The identity

means that the vectors form a Parseval frame. Equivalently, for every unit vector ,

Thus the vectors distribute one unit of quadratic energy in every direction.

Weaver’s conjecture is a two-color version with a normalization parameter. It asserts the existence of universal constants and such that the following holds. If

and

for every unit vector , then there is a partition such that

for every unit vector and for (Weaver, 2004). In operator form this says

This is a discrepancy statement, but not scalar discrepancy. Each vector contributes a rank-one matrix, and the goal is to split the matrix sum without allowing either color to retain almost all of the mass in any direction. The small norm assumption prevents a single vector from being an unavoidable obstruction.

MSS prove a stronger -part version. If

then for every positive integer there is a partition

such that

This is the vector partition theorem that drives the paper (Marcus, Spielman & Srivastava, 2015b).

The constants in Weaver’s conjecture follow by setting and . Then

Choosing gives , and

Multiplying back by yields the bound . Hence Weaver’s conjecture holds with

Random Vectors and Deterministic Partitions

The partition theorem is deduced from a random-vector statement. Let be independent random vectors in , each with finite support. Assume

and

Then MSS prove

The conclusion is intentionally only positive probability. Matrix Chernoff inequalities give high-probability norm bounds for random sums of positive semidefinite matrices, but the usual statements pay dimension-dependent or logarithmic losses in regimes relevant to Kadison—Singer (Tropp, 2012). MSS instead prove that at least one outcome is excellent, uniformly in dimension.

The reduction from this random-vector theorem to the partition theorem is useful because it exposes the role of the direct sum. Given , define by placing in the th block and zeros in the other blocks:

Let choose one of the vectors

uniformly at random. Then

and therefore

Moreover

The random-vector theorem gives one assignment with

But for a fixed assignment, the sum is block diagonal. If is the set of indices assigned to block , then the th diagonal block is

Dividing by gives

Thus a deterministic partition is extracted from an existence statement about a random block construction.

Characteristic Polynomials as Spectral Certificates

For a Hermitian matrix , write

The largest eigenvalue of is the largest root of . Since each matrix

is positive semidefinite, controlling its operator norm is exactly controlling the largest root of its characteristic polynomial.

The challenge is that the random sum has many possible outcomes. A direct estimate of

would be too crude. MSS instead study the polynomial

This expected characteristic polynomial is not the characteristic polynomial of the expected matrix. In general,

The expectation keeps track of higher-order spectral information.

The decisive selection principle is this: under the MSS hypotheses, one possible outcome has largest eigenvalue no larger than the largest root of the expected characteristic polynomial. This is false for arbitrary families of polynomials. The reason it holds here is that the probability-weighted outcome polynomials form an interlacing family; the weights are needed for the sums, but they do not affect the roots of individual outcomes.

Interlacing Families

Let be real-rooted polynomials of the same degree with positive leading coefficients. They have a common interlacing if there is a real-rooted polynomial whose roots alternate with the roots of each . The elementary consequence is that if

then at least one has largest root at most the largest root of (Marcus, Spielman & Srivastava, 2015a).

The intuition is that common interlacing imposes a one-dimensional order on the roots. When the polynomials are averaged, the largest root of the sum cannot lie strictly below the largest root of every summand. Therefore one summand is at least as good as the average from the perspective of the largest root.

The paper needs this lemma repeatedly. Suppose the possible outcomes are indexed by a Cartesian product

and let

be the characteristic polynomial of the leaf outcome. For a partial assignment define

The family is an interlacing family if, at every node, the child polynomials have a common interlacing. Iterating the one-step lemma gives a leaf such that

where denotes the largest root.

A useful criterion connects common interlacing to real-rootedness: polynomials of the same degree and positive leading coefficient have a common interlacing if and only if every convex combination

is real-rooted (Dedieu, 1992; Fell, 1980; Chudnovsky & Seymour, 2007). Thus the problem becomes proving real-rootedness for many partial averages of characteristic polynomials.

Mixed Characteristic Polynomials

Let be independent finite-support random column vectors in , and set

MSS prove the identity

The right side depends only on the covariance matrices , not on the full distributions of the . It is called the mixed characteristic polynomial and is denoted

The proof rests on a rank-one determinant identity. For any square matrix and random vector ,

When is invertible, the matrix determinant lemma gives

Taking expectation and using

produces exactly the derivative of at . Singular follows by continuity. Applying this identity one random vector at a time yields the mixed characteristic polynomial formula.

This identity is the algebraic bridge of the proof. It says that random rank-one updates of characteristic polynomials can be averaged by applying differential operators to a deterministic determinant.

Real Stability

A polynomial is stable if

whenever every has positive imaginary part. It is real stable if its coefficients are real. In one variable, real stability is exactly real-rootedness.

The determinant

is real stable when the matrices are positive semidefinite Hermitian. This observation belongs to the Borcea—Branden theory of stable polynomials and mixed determinants (Borcea & Brändén, 2008; Borcea & Brändén, 2010). Stability is then preserved by the operators needed in the MSS proof:

  • specializing a variable to a real value,
  • differentiating with respect to a variable,
  • applying operators of the form in the relevant stable setting.

Consequently

is real-rooted for positive semidefinite .

This real-rootedness does two jobs. First, it makes the expected characteristic polynomial a legitimate object whose largest root can be bounded. Second, it proves the interlacing-family property. A partial average of the probability-weighted leaf characteristic polynomials corresponds to choosing probability weights for some of the finite-support vectors while fixing the previous choices. By the mixed characteristic polynomial identity, that partial average is again a mixed characteristic polynomial, up to a positive scalar factor. Hence it is real-rooted. The convex-combination criterion then gives common interlacings at each node.

Barrier Functions

It remains to bound the largest root of the mixed characteristic polynomial. Let be positive semidefinite Hermitian matrices satisfying

MSS prove

The proof uses a multivariate analogue of the logarithmic derivative

for a univariate real-rooted polynomial . This expression measures how close is to the roots; it becomes large near the largest root.

For a real stable polynomial , say that a point is above the roots of if

for every vector . At such a point define the barrier function in direction by

If the other coordinates are frozen, real stability gives a real-rooted univariate polynomial in , and is the sum of reciprocal distances to those roots.

Now set

Because , the point

is above the roots of . Jacobi’s formula for the derivative of the determinant gives

At this becomes

Write

and choose

The mixed characteristic polynomial can be expressed in the homogeneous form

The task is therefore to apply the operators one by one without letting a root cross the final diagonal point.

The barrier lemma says, schematically, that if is above the roots of a real stable polynomial and the th barrier is safely below , then shifting in the th coordinate by keeps the new point above the roots of

and does not increase the other barriers. The proof uses the monotonicity and convexity of barrier functions above the roots, together with stability-preserving properties of differentiation (Marcus, Spielman & Srivastava, 2015b; Marcus & Srivastava, 2017).

Define

and let have its first coordinates equal to and its remaining coordinates equal to . Induction gives:

  • is above the roots of ,
  • every barrier is at most .

After all operators have been applied, the point

is above the roots of . Therefore the largest root of the diagonal polynomial

is at most

This calculation is the quantitative heart of the paper. The trace bound controls the initial barriers. The shift is precisely the margin needed so that each differential operator can be applied without losing control of the remaining directions.

Assembly of the Proof

The random-vector theorem follows by combining the preceding mechanisms.

Let

Then

and

The barrier theorem gives

By the mixed characteristic polynomial identity,

By real stability, all partial averages of the probability-weighted leaf characteristic polynomials are real-rooted, so these weighted leaf polynomials form an interlacing family. The interlacing selection theorem then gives one outcome whose characteristic polynomial has largest root at most the largest root of the expected polynomial. Therefore

Because the random variables have finite support, this outcome has positive probability. The vector partition theorem and Weaver’s follow from the block-assignment reduction described above.

Paving Consequences

The same vector partition theorem gives Anderson paving. MSS prove that every zero-diagonal self-adjoint matrix can be paved with

parts so that

for every block (Marcus, Spielman & Srivastava, 2015b). The reduction passes through projection paving: a zero-diagonal self-adjoint matrix is encoded into projections whose diagonal entries are controlled, and the vector partition theorem bounds the compressed pieces. The relevant finite-dimensional projection-paving formulation is due to Casazza, Edidin, Kalra, and Paulsen (Casazza et al., 2007).

For non-self-adjoint zero-diagonal matrices, one decomposes

with and self-adjoint and zero diagonal. Paving and separately and refining the two partitions gives a paving for , with a corresponding change in the number of parts. Thus the self-adjoint theorem supplies the general complex paving statement.

The operator-algebraic conclusion is inherited from the established equivalences. Kadison and Singer connected their uniqueness problem to paving phenomena, Anderson proved finite paving reductions, and Weaver’s vector discrepancy conjecture was known to imply the needed projection paving statement (Kadison & Singer, 1959; Anderson, 1979; Akemann & Anderson, 1991; Weaver, 2004). The contribution of MSS is the finite-dimensional polynomial method that proves the required vector and paving estimates.

Examples and Interpretation

The theorem is dimension-free because it measures the size of each summand by

not by the ambient dimension. This is the correct parameter for a rank-one positive semidefinite matrix: the trace equals its only nonzero eigenvalue.

A simple diagonal example illustrates the distinction between existence and typicality. Suppose many vectors point in coordinate directions, scaled so that

A uniformly random partition can leave a coordinate overloaded, especially when the multiplicities are uneven. A carefully chosen partition can distribute repeated coordinate vectors almost evenly. MSS does not prove that the random partition usually succeeds; it proves that the space of all assignments contains one good leaf, certified by the roots of an average polynomial.

In contrast, for genuinely isotropic random vectors with no coordinate structure, concentration inequalities often do show that random assignments are good with high probability. Those results are powerful, but their constants and logarithmic factors are not the right tool for Kadison—Singer. The MSS method is closer to a refined probabilistic method: randomness generates a finite family, the expected characteristic polynomial summarizes the family, and interlacing selects a deterministic member.

Scope and Limitations

The argument is specialized to sums of independent rank-one positive semidefinite matrices. The rank-one determinant identity is what makes the expected characteristic polynomial depend only on the covariance matrices . Higher-rank analogues require additional ideas and do not follow formally from the same proof.

The result is also existential in the Annals paper. The interlacing theorem proves that a good leaf exists, but it does not by itself give an efficient algorithm for finding the partition. Later work and related algorithmic questions study how to search such families, but the original Kadison—Singer breakthrough is a dimension-free existence proof.

Finally, the proof should not be interpreted as a general concentration theorem. It gives positive probability of an optimal-scale event under finite support and rank-one hypotheses. That is exactly what the paving and vector partition applications need, but it is different from a high-probability tail bound.

Transferable Mechanisms

  • Interlacing can turn an average spectral certificate into a deterministic choice. This mechanism is explicit in the Ramanujan-graph paper and is reused in the Kadison—Singer paper (Marcus, Spielman & Srivastava, 2015a; Marcus, Spielman & Srivastava, 2015b). It is useful whenever the objects to be selected have characteristic polynomials whose partial averages remain real-rooted.

  • Real stability is a robust invariant for preserving real-rootedness under multivariate operations. The MSS proof relies on Borcea—Branden stability theory, and Wagner’s survey explains the broader combinatorial role of stable polynomials (Borcea & Brändén, 2008; Borcea & Brändén, 2010; Wagner, 2011).

  • Differential operators can encode rank-one random updates of determinants. The identity

shows how distributional averaging becomes algebraic manipulation of a determinant (Marcus, Spielman & Srivastava, 2015b). This idea is a useful template for problems where the random object enters through low-rank updates.

  • Barrier functions provide a multivariate root-location method. Instead of expanding the mixed characteristic polynomial, MSS tracks reciprocal distances to roots while applying stability-preserving differential operators (Marcus, Spielman & Srivastava, 2015b; Marcus & Srivastava, 2017). This is a reusable way to convert local trace bounds into global spectral bounds.

  • Small leverage scores are the correct hypothesis for dimension-free matrix partitioning. The condition says no summand has excessive leverage in the identity decomposition. Related spectral sparsification work of Batson, Spielman, and Srivastava shows the same philosophy in a different form: control individual rank-one contributions, then select a sparse or balanced subcollection with spectral guarantees (Batson, Spielman & Srivastava, 2012).

See Also

  • on Huang’s sensitivity conjecture proof --- Huang’s proof also turns a combinatorial problem into a sharp eigenvalue statement, but it uses Cauchy interlacing for principal submatrices rather than interlacing families of characteristic polynomials.
  • on Sylvester’s determinantal identity and Schweinsian expansion --- The determinant identities there are the classical background for rank-one determinant manipulations and characteristic-polynomial calculations.
  • on improved Nyström bounds --- Nyström approximation is another setting where sums and subspaces of positive semidefinite rank-one data are controlled through spectral norm estimates, although the sampling guarantees are probabilistic rather than interlacing-based.

References

🐻  Akemann, C.A. & Anderson, J. 1991. Lyapunov theorems for operator algebras, American Mathematical Society,p.
🐻  Anderson, J. 1979. Extensions, restrictions, and representations of states on C*-algebras. Transactions of the American Mathematical Society 249(2), 303–329.
🐻  Batson, J., Spielman, D.A. & Srivastava, N. 2012. Twice-Ramanujan sparsifiers. SIAM Journal on Computing 41(6), 1704–1721.
🐻  Borcea, J. & Brändén, P. 2008. Applications of stable polynomials to mixed determinants: Johnson’s conjectures, unimodality, and symmetrized Fischer products. Duke Mathematical Journal 143(2), 205–223.
🐻  Borcea, J. & Brändén, P. 2010. Multivariate Pólya–Schur classification problems in the Weyl algebra. Proceedings of the London Mathematical Society 101(1), 73–104.
🐻  Casazza, P.G., Fickus, M., Tremain, J.C. & Weber, E. 2006. The Kadison–Singer problem in mathematics and engineering: A detailed account. In Operator Theory, Operator Algebras, and Applications, pp. 299–355. Contemporary Mathematics, American Mathematical Society.
🐻  Casazza, P.G., Edidin, D., Kalra, D. & Paulsen, V.I. 2007. Projections and the Kadison–Singer problem. Operators and Matrices 1(3), 391–408.
🐻  Chudnovsky, M. & Seymour, P. 2007. The roots of the independence polynomial of a clawfree graph. Journal of Combinatorial Theory, Series B 97(3), 350–357.
🐻  Dedieu, J.P. 1992. Obreschkoff’s theorem revisited: What convex sets are contained in the set of hyperbolic polynomials? Journal of Pure and Applied Algebra 81(3), 269–278.
🐻  Fell, H.J. 1980. Zeros of convex combinations of polynomials. Pacific Journal of Mathematics 89(1), 43–50.
🐻  Kadison, R.V. & Singer, I.M. 1959. Extensions of pure states. American Journal of Mathematics 81, 383–400.
🐻  Marcus, A.W. & Srivastava, N. 2017. A course on interlacing families. arXiv preprint arXiv:1712.08874.
🐻  Marcus, A.W., Spielman, D.A. & Srivastava, N. 2015a. Interlacing families I: Bipartite Ramanujan graphs of all degrees. Annals of Mathematics 182(1), 307–325.
🐻  Marcus, A.W., Spielman, D.A. & Srivastava, N. 2015b. Interlacing families II: Mixed characteristic polynomials and the Kadison–Singer problem. Annals of Mathematics 182(1), 327–350.
🐻  Tropp, J.A. 2012. User-friendly tail bounds for sums of random matrices. Foundations of Computational Mathematics 12(4), 389–434.
🐻  Wagner, D.G. 2011. Multivariate stable polynomials: Theory and applications. Bulletin of the American Mathematical Society 48(1), 53–84.
🐻  Weaver, N. 2004. The Kadison–Singer problem in discrepancy theory. Discrete Mathematics 278(1–3), 227–239.