You are on page 1of 4

On Lower Bounds for Algebraic Decision Trees over the Complex Numbers

Peter Scheiblechner
Department of Mathematics
Purdue University
West Lafayette, IN 47907-2067, USA,
Email: pscheibl@math.purdue.edu

Abstract—We prove a new lower bound for the decision looks like a big improvement, it yields better lower bounds
complexity of a complex algebraic set in terms of the sum only for quite large Betti numbers. Note that we need bc (X)
of its (compactly supported) Betti numbers, which is for the 1+ε
to be at least of order 2n log n for some ε > 0 to have
first time better than logarithmic. 1

We apply this result to subspace arrangements including bc (X) n substantially larger than log bc (X). So for instance,
some well studied problems such as the knapsack and element our result yields a worse lower bound than Yao’s for the
distinctness problems. element distinctness or k-equal problem. An examples on
Keywords-lower bounds; algebraic decision trees; which our lower bound performs better is the knapsack
problem. However, the generic path argument mentioned
I. I NTRODUCTION above yields the same result. We are currently looking for
examples of higher codimension, where this argument is no
It came as a surprise in the 1980’s that there exist linear longer applicable.
decision trees of polynomial depth for subspace arrange-
ments in Rn , some of whose restrictions to binary inputs II. P RELIMINARIES
are NP-complete. A famous example of such a problem is An algebraic decision tree of degree d over C is a rooted
the knapsack problem, which is an arrangement of 2n hy- binary tree, whose inner nodes (branching nodes) are labeled
perplanes. In particular, Meyer auf der Heide [1] proved that with polynomials in C[X1 , . . . , Xn ] of degree at most d,
one can solve the knapsack problem by linear decision trees and whose leaves are labeled with either ”yes” or ”no”. The
of polynomial depth. This result is generalized by Clarkson tree encodes a program that on input (x1 , . . . , xn ) ∈ Cn
and Meiser [2], [3] to arbitrary subspace arrangements. More parses the tree from the root to some leaf by testing at
precisely, their results imply that one can decide membership each branching node labeled with f , whether f (x) = 0, and
to an arrangement of m subspaces of Rn by a linear decision continuing to the left or right according to the outcome of the
tree of depth polynomial in n log m (see also [4, §3.4]). test. The program answers the label of the leaf it reaches.
We study the corresponding problem over the complex In this way, an algebraic decision tree over C decides a
numbers. More generally, we consider the problem of testing constructible set in Cn , i.e., a set which is definable by a
membership of a point to an algebraic set in Cn in the Boolean combination of polynomial equations.
computational model of algebraic decision trees of degree d. For lower complexity bounds one needs invariants which
It is easy to see by a generic path argument that the results are subadditive. It was Yao’s idea to use the compactly
of Meyer auf der Heide etc. are impossible over C [5], supported Betti numbers (or equivalently, Borel-Moore Betti
[6]. We provide a second proof for this fact by proving numbers). These may be defined for locally closed semial-
a general lower bound for the decision tree complexity gebraic sets via the cohomology with compact supports. A
of a complex algebraic set X in terms of its (compactly semialgebraic set in Rn is a set which can be defined by
supported) Betti numbers. There is a tradition of lower a Boolean combination of polynomial inequalities f ≥ 0.
bounds for the decision complexity in terms of topolog- A locally closed set in Rn is the intersection of an open
ical invariants [7], [8], [9], [10], [11], [12], see also the with a closed set. We recall the definition of the cohomol-
survey [13]. All known lower bounds are logarithmic. For ogy with compact support [13]. Let A ⊆ X be locally
instance, Yao’s result [11] bounds the complexity of X closed semialgebraic sets in Rn . Denote with Hck (X, A)
by Ω(log bc (X)), where bc (X) denotes the sum of the the cohomology group with compact support of the pair
(compactly supported) Betti numbers of X. Our bound is (X, A), which is defined as the direct limit of the singular
the first non-logarithmic one. In particular, we prove that cohomology groups H k (X, X \K) over all compact subsets
the decision tree complexity of an algebraic set X in Cn K ⊆ X with A ⊆ X \ K, directed by inclusion. The k-th
Ω( 1 )
is bounded below by (bc (X)/ deg(X)) n , where deg(X) Betti number with compact supports bc,k (X) is defined as
k k
denotes the cumulative degree of X, i.e., the sum of the P of Hc (X) := Hc (X, ∅). We write bc (X) for the
the rank
degrees of all irreducible components of X. Although this sum k∈N bc,k (X).
The important subadditivity property of these Betti num- Remark 3.4: If X is a subspace arrangement, i.e., a union
bers reads as follows. Let A ⊆ X be a pair of locally of m affine linear subspaces, then deg(X) = m, hence
closed sets, where A is closed in X. Then excision implies   1
Hck (X, A) = Hck (U ), where U := X \ A. It follows that the 1 bc (X) 3n+2
Cd (X) ≥ .
long exact sequence of the pair (X, A) takes the form 4d m

· · · → Hck (U ) → Hck (X) → Hck (A) → Hck+1 (U ) → · · · , Proof: The proof of this theorem begins as the proof
of Yao’s lower bound. The case X = Cn is clear by (3),
where U := X \ A. It follows so assume X 6= Cn . Let T be a degreee d decision tree of
depth k deciding X. For a leaf ν denote by Dν its leaf set
bc,k (X) ≤ bc,k (U ) + bc,k (A) for closed A ⊆ X. (1)
consisting of those x ∈ Cn which follow the path of T to
It is clear that for compact X the numbers bc,k (X) coin- the leaf ν. We clearly have the decomposition
cide with the k-th Betti numbers bk (X) with respect to the G
X= Dν , where Υ = {yes-leaves of T }. (4)
usual singular cohomology. In general, one can compute the
ν∈Υ
compactly supported Betti numbers of X via the Alexandrov
compactification Ẋ = X ∪ {∞} as follows: Furthermore, each leaf set can be written as

b0 (Ẋ) − 1 if k = 0, Dν = {f1 = 0, . . . , fr = 0, g1 6= 0, . . . , gs 6= 0}, (5)
bc,k (X) = (2)
bk (Ẋ) if k > 0.
where deg fi , deg gi ≤ d. Since X is an algebraic set of
As an example we note that the Alexandrov compactification dimension at most n − 1, we have s ≤ k − 1. Using the
of Rn is the n-sphere S n , hence subadditivity, we prove

0 if k 6= n,
X
n
bc,k (R ) = (3) bc (X) ≤ bc (Dν ). (6)
1 if k = n. ν∈Υ

III. T HE G ENERAL L OWER B OUND For a node u of T let Xu be the set of inputs x ∈ X passing
Our result is based on the fundamental Oleinik- through u. Since Xu is defined by the sign-conditions on
Petrovski/Milnor/Thom-Bound. The following is a version the path leading to u, it is a locally closed set. Also, if u
for the compactly supported Betti-numbers which is proved is labeled by the polynomial f and has descendants u0 and
in [13, Corollary 4.5]. u1 , then Xu is the disjoint union of Xu0 = Xu ∩ {f = 0}
Theorem 3.1: Let X = {f1 = 0, . . . , fr = 0} ⊆ Rn be and Xu1 ∩ {f 6= 0}, so Xu0 is closed in Xu . Hence (1)
an algebraic set defined by the real polynomials fi of degree implies bc (Xu ) ≤ bc (Xu0 ) + bc (Xu1 ). By induction on the
at most d. Then bc (X) ≤ d(2d − 1)n . depth of T , our claim (6) follows.
We need it for locally closed sets over the complex Now (4) and Corollary 3.2 imply
numbers. bc (X) ≤
X
bc (Dν ) ≤ |Υ|kd(2kd)2n+2 . (7)
Corollary 3.2: Let X be the locally closed subset of Cn ν∈Υ
defined by f1 = 0, . . . , fr = 0, g1 6= 0, . . . , gs 6= 0, where
s ≥ 1 and fi , gj ∈ C[X1 , . . . , Xn ] have degree at most d. Yao now bounds |Υ| by the number of all leaves, which
Then bc (X) ≤ (sd + 1)(2sd + 1)2n+2 . is in our case at most 2k . The new idea is to improve this
to a polynomial bound in k.
Q
Proof: The set X = {f1 = 0, . . . , fr = 0, i gi 6= 0}
is homeomorphic to the closed set First note that each irreducible component Z of X must
Y be contained in a unique Dν(Z)S . We set I1 := {ν(Z) | Z
{f1 = 0, . . . , fr = 0, Y gi = 1} ⊆ Cn+1 , component of X} and X1 := ν∈Υ\I1 Dν . Then X1 is
i an algebraic subset of X of dimension < m := dim X,
whose sum of Betti numbers is bounded by (sd + 1)(2(sd + and each component Z of X1 is contained in a unique
1) − 1)2(n+1) according to Theorem 3.1. Dν(Z) . SWe set I2 := I1 t {ν(Z) | Z component of X1 } and
To state the main result of this section, we introduce the X2 := ν∈Υ\I2 Dν . Continuing this way we get sequences
following notation. For a constructible set X ⊆ Cn the of subvarieties X = X0 ⊇ X1 ⊇ · · · ⊇ Xm ⊇ Xm+1 = ∅
degree d decision complexity Cd (X) is the minimal depth and subsets ∅ = I0 ⊆ I1 ⊆ · · · ⊆ Im ⊆ Im+1 = Υ with
of a degree d algebraic decision tree deciding X. [
Xi = Dν for 0 ≤ i ≤ m + 1.
Theorem 3.3: Let X ⊆ Cn be an algebraic set. Then
ν∈Υ\Ii
  1
1 bc (X) 3n+2 By construction we have |Ii | ≤
P
Cd (X) ≥ . j<i deg(Xj ), since the
4d deg(X) number of irreducible components of an algebraic set is
bounded by its degree. Hence see [14, §8.3]. Furthermore, we have
m
X Lemma 4.1: For any closed subset X ⊆ Rn we have
|Υ| ≤ deg(Xi ), (8)
bc (X) = b(Rn \ X) − 1.
i=0

and we are left with the task to bound deg(Xi ). Proof: Using (2) and Alexander duality in S n = Rn ∪
Now we prove {∞} we conclude
deg(Xi ) ≤ deg(X)(kd)i for 0 ≤ i ≤ m + 1, (9) bc (X) = b(Ẋ) − 1 = b(S n \ Ẋ) − 1,
which is trivial for i = 0. Assume it is proved for some but S n \ Ẋ = Rn \ X.
i ≥ 0. We write (5) in the form Dν = Vν ∩ Uν , where Vν is
the closed set defined by the equations, and Uν the open set A. Element Distinctness
defined by the inequalities. According to the construction of Consider the element-distinctness problem
Xi+1 , for each irreducible component Z of Xi there is a [
unique ν(Z) such that Z ∩ Dν(Z) is dense in Z. It follows Distn = {xi = xj }.
Z ⊆ Vν(Z) , hence Z ∩ Dν(Z) = Z ∩ Uν(Z) . Denote by GZ i<j

the product of the polynomials gj from (5) for ν(Z). Note It is shown in [4, Corollary (11.10)] that b0 (Rn \ Distn )) ≥
that deg GZ ≤ kd. Then we have n!, hence Lemma 4.1 and Theorem 3.3 only imply
1
(1−ε)
Z \ Dν(Z) = Z ∩ Z(GZ ), Cd (Distn ) ≥ Ω((n/e) 3 ) for all ε > 0, whereas Yao’s
result shows the better bound Cd (Distn ) ≥ Ω(n log n).
in particular, this set is closed. Hence
[ [ B. Knapsack
Xi+1 = Dν = Xi \ Dν For the knapsack problem
ν∈Υ\Ii+1 ν∈Ii+1 \Ii ( )
[ [
(Z \ Dν(Z) ) = (Z ∩ Z(GZ )),
[ X
= KNn = xi = 1 ,
Z Z I⊆[n] i∈I
where the union runs over all irreducible components Z
Lemma 4.1 together with [4, Lemma (11.14)] shows
of Xi . We conclude with Bézout’s Theorem n
X X bc (KNn ) ≥ 2 · 2( 2 ) − 1. Hence Theorem 3.3 yields
deg(Xi+1 ) ≤ deg(Z ∩ Z(gZ )) ≤ deg(Z) deg(gZ ) Cd (KNn ) ≥ 2Ω(n) , now better than Yao’s quadratic bound.
Z Z However, the aforementioned generic path argument implies
≤ deg(Xi )kd, Cd (X) ≥ m d for a hyperplane arrangement X with m
hyperplanes, which also yields the single exponential lower
which completes the proof of (9).
bound for the knapsack problem.
From (8) and (9) we conclude
m
X C. Higher Codimension
|Υ| ≤ deg(X) (kd)i ≤ 2 deg(X)(kd)m The generic path argument does not apply to arrangements
i=0
of higher codimension. To get such a subspace arrangement
≤ 2 deg(X)(kd)n−1 , with sufficiently large Betti numbers, one can take
since k ≥ 2 and m ≤ n − 1. Plugging this into (7) and 
X


solving for k yields our Theorem.
[ X
KN2n = xi = y j = 1 ⊆ Cn × Cn ,
 
IV. A PPLICATIONS I⊆[n],J⊆[n] i∈I j∈J

In order to bound the Betti numbers of subspace arrange- which has codimension 2. Using the Künneth-Theorem one
ments, we collect some well known facts. A nice exposition can show bc (X×Y ) = bc (X)bc (Y ) [15], hence Theorem 3.3
about this topic is [14]. We write b(X) for theSsum of the implies Cd (KN2n ) ≥ 2Ω(2n) . However, this lower bound may
singular Betti numbers of a space X. Let X = i Ai ⊆ Rn also be derivable by reducing to the knapsack problem. An
be a real subspace arrangement. Its complexification is interesting problem for our bound arises, if we require the
n
S
defined to be X C := i AC i , where ACi ⊆ C is defined two subsets I and J to be the same:
by the same equations as Ai . It is a remarkable fact that [ X
(
X
)
the cohomology of the complement of an arrangement X X= xi = y i = 1 ⊆ C n × Cn ,
is a combinatorial invariant, i.e., it depends only on the I⊆[n] i∈I i∈I
intersection semilattice of X. A consequence is that
Unfortunately, at present we do not know a bound for the
b(Rn \ X) = b(Cn \ X C ), Betti numbers of this arrangement.
ACKNOWLEDGMENT [13] P. Bürgisser, “Lower bounds and real algebraic geometry,”
in Algorithmic and Quantitative Aspects of Real Algebraic
This paper has also been presented at the conference Geometry in Mathematics and Computer Science, 2001, pp.
”Logical Approaches to Barriers in Computing and Com- 35–54.
plexity” in February 2010 in Greifswald, Germany. This
work was partially supported by DFG grant SCHE 1639/1- [14] A. Björner, “Subspace arrangements,” in Proc. of 1st Euro-
pean Congress of Mathematics. Paris, 1992: Birkhäuser,
1. The author would like to thank the anonymous referees 1992, pp. 321–370.
of this and an earlier version for valuable comments.
[15] A. Dold, Lectures on Algebraic Topology, ser. Grundlehren
R EFERENCES der Mathematischen Wissenschaften. Berlin: Springer-
Verlag, 1980, vol. 200.
[1] F. Meyer auf der Heide, “A polynomial linear search algo-
rithm for the n-dimensional knapsack problem,” J. ACM,
vol. 31, no. 3, pp. 668–676, 1984.

[2] K. L. Clarkson, “New applications of random sampling in


computational geometry,” Discrete Comput. Geom., vol. 2,
pp. 195–222, 1987.

[3] S. Meiser, “Point location in arrangements of hyperplanes,”


Inf. Comput., vol. 106, no. 2, pp. 286–303, 1993.

[4] P. Bürgisser, M. Clausen, and M. Shokrollahi, Algebraic


complexity theory, ser. Grundlehren der Mathematischen Wis-
senschaften. Berlin: Springer-Verlag, 1997, vol. 315.

[5] L. Blum, F. Cucker, M. Shub, and S. Smale, Complexity and


Real Computation. Springer, 1998.

[6] P. Koiran, “Computing over the reals with addition and order,”
in Selected papers of the workshop on Continuous algorithms
and complexity. New York, NY, USA: Elsevier Science Inc.,
1994, pp. 35–47.

[7] M. Ben-Or, “Lower bounds for algebraic computation trees,”


in STOC ’83: Proceedings of the fifteenth annual ACM
symposium on Theory of computing. New York, NY, USA:
ACM, 1983, pp. 80–86.

[8] A. Björner, L. Lovász, and A. Yao, “Linear decision trees:


volume estimates and topological bounds,” in STOC ’92:
Proceedings of the twenty-fourth annual ACM symposium on
Theory of computing. New York, NY, USA: ACM, 1992,
pp. 170–177.

[9] A. Yao, “Algebraic decision trees and Euler characteristics,”


in FOCS ’92: Proceedings of the 33rd Annual Symposium on
Foundations of Computer Science. Washington, DC, USA:
IEEE Computer Society, 1992, pp. 268–277.

[10] M. Ben-Or, “Algebraic computation trees in characteristic


p > 0,” in FOCS ’94: Proceedings of the 35th Annual Sym-
posium on Foundations of Computer Science. Washington,
DC, USA: IEEE Computer Society, 1994, pp. 534–539.

[11] A. Yao, “Decision tree complexity and Betti numbers,” in


STOC ’94: Proceedings of the twenty-sixth annual ACM
symposium on Theory of computing. New York, NY, USA:
ACM, 1994, pp. 615–624.

[12] T. Lickteig and M. Roy, “Semi-algebraic complexity of


quotients and sign determination of remainders,” J. Compl.,
vol. 12, no. 4, pp. 545–571, 1996.

You might also like