Available in electronic format
Available in print format
Journal of the American Mathematical Society
Journal of the American Mathematical Society
ISSN: 1088-6834(e) ISSN: 0894-0347(p)
     

Counting faces of randomly projected polytopes when the projection radically lowers dimension

Author(s): David L. Donoho; Jared Tanner
Journal: J. Amer. Math. Soc. 22 (2009), 1-53.
MSC (2000): Primary 52A22, 52B05, 52B11, 52B12, 62E20, 68P30, 68P25, 68W20, 68W40, 94B20, 94B35, 94B65, 94B70
Posted: July 10, 2008
Retrieve article in: PDF

Abstract | References | Similar articles | Additional information

Abstract: Let $ Q = Q_N$ denote either the $ N$-dimensional cross-polytope $ C^N$ or the $ N-1$-dimensional simplex $ T^{N-1}$. Let $ A = A_{n,N}$ denote a random orthogonal projector $ A: \mathbf{R}^{N} \mapsto bR^n$. We compare the number of faces $ f_k(AQ)$ of the projected polytope $ AQ$ to the number of faces of $ f_k(Q)$ of the original polytope $ Q$. We concentrate on the case where $ n$ and $ N$ are both large, but $ n$ is much smaller than $ N$; in this case the projection dramatically lowers dimension.

We consider sequences of triples $ (k,n,N)$ where $ N = N_n$ is not exponentially larger than $ n$. We identify thresholds of the form $ const \cdot n \log(n/N)$ where the relationship of $ f_k(AQ)$ and $ f_k(Q)$ changes abruptly.

These properties of polytopes have significant implications for neighborliness of convex hulls of Gaussian point clouds, for efficient sparse solution of underdetermined linear systems, for efficient decoding of random error correcting codes and for determining the allowable rate of undersampling in the theory of compressed sensing.

The thresholds are characterized precisely using tools from polytope theory, convex integral geometry, and large deviations. Asymptotics developed for these thresholds yield the following, for fixed $ \epsilon > 0$.

With probability tending to 1 as $ n$, $ N$ tend to infinity:

(1a) for $ k < (1-\epsilon) \cdot n [2e\ln (N/n)]^{-1}$ we have $ f_k(AQ) = f_k(Q)$,

(1b) for $ k > (1 +\epsilon) \cdot n [2e\ln (N/n)]^{-1}$ we have $ f_k(AQ) < f_k(Q)$,

with $ {\mathcal E}$ denoting expectation,

(2a) for $ k < (1-\epsilon) \cdot n [2\ln (N/n)]^{-1}$ we have $ {\mathcal E} f_k(AQ) > (1-\epsilon) f_k(Q)$,

(2b) for $ k > (1 +\epsilon) \cdot n [2\ln (N/n)]^{-1}$ we have $ {\mathcal E} f_k(AQ) < \epsilon f_k(Q)$.

These asymptotically sharp transitions in the behavior of face numbers as $ k$ varies relative to $ n \log(N/n)$ are proven, interpreted, and related to the above-mentioned applications.


References:

1.
Fernando Affentranger and Rolf Schneider, Random projections of regular simplices, Discrete Comput. Geom. 7 (1992), no. 3, 219-226. MR 1149653 (92k:52008)

2.
Norman Bleistein and Richard A Handelsman, Asymptotic expansions of integrals, Dover, New York, 1986. MR 863284 (89d:41049)

3.
Károly Böröczky, Jr. and Martin Henk, Random projections of regular polytopes, Arch. Math. (Basel) 73 (1999), no. 6, 465-473. MR 1725183 (2001b:52004)

4.
Emmanuel J. Candès, Justin Romberg, and Terence Tao, Robust uncertainty principles: Exact signal reconstruction from highly incomplete frequency information, IEEE Trans. Inform. Theory 52 (2006), no. 2, 489-509. MR 2236170 (2007e:94020)

5.
Emmanuel J. Candès and Terence Tao, Decoding via linear programming, IEEE Trans. Inform. Theory 51 (2005), no. 12, 4203- 4215. MR 2243152 (2007b:94313)

6.
-, Near optimal signal recovery from random projections and universal encoding strategies, IEEE. Trans. Info. Thry. 52 (2006), 5406 -5425. MR 2300700

7.
E. W. Cheney, Introduction to approximation theory, Chelsea, New York, 1982. MR 1656150 (99f:41001)

8.
David L. Donoho, Compressed sensing, IEEE. Trans. Info. Thry. 52 (2006), no. 4, 1289-1306. MR 2241189 (2007e:94013)

9.
-, For most large systems of underdetermined equations, the minimum $ \ell^1$-norm solution is the sparsest solution, Comm. Pure Appl. Math. 59 (2006), no. 7, 907-934. MR 2222440 (2006m:65079)

10.
-, High-dimensional centrally-symmetric polytopes with neighborliness proportional to dimension, Disc. Comput. Geometry 35 (2006), no. 4, 617-652. MR 2225676 (2007h:52012)

11.
-, Neighborly polytopes and sparse solutions of underdetermined linear equations, Technical report Stanford University, Department of Statistics, $ \char93 $ 2005-04 (2005).

12.
David L. Donoho and Jared Tanner, Neighborliness of randomly-projected simplices in high dimensions, Proc. Natl. Acad. Sci. USA 102 (2005), no. 27, 9452-9457. MR 2168716

13.
-, Sparse nonnegative solutions of underdetermined linear equations by linear programming, Proc. Natl. Acad. Sci. USA 102 (2005), no. 27, 9446-9451. MR 2168715 (2006d:90089)

14.
-, Finite dimensional phase transition for the expected number of randonly-projected simplices and cross-polytopes, preprint (2007).

15.
M. F. Duarte, M.B. Wakin, and R.G. Baraniuk, Fast reconstruction of piecewise smooth signals from random projections, Proceedings SPARS 05, Rennes, France, 2005.

16.
E.R. Berlekamp, R.J. McEliece, and H.C.A. van Tilborg, On the inherent intractability of certain coding problems, IEEE Trans. Info. Thry. 24 (1978), 384 -386. MR 0495180 (58:13912)

17.
David Gale, Neighboring vertices on a convex polyhedron, Linear inequalities and related system, Annals of Mathematics Studies, no. 38, Princeton University Press, Princeton, N.J., 1956, pp. 255-263. MR 0085552

18.
-, Neighborly and cyclic polytopes, Proc. Sympos. Pure Math., Vol. VII, Amer. Math. Soc., Providence, R.I., 1963, pp. 225-232. MR 0152944 (27:2915)

19.
Branko Grünbaum, Convex polytopes, second ed., Graduate Texts in Mathematics, vol. 221, Springer-Verlag, New York, 2003, prepared and with a preface by Volker Kaibel, Victor Klee and Günter M. Ziegler. MR 1976856

20.
P. Hall, J.S. Marron, and A. Neeman, Geometric representation of high dimensional low sample size data, J. Roy. Stat. Soc. B 67 (2005), 427-444. MR 2155347

21.
Jarvis Haupt and Robert A. Nowak, Signal reconstruction from noisy randomized projections with applications to wireless sensing, Tech. report, Electrical Engineering, University of Wisconsin, 2005.

22.
J. Hoffman-Jorgensen, J.A. Wellner, and M.B. Marcus, High-dimensional probability III, Birkhauser, Boston, 2004. MR 2033877 (2004j:60005)

23.
Irene Hueter, Limit theorems for the convex hull of random points in higher dimensions, Trans. Amer. Math. Soc. 351 (1999), no. 11, 4337-4363. MR 1670156 (2000a:52008)

24.
M. Kendall, A. Stuart, and J.K. Ord, Kendall's advanced theory of statistics, Edward Arnold, London, 1991.

25.
Nathan Linial and Isabella Novik, How neighborly can a centrally symmetric polytope be?, Disc. Comput. Geometry 36 (2006), no. 2, 273 - 281. MR 2252105 (2007f:52027)

26.
Jiri Matousek, Lectures on discrete geometry, Graduate Texts in Mathematics, vol. 212, Springer-Verlag, New York, 2002. MR 1899299 (2003f:52011)

27.
Peter McMullen and Geoffrey C. Shephard, Diagrams for centrally symmetric polytopes, Mathematika 15 (1968), 123-138. MR 0238180 (38:6456)

28.
Harold Ruben, On the geometrical moments of skew-regular simplices in hyperspherical space, with some applications in geometry and mathematical statistics, Acta Math. 103 (1960), 1-23. MR 0121713 (22:12447)

29.
M. Rudelson and R. Vershynin, Geometric approach to error-correcting codes and reconstruction of signals, Tech. report, Department of Mathematics, University of California, Davis, 2005. MR 2206919 (2006j:94116)

30.
-, Sparse reconstruction by convex relaxation: Fourier and gaussian measurements, Proceedings Conference on Information Science and Systems (CISS) 2006, Princeton University, 2006.

31.
Rolf Schneider, Neighbourliness of centrally symmetric polytopes in high dimensions, Mathematika 22 (1975), no. 2, 176-181. MR 0405244 (53:9038)

32.
J.A. Tropp and Anna Gilbert, Signal recovery from partial information by orthogonal matching pursuit, Tech. report, Mathematics Department, University of Michigan, 2005.

33.
Y. Tsaig and D.L. Donoho, Extensions of compressed sensing, EURASIP Journal of Applied Signal Processing 86 (2006), no. 3, 549-571.

34.
A. M. Vershik and P. V. Sporyshev, Asymptotic behavior of the number of faces of random polyhedra and the neighborliness problem, Selecta Math. Soviet. 11 (1992), no. 2, 181-201. MR 1166627 (93d:60017)


Similar Articles:

Retrieve articles in Journal of the American Mathematical Society with MSC (2000): 52A22, 52B05, 52B11, 52B12, 62E20, 68P30, 68P25, 68W20, 68W40, 94B20, 94B35, 94B65, 94B70

Retrieve articles in all Journals with MSC (2000): 52A22, 52B05, 52B11, 52B12, 62E20, 68P30, 68P25, 68W20, 68W40, 94B20, 94B35, 94B65, 94B70


Additional Information:

David L. Donoho
Affiliation: Department of Statistics, Stanford University, 390 Serra Mall, Sequoia Hall, Stanford, California 94305
Email: donoho@stanford.edu

Jared Tanner
Affiliation: Department of Statistics, Stanford University 390 Serra Mall, Sequoia Hall, Stanford, California 94305
Email: tanner@math.utah.edu

DOI: 10.1090/S0894-0347-08-00600-0
PII: S 0894-0347(08)00600-0
Received by editor(s): July 5, 2006
Posted: July 10, 2008
Additional Notes: The first author acknowledges partial support from NSF DMS 05-05303, 01-40698 (FRG), and NIH
The second author acknowledges support from NSF fellowship DMS 04-03041 and thanks John E. and Marva M. Warnock for their generous support in the form of an endowed chair.
Copyright of article: Copyright 2008, American Mathematical Society
The copyright for this article reverts to public domain after 28 years from publication.


  AMS Website Logo Small Comments: webmaster@ams.org
© Copyright 2009, American Mathematical Society
Privacy Statement
Search the AMSPowered by Google