Memory-Query Tradeoffs for Randomized Convex Optimization. (arXiv:2306.12534v1 [cs.DS])
By: <a href="http://arxiv.org/find/cs/1/au:+Chen_X/0/1/0/all/0/1">Xi Chen</a>, <a href="http://arxiv.org/find/cs/1/au:+Peng_B/0/1/0/all/0/1">Binghui Peng</a> Posted: June 23, 2023
We show that any randomized first-order algorithm which minimizes a
$d$-dimensional, $1$-Lipschitz convex function over the unit ball must either
use $Omega(d^{2-delta})$ bits of memory or make $Omega(d^{1+delta/6-o(1)})$
queries, for any constant $deltain (0,1)$ and when the precision $epsilon$
is quasipolynomially small in $d$. Our result implies that cutting plane
methods, which use $tilde{O}(d^2)$ bits of memory and $tilde{O}(d)$ queries,
are Pareto-optimal among randomized first-order algorithms, and quadratic
memory is required to achieve optimal query complexity for convex optimization.
Provided by:
http://arxiv.org/icons/sfx.gif