📖
Polynomial Learning of Positive ReLU Networks under Gaussian Inputs
Zhijie Zheng

Polynomial Learning of Positive ReLU Networks under Gaussian Inputs

Author / Organization:
Published 2026 Verification Pending

Overview & Synopsis

We study positive, bias-free, one-hidden-layer ReLU networks under standard Gaussian inputs. We obtain algorithms with polynomial sample and real-arithmetic complexity, without separation or conditioning assumptions on the hidden directions. When the conditional label mean is a width-$k$ network with total output weight at most one, the learner achieves squared prediction error $\varepsilon$ with output width at most $k+\min\{k,d\}$ and complexity linear in one plus the residual second moment. For arbitrary labels with bounded second moment, we obtain a positive ReLU network of width $O(k\log(2/\varepsilon))$. Its risk is bounded by the irreducible noise variance plus $Ck^3\log^{9/2}(2k/\varepsilon)$ times the squared distance of the conditional mean to the target class, plus $\varepsilon$. The proofs combine implicit Hermite moments, orthogonal tensor-train compression, and a direction decoder whose probability of returning a direction far from every atom is bounded linearly in the compression and estimation errors. Exact Gaussian localization refines the resulting direction covers. In the agnostic setting, a cone-constrained convex program with a scale-dependent penalty produces a positive network; in the conditional-mean setting, exact sparsification yields the smaller width. We also establish projective direction recovery and confidence amplification with sample complexity proportional to the logarithm of the reciprocal failure probability.

Indexed from repository: arXiv (arxiv.org)
Loading document from verified source...
Keyboard Shortcuts: ← / → for pages • + / - for zoom • 0 to fit width Powered by Mozilla PDF.js v3.11

Document Information

Document Title Polynomial Learning of Positive ReLU Networks under Gaussian Inputs
Author / Organization Zhijie Zheng
Subject & Discipline cs.LG
Publication Year 2026
License / Rights arXiv Open Access / Creative Commons
Resource Verification Listed PDF (Verification Pending)
Original Host Website arXiv (arxiv.org)
File Format application/pdf (Portable Document Format)
Language EN
Catalog ID DOC-275814
Original Source Link Visit Source Page on arxiv.org »