--- 格式版本: 2 标题: "Depth Enables Local Entropy: Quadratic Depth Dependence in Deep Variation-Norm ReLU Regression" 原文链接: "https://arxiv.org/abs/2608.17434" 发布日期: "2026-08-19" 发布时间校准状态: "found" 发布时间需复核: "否" 发布时间来源: "llm:local:strict_original_body" 发布时间证据: "Published Time: Wed, 19 Aug 2026 00:34:38 GMT" 发布时间校准原因: "正文中明确标注发布时间为2026-08-19，优先级高于submitted日期。" 发布时间校准置信度: "1" 发布时间候选数量: 12 发布时间严格候选数量: 3 发布时间原页读取状态: "source template page reused from URL open" 发布时间未找到原因: "" 发布时间校准时间: "2026-08-19T21:18:57+08:00" 发布时间仲裁状态: "confirmed" 发布时间仲裁尝试次数: 3 发布时间仲裁耗时毫秒: 23774 发现时间: "2026-08-19T21:16:38+08:00" 入库时间: "2026-08-19T13:19:21.033Z" 来源平台: "arXiv 学术论文搜索" 搜索渠道: "source_template" 搜索词: "https://arxiv.org/search/?query=Scale-up&searchtype=all" 匹配关键词: - "Scale-up" - "AI" 相关厂家: - "Google" 相关专家: [] 内容类型: "网页" 抓取工具: "Jina Reader" 清洗工具: "Jina Reader Markdown + Defuddle/Readability 正文提取" 原始附件: [] AI优质: "否" AI打分: 11 AI分档: "非优质" AI质检状态: "不通过" AI打分理由: "该资料为arXiv深度学习理论论文，研究ReLU回归深度依赖与极小极大风险，完全未涉及超节点、AI Rack、GPU、液冷、供电、互连、量产等任何项目主题，属于明显无关内容。" AI质检模型: "ali-deepseek-v4-flash" AI质检时间: "2026-08-19T21:19:32+08:00" AI主题相关性: 0 AI来源权威性: 6 AI新颖性: 0 AI技术细节: 0 AI商业部署信号: 0 AI完整性: 5 AI摘要: "Tao Jiang等人研究深度ReLU变差范数回归，针对Parhi-Nowak deep-RBV²架构构造局部填充集，证明深度对极小化风险的依赖是二次的，下界与上界均约为深度平方乘宽度平方的量级。" AI摘要模型: "ali-deepseek-v4-flash" AI摘要时间: "2026-09-07T03:19:56.135Z" 采集批次: "2026年8月19日19点33分50秒" 采集批次ID: "20260819-193350-682" 去重键: "https://arxiv.org/abs/2608.17434" --- Title: Depth Enables Local Entropy: Quadratic Depth Dependence in Deep Variation-Norm ReLU Regression URL Source: https://arxiv.org/abs/2608.17434 Published Time: Wed, 19 Aug 2026 00:34:38 GMT Markdown Content: [Skip to main content](https://arxiv.org/abs/2608.17434#content)[](https://arxiv.org/IgnoreMe)[![Image 1: archive](https://arxiv.org/static/base/1.0.1/images/arxiv-logo-primary-light.svg)](https://arxiv.org/)[Search](https://arxiv.org/search)[Submit](https://arxiv.org/user/create)[Donate](https://info.arxiv.org/about/donate.html)[Log in](https://arxiv.org/login) Search arXiv Press Enter to search · [Advanced search](https://arxiv.org/search/advanced) # Computer Science > Artificial Intelligence **arXiv:2608.17434** (cs) [Submitted on 18 Aug 2026] # Title:Depth Enables Local Entropy: Quadratic Depth Dependence in Deep Variation-Norm ReLU Regression Authors:[Tao Jiang](https://arxiv.org/search/cs?searchtype=author&query=Jiang,+T), [Minbo Gao](https://arxiv.org/search/cs?searchtype=author&query=Gao,+M), [Shaowei Cai](https://arxiv.org/search/cs?searchtype=author&query=Cai,+S) View a PDF of the paper titled Depth Enables Local Entropy: Quadratic Depth Dependence in Deep Variation-Norm ReLU Regression, by Tao Jiang and 2 other authors [View PDF](https://arxiv.org/pdf/2608.17434)[HTML (experimental)](https://arxiv.org/html/2608.17434v1) > Abstract:We study Gaussian regression over the explicit vector-valued Parhi--Nowak deep-RBV^2 architecture with depth L, width w, layer-sum variation budget A, and output bound B. For this O(L w^2)-parameterized architecture, the known lower and upper bounds differ by one factor of depth. We construct a local packing showing that the quadratic depth dependence is intrinsic under an explicit sample-size-dependent radius condition. The packing has log-cardinality Omega(L^2 w^2 log w); its codewords lie in an O(lambda) L^2 ball and are pairwise Omega(lambda)-separated. The main ingredients are a bias-corrected bounded-coefficient approximation theorem and balanced amplification: multiplying a depth-D ReLU network by q can be implemented using one constant channel so that every coefficient grows by only q^(1/D). Translation to vector-valued RBV^2 blocks then has layer-sum cost O(D w^2 q^(1/D)). Gaussian Fano yields a radius-explicit lower bound governed by the output, testing, and representation scales. Under A=B=R, sigma proportional to R, and the stated radius condition, this gives minimax risk at least of order L^2 w^2 log(w) R^2/n. A pseudodimension-based finite-net upper bound gives O-tilde(L^2 w^2 R^2/n) for unbounded Gaussian responses. Thus the minimax risk has quadratic polynomial dependence on depth, up to logarithmic factors, and exhibits a transition to representation-limited behavior at smaller radius. Subjects:Artificial Intelligence (cs.AI) Cite as:[arXiv:2608.17434](https://arxiv.org/abs/2608.17434) [cs.AI] (or [arXiv:2608.17434v1](https://arxiv.org/abs/2608.17434v1) [cs.AI] for this version) [https://doi.org/10.48550/arXiv.2608.17434](https://doi.org/10.48550/arXiv.2608.17434) Focus to learn more arXiv-issued DOI via DataCite (pending registration) ## Submission history From: Tao Jiang [[view email](https://arxiv.org/show-email/18eca858/2608.17434)] **[v1]** Tue, 18 Aug 2026 07:03:14 UTC (32 KB) [](https://arxiv.org/abs/2608.17434)Full-text links: ## Access Paper: View a PDF of the paper titled Depth Enables Local Entropy: Quadratic Depth Dependence in Deep Variation-Norm ReLU Regression, by Tao Jiang and 2 other authors * [View PDF](https://arxiv.org/pdf/2608.17434) * [HTML (experimental)](https://arxiv.org/html/2608.17434v1) * [TeX Source](https://arxiv.org/src/2608.17434) [![Image 2: license icon](https://arxiv.org/icons/licenses/by-nc-nd-4.0.png)view license](http://creativecommons.org/licenses/by-nc-nd/4.0/ "Rights to this article") ### Current browse context: cs.AI [](https://arxiv.org/prevnext?id=2608.17434&function=next&context=cs.AI "next in cs.AI (accesskey n)") [new](https://arxiv.org/list/cs.AI/new) | [recent](https://arxiv.org/list/cs.AI/recent) | [2026-08](https://arxiv.org/list/cs.AI/2026-08) Change to browse by: [cs](https://arxiv.org/abs/2608.17434?context=cs) ### References & Citations * [NASA ADS](https://ui.adsabs.harvard.edu/abs/arXiv:2608.17434) * [Google Scholar](https://scholar.google.com/scholar_lookup?arxiv_id=2608.17434) * [Semantic Scholar](https://api.semanticscholar.org/arXiv:2608.17434) export BibTeX citation Loading... ## BibTeX formatted citation × Data provided by: [](https://arxiv.org/abs/2608.17434) ### Bookmark [![Image 3: BibSonomy](https://arxiv.org/static/browse/0.3.4/images/icons/social/bibsonomy.png)](http://www.bibsonomy.org/BibtexHandler?requTask=upload&url=https://arxiv.org/abs/2608.17434&description=Depth%20Enables%20Local%20Entropy:%20Quadratic%20Depth%20Dependence%20in%20Deep%20Variation-Norm%20ReLU%20Regression "Bookmark on BibSonomy")[![Image 4: Reddit](https://arxiv.org/static/browse/0.3.4/images/icons/social/reddit.png)](https://reddit.com/submit?url=https://arxiv.org/abs/2608.17434&title=Depth%20Enables%20Local%20Entropy:%20Quadratic%20Depth%20Dependence%20in%20Deep%20Variation-Norm%20ReLU%20Regression "Bookmark on Reddit") Bibliographic Tools # Bibliographic and Citation Tools - [x] Bibliographic Explorer Toggle Bibliographic Explorer _([What is the Explorer?](https://info.arxiv.org/labs/showcase.html#arxiv-bibliographic-explorer))_ - [x] Connected Papers Toggle Connected Papers _([What is Connected Papers?](https://www.connectedpapers.com/about))_ - [x] Litmaps Toggle Litmaps _([What is Litmaps?](https://www.litmaps.co/))_ - [x] scite.ai Toggle scite Smart Citations _([What are Smart Citations?](https://www.scite.ai/))_ Code, Data, Media # Code, Data and Media Associated with this Article - [x] alphaXiv Toggle alphaXiv _([What is alphaXiv?](https://alphaxiv.org/))_ - [x] Links to Code Toggle CatalyzeX Code Finder for Papers _([What is CatalyzeX?](https://www.catalyzex.com/))_ - [x] DagsHub Toggle DagsHub _([What is DagsHub?](https://dagshub.com/))_ - [x] GotitPub Toggle Gotit.pub _([What is GotitPub?](http://gotit.pub/faq))_ - [x] Huggingface Toggle Hugging Face _([What is Huggingface?](https://huggingface.co/huggingface))_ - [x] ScienceCast Toggle ScienceCast _([What is ScienceCast?](https://sciencecast.org/welcome))_ Demos # Demos - [x] Replicate Toggle Replicate _([What is Replicate?](https://replicate.com/docs/arxiv/about))_ - [x] Spaces Toggle Hugging Face Spaces _([What is Spaces?](https://huggingface.co/docs/hub/spaces))_ - [x] Spaces Toggle TXYZ.AI _([What is TXYZ.AI?](https://txyz.ai/))_ Related Papers # Recommenders and Search Tools - [x] Link to Influence Flower Influence Flower _([What are Influence Flowers?](https://influencemap.cmlab.dev/))_ - [x] Core recommender toggle CORE Recommender _([What is CORE?](https://core.ac.uk/services/recommender))_ * [Author](https://arxiv.org/abs/2608.17434) * [Venue](https://arxiv.org/abs/2608.17434) * [Institution](https://arxiv.org/abs/2608.17434) * [Topic](https://arxiv.org/abs/2608.17434) About arXivLabs # arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? [**Learn more about arXivLabs**](https://info.arxiv.org/labs/index.html). [Which authors of this paper are endorsers?](https://arxiv.org/auth/show-endorsers/2608.17434) | [Disable MathJax](javascript:setMathjaxCookie()) ([What is MathJax?](https://info.arxiv.org/help/mathjax.html)) We gratefully acknowledge support from our **major funders**, [**member institutions**](https://info.arxiv.org/about/ourmembers.html), , and all contributors. [About](https://info.arxiv.org/about)·[Help](https://info.arxiv.org/help)·[Contact](https://info.arxiv.org/help/contact.html)·[Subscribe](https://info.arxiv.org/help/subscribe)·[Copyright](https://info.arxiv.org/help/license/index.html)·[Privacy](https://info.arxiv.org/help/policies/privacy_policy.html)·[Accessibility](https://info.arxiv.org/help/web_accessibility.html)·[Operational Status (opens in new tab)](https://status.arxiv.org/) Major funding support from [![Image 5: Simons Foundation](https://arxiv.org/static/base/1.0.1/images/funders/simons-foundation.png)](https://www.simonsfoundation.org/)[![Image 6: Simons Foundation International](https://arxiv.org/static/base/1.0.1/images/funders/simons-foundation-international.png)](https://www.sfi.org.bm/)[![Image 7: Schmidt Sciences](https://arxiv.org/static/base/1.0.1/images/funders/schmidt-sciences.png)](https://www.schmidtsciences.org/)