تقرير
Local Recovery of Two-layer Neural Networks at Overparameterization
| العنوان: | Local Recovery of Two-layer Neural Networks at Overparameterization |
|---|---|
| المؤلفون: | Zhang, Leyang, Zhang, Yaoyu, Luo, Tao |
| سنة النشر: | 2023 |
| المجموعة: | Computer Science Mathematics |
| مصطلحات موضوعية: | Computer Science - Machine Learning, Mathematics - Dynamical Systems |
| الوصف: | Under mild assumptions, we investigate the structure of loss landscape of two-layer neural networks near global minima, determine the set of parameters which recovers the target function, and characterize the gradient flows around it. With novel techniques, our work uncovers some simple aspects of the complicated loss landscape and reveals how model, target function, samples and initialization affect the training dynamics differently. These results concludes that two-layer neural networks can be recovered locally at overparameterization. |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2309.00508 |
| رقم الأكسشن: | edsarx.2309.00508 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |