Model-assisted deep learning of rare extreme events from partial observations

التفاصيل البيبلوغرافية
العنوان: Model-assisted deep learning of rare extreme events from partial observations
المؤلفون: Asch, Anna, Brady, Ethan, Gallardo, Hugo, Hood, John, Chu, Bryan, Farazmand, Mohammad
سنة النشر: 2021
المجموعة: Computer Science
Mathematics
Nonlinear Sciences
Physics (Other)
مصطلحات موضوعية: Computer Science - Machine Learning, Mathematics - Dynamical Systems, Nonlinear Sciences - Chaotic Dynamics, Physics - Fluid Dynamics
الوصف: To predict rare extreme events using deep neural networks, one encounters the so-called small data problem because even long-term observations often contain few extreme events. Here, we investigate a model-assisted framework where the training data is obtained from numerical simulations, as opposed to observations, with adequate samples from extreme events. However, to ensure the trained networks are applicable in practice, the training is not performed on the full simulation data; instead we only use a small subset of observable quantities which can be measured in practice. We investigate the feasibility of this model-assisted framework on three different dynamical systems (Rossler attractor, FitzHugh-Nagumo model, and a turbulent fluid flow) and three different deep neural network architectures (feedforward, long short-term memory, and reservoir computing). In each case, we study the prediction accuracy, robustness to noise, reproducibility under repeated training, and sensitivity to the type of input data. In particular, we find long short-term memory networks to be most robust to noise and to yield relatively accurate predictions, while requiring minimal fine-tuning of the hyperparameters.
Comment: Accepted for publication in Chaos: An Interdisciplinary Journal of Nonlinear Science
نوع الوثيقة: Working Paper
DOI: 10.1063/5.0077646
URL الوصول: http://arxiv.org/abs/2111.04857
رقم الأكسشن: edsarx.2111.04857
قاعدة البيانات: arXiv