EM Algorithm and Stochastic Control in Economics

التفاصيل البيبلوغرافية
العنوان: EM Algorithm and Stochastic Control in Economics
المؤلفون: Kou, Steven, Peng, Xianhua, Xu, Xingbo
سنة النشر: 2016
المجموعة: Mathematics
Quantitative Finance
Statistics
مصطلحات موضوعية: Quantitative Finance - Economics, Mathematics - Optimization and Control, Statistics - Machine Learning, 93E20, 93E35, 91G60, 91G80, 90B05, 90C15, 90C35, 90C39, 90C40
الوصف: Generalising the idea of the classical EM algorithm that is widely used for computing maximum likelihood estimates, we propose an EM-Control (EM-C) algorithm for solving multi-period finite time horizon stochastic control problems. The new algorithm sequentially updates the control policies in each time period using Monte Carlo simulation in a forward-backward manner; in other words, the algorithm goes forward in simulation and backward in optimization in each iteration. Similar to the EM algorithm, the EM-C algorithm has the monotonicity of performance improvement in each iteration, leading to good convergence properties. We demonstrate the effectiveness of the algorithm by solving stochastic control problems in the monopoly pricing of perishable assets and in the study of real business cycle.
Comment: 46 pages, 9 figures
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/1611.01767
رقم الأكسشن: edsarx.1611.01767
قاعدة البيانات: arXiv