تقرير
Quantum Markov Decision Processes Part I: General Theory, Approximations, and Classes of Policies
| العنوان: | Quantum Markov Decision Processes Part I: General Theory, Approximations, and Classes of Policies |
|---|---|
| المؤلفون: | Saldi, Naci, Sanjari, Sina, Yuksel, Serdar |
| سنة النشر: | 2024 |
| المجموعة: | Computer Science Mathematics Quantum Physics |
| مصطلحات موضوعية: | Quantum Physics, Electrical Engineering and Systems Science - Systems and Control, Mathematics - Optimization and Control |
| الوصف: | In this two part article, the aim is to develop a quantum counterpart to classical Markov decision processes (MDPs). In Part I, we provide a very general formulation of quantum MDPs with state and action spaces in the quantum domain, quantum transitions, and cost functions. Once we formulate the quantum MDP (q-MDP), our focus shifts to establishing the verification theorem that proves the sufficiency of Markovian quantum control policies and provides a dynamic programming principle. Subsequently, a comparison is drawn between our q-MDP model and previously established quantum MDP models (referred to as QOMDPs) found in the literature. Furthermore, approximations of q-MDPs are obtained via finite-action models, which can be formulated as QOMDPs. Finally, classes of open-loop and closed-loop policies for q-MDPs are introduced, along with structural results for these policies. In summary, we present a novel quantum MDP model aiming to introduce a new framework, algorithms, and future research avenues. We believe that our approach will pave the way for a new research direction in discrete-time quantum control. Comment: 25 pages |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2402.14649 |
| رقم الأكسشن: | edsarx.2402.14649 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |