تقرير
The Lack of Convexity of the Relevance-Compression Function
| العنوان: | The Lack of Convexity of the Relevance-Compression Function |
|---|---|
| المؤلفون: | Parker, Albert E, Gedeon, Tomas, Dimitrov, Alexander |
| سنة النشر: | 2022 |
| المجموعة: | Computer Science Mathematics |
| مصطلحات موضوعية: | Computer Science - Information Theory, 68P30 94A34 |
| الوصف: | In this paper we investigate the convexity of the relevance-compression function for the Information Bottleneck and the Information Distortion problems. This curve is an analog of the rate-distortion curve, which is convex. In the problems we discuss in this paper, the distortion function is not a linear function of the quantizer, and the relevance-compression function is not necessarily convex (concave), but can change its convexity. We relate this phenomena with existence of first order phase transitions in the corresponding Lagrangian as a function of the annealing parameter. Comment: 8 pages, 2 figures |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2204.10957 |
| رقم الأكسشن: | edsarx.2204.10957 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |