Efficient Conformal Prediction under Data Heterogeneity

التفاصيل البيبلوغرافية
العنوان: Efficient Conformal Prediction under Data Heterogeneity
المؤلفون: Plassier, Vincent, Kotelevskii, Nikita, Rubashevskii, Aleksandr, Noskov, Fedor, Velikanov, Maksim, Fishkov, Alexander, Horvath, Samuel, Takac, Martin, Moulines, Eric, Panov, Maxim
سنة النشر: 2023
المجموعة: Computer Science
Statistics
مصطلحات موضوعية: Statistics - Machine Learning, Computer Science - Machine Learning
الوصف: Conformal Prediction (CP) stands out as a robust framework for uncertainty quantification, which is crucial for ensuring the reliability of predictions. However, common CP methods heavily rely on data exchangeability, a condition often violated in practice. Existing approaches for tackling non-exchangeability lead to methods that are not computable beyond the simplest examples. This work introduces a new efficient approach to CP that produces provably valid confidence sets for fairly general non-exchangeable data distributions. We illustrate the general theory with applications to the challenging setting of federated learning under data heterogeneity between agents. Our method allows constructing provably valid personalized prediction sets for agents in a fully federated way. The effectiveness of the proposed method is demonstrated in a series of experiments on real-world datasets.
Comment: 29 pages
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2312.15799
رقم الأكسشن: edsarx.2312.15799
قاعدة البيانات: arXiv