Denoising individual bias for a fairer binary submatrix detection

التفاصيل البيبلوغرافية
العنوان: Denoising individual bias for a fairer binary submatrix detection
المؤلفون: Wan, Changlin, Chang, Wennan, Zhao, Tong, Cao, Sha, Zhang, Chi
سنة النشر: 2020
المجموعة: Computer Science
Statistics
مصطلحات موضوعية: Computer Science - Machine Learning, Statistics - Machine Learning
الوصف: Low rank representation of binary matrix is powerful in disentangling sparse individual-attribute associations, and has received wide applications. Existing binary matrix factorization (BMF) or co-clustering (CC) methods often assume i.i.d background noise. However, this assumption could be easily violated in real data, where heterogeneous row- or column-wise probability of binary entries results in disparate element-wise background distribution, and paralyzes the rationality of existing methods. We propose a binary data denoising framework, namely BIND, which optimizes the detection of true patterns by estimating the row- or column-wise mixture distribution of patterns and disparate background, and eliminating the binary attributes that are more likely from the background. BIND is supported by thoroughly derived mathematical property of the row- and column-wise mixture distributions. Our experiment on synthetic and real-world data demonstrated BIND effectively removes background noise and drastically increases the fairness and accuracy of state-of-the arts BMF and CC methods.
Comment: Accepted at CIKM 2020
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2007.15816
رقم الأكسشن: edsarx.2007.15816
قاعدة البيانات: arXiv