Early Stopping Criteria for Training Generative Adversarial Networks in Biomedical Imaging

التفاصيل البيبلوغرافية
العنوان: Early Stopping Criteria for Training Generative Adversarial Networks in Biomedical Imaging
المؤلفون: Saad, Muhammad Muneeb, Rehmani, Mubashir Husain, O'Reilly, Ruairi
سنة النشر: 2024
المجموعة: Computer Science
مصطلحات موضوعية: Computer Science - Computer Vision and Pattern Recognition, Computer Science - Machine Learning, Electrical Engineering and Systems Science - Image and Video Processing
الوصف: Generative Adversarial Networks (GANs) have high computational costs to train their complex architectures. Throughout the training process, GANs' output is analyzed qualitatively based on the loss and synthetic images' diversity and quality. Based on this qualitative analysis, training is manually halted once the desired synthetic images are generated. By utilizing an early stopping criterion, the computational cost and dependence on manual oversight can be reduced yet impacted by training problems such as mode collapse, non-convergence, and instability. This is particularly prevalent in biomedical imagery, where training problems degrade the diversity and quality of synthetic images, and the high computational cost associated with training makes complex architectures increasingly inaccessible. This work proposes a novel early stopping criteria to quantitatively detect training problems, halt training, and reduce the computational costs associated with synthesizing biomedical images. Firstly, the range of generator and discriminator loss values is investigated to assess whether mode collapse, non-convergence, and instability occur sequentially, concurrently, or interchangeably throughout the training of GANs. Secondly, utilizing these occurrences in conjunction with the Mean Structural Similarity Index (MS-SSIM) and Fr\'echet Inception Distance (FID) scores of synthetic images forms the basis of the proposed early stopping criteria. This work helps identify the occurrence of training problems in GANs using low-resource computational cost and reduces training time to generate diversified and high-quality synthetic images.
Comment: This paper is accepted at the 35th IEEE Irish Signals and Systems Conference (ISSC 2024)
نوع الوثيقة: Working Paper
URL الوصول: http://arxiv.org/abs/2405.20987
رقم الأكسشن: edsarx.2405.20987
قاعدة البيانات: arXiv