التفاصيل البيبلوغرافية
العنوان: |
Dual-Task ConvLSTM-UNet for Instance Segmentation of Weakly Annotated Microscopy Videos. |
المؤلفون: |
Arbelle A, Cohen S, Raviv TR |
المصدر: |
IEEE transactions on medical imaging [IEEE Trans Med Imaging] 2022 Feb 18; Vol. PP. Date of Electronic Publication: 2022 Feb 18. |
Publication Model: |
Ahead of Print |
نوع المنشور: |
Journal Article |
اللغة: |
English |
بيانات الدورية: |
Publisher: Institute of Electrical and Electronics Engineers Country of Publication: United States NLM ID: 8310780 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1558-254X (Electronic) Linking ISSN: 02780062 NLM ISO Abbreviation: IEEE Trans Med Imaging Subsets: MEDLINE |
أسماء مطبوعة: |
Original Publication: New York, NY : Institute of Electrical and Electronics Engineers, c1982- |
مستخلص: |
Convolutional Neural Networks (CNNs) are considered state of the art segmentation methods for biomedical images in general and microscopy sequences of living cells, in particular. The success of the CNNs is attributed to their ability to capture the structural properties of the data, which enables accommodating complex spatial structures of the cells, low contrast, and unclear boundaries. However, in their standard form CNNs do not exploit the temporal information available in time-lapse sequences, which can be crucial to separating touching and partially overlapping cell instances. In this work, we exploit cell dynamics using a novel CNN architecture which allows multi-scale spatio-temporal feature extraction. Specifically, a novel recurrent neural network (RNN) architecture is proposed based on the integration of a Convolutional Long Short Term Memory (ConvLSTM) network with the U-Net. The proposed ConvLSTM-UNet network is constructed as a dual-task network to enable training with weakly annotated data, in the form of approximate cell centers, termed markers, when the complete cells' outlines are not available. We further use the fast marching method to facilitate the partitioning of clustered cells into individual connected components. Finally, we suggest an adaptation of the method for 3D microscopy sequences without drastically increasing the computational load. The method was evaluated on the Cell Segmentation Benchmark and was ranked among the top three methods on six submitted datasets. Exploiting the proposed built-in marker estimator we also present state-of-the-art cell detection results for an additional, publicly available, weekly annotated dataset. The source code is available at https://gitlab.com/shaked0/lstmUnet. |
تواريخ الأحداث: |
Date Created: 20220218 Latest Revision: 20240220 |
رمز التحديث: |
20240220 |
DOI: |
10.1109/TMI.2022.3152927 |
PMID: |
35180079 |
قاعدة البيانات: |
MEDLINE |