Enhanced Remote Astronomical Archive System Based on the File-Level Unlimited Sliding-Window Technique

التفاصيل البيبلوغرافية
العنوان: Enhanced Remote Astronomical Archive System Based on the File-Level Unlimited Sliding-Window Technique
المؤلفون: Shi, Cong-Ming, Deng, Hui, Wang, Feng, Mei, Ying, Guo, Shao-Guang, Yang, Chen, Wu, Chen, Wei, Shou-Lin, Wicenec, Andreas
سنة النشر: 2021
المجموعة: Astrophysics
مصطلحات موضوعية: Astrophysics - Instrumentation and Methods for Astrophysics
الوصف: Data archiving is one of the most critical issues for modern astronomical observations. With the development of a new generation of radio telescopes, the transfer and archiving of massive remote data have become urgent problems to be solved. Herein, we present a practical and robust file-level flow-control approach, called the Unlimited Sliding-Window (USW), by referring to the classic flow-control method in TCP protocol. Basing on the USW and the Next Generation Archive System (NGAS) developed for the Murchison Widefield Array telescope, we further implemented an enhanced archive system (ENGAS) using ZeroMQ middleware. The ENGAS substantially improves the transfer performance and ensures the integrity of transferred files. In the tests, the ENGAS is approximately three to twelve times faster than the NGAS and can fully utilize the bandwidth of network links. Thus, for archiving radio observation data, the ENGAS reduces the communication time, improves the bandwidth utilization, and solves the remote synchronous archiving of data from observatories such as Mingantu spectral radioheliograph. It also provides a better reference for the future construction of the Square Kilometer Array (SKA) Science Regional Center.
Comment: 11 pages, 10 figures
نوع الوثيقة: Working Paper
DOI: 10.1088/1674-4527/21/10/253
URL الوصول: http://arxiv.org/abs/2106.12769
رقم الأكسشن: edsarx.2106.12769
قاعدة البيانات: arXiv
الوصف
DOI:10.1088/1674-4527/21/10/253