التفاصيل البيبلوغرافية
| العنوان: |
Extending Rucio with modern cloud storage support. |
| المؤلفون: |
Barisits, Martin, Barnsley, Robert, Barreiro Megino, Fernando Harald, Elmsheuser, Johannes, Lassnig, Mario, Patrascoiu, Mihai, Perry, James, Serfon, Cedric, Vendrell Moya, Alba, Wegner, Tobias |
| المصدر: |
EPJ Web of Conferences; 5/6/2024, Vol. 295, p1-7, 7p |
| مصطلحات موضوعية: |
CLOUD computing, COMPUTER storage devices, COMPUTER access control, COST estimates, DATA recovery |
| مستخلص: |
Rucio is a software framework designed to facilitate scientific collaborations in efficiently organising, managing, and accessing extensive volumes of data through customizable policies. The framework enables data distribution across globally distributed locations and heterogeneous data centres, integrating various storage and network technologies into a unified federated entity. Rucio offers advanced features like distributed data recovery and adaptive replication, and it exhibits high scalability, modularity, and extensibility. Originally developed to meet the requirements of the high-energy physics experiment ATLAS, Rucio has been continuously expanded to support LHC experiments and diverse scientific communities. Recent R&D projects within these communities have evaluated the integration of both private and commercially-provided cloud storage systems, leading to the development of additional functionalities for seamless integration within Rucio. Furthermore, the underlying systems, FTS and GFAL/Davix, have been extended to cater to specific use cases. This contribution focuses on the technical aspects of this work, particularly the challenges encountered in building a generic interface for self-hosted cloud storage, such as MinIO or CEPH S3 Gateway, and established providers like Google Cloud Storage and Amazon Simple Storage Service. Additionally, the integration of decentralised clouds like SEAL is explored. Key aspects, including authentication and authorisation, direct and remote access, throughput and cost estimation, are highlighted, along with shared experiences in daily operations. [ABSTRACT FROM AUTHOR] |
|
Copyright of EPJ Web of Conferences is the property of EDP Sciences and its content may not be copied or emailed to multiple sites or posted to a listserv without the copyright holder's express written permission. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) |
| قاعدة البيانات: |
Complementary Index |
Full Text Finder