دورية أكاديمية
A guide to creating an effective big data management framework
| العنوان: | A guide to creating an effective big data management framework |
|---|---|
| المؤلفون: | S. T. Arundel, K. G. McKeehan, B. B. Campbell, A. N. Bulen, P. T. Thiem |
| المصدر: | Journal of Big Data, Vol 10, Iss 1, Pp 1-22 (2023) |
| بيانات النشر: | SpringerOpen, 2023. |
| سنة النشر: | 2023 |
| المجموعة: | LCC:Computer engineering. Computer hardware LCC:Information technology LCC:Electronic computers. Computer science |
| مصطلحات موضوعية: | ADOM, Data movement, Ingress, Egress, Rclone, Computer engineering. Computer hardware, TK7885-7895, Information technology, T58.5-58.64, Electronic computers. Computer science, QA75.5-76.95 |
| الوصف: | Abstract Many agencies and organizations, such as the U.S. Geological Survey, handle massive geospatial datasets and their auxiliary data and are thus faced with challenges in storing data and ingesting it, transferring it between internal programs, and egressing it to external entities. As a result, these agencies and organizations may inadvertently devote unnecessary time and money to convey data without existing or outdated standards. This research aims to evaluate the components of data conveyance systems, such as transfer methods, tracking, and automation, to guide their improved performance. Specifically, organizations face the challenges of slow dispatch time and manual intervention when conveying data into, within, and from their systems. Conveyance often requires skilled workers when the system depends on physical media such as hard drives, particularly when terabyte transfers are required. In addition, incomplete or inconsistent metadata may necessitate manual intervention, process changes, or both. A proposed solution is organization-wide guidance for efficient data conveyance. That guidance involves systems analysis to outline a data management framework, which may include understanding the minimum requirements of data manifests, specification of transport mechanisms, and improving automation capabilities. |
| نوع الوثيقة: | article |
| وصف الملف: | electronic resource |
| اللغة: | English |
| تدمد: | 2196-1115 |
| Relation: | https://doaj.org/toc/2196-1115 |
| DOI: | 10.1186/s40537-023-00801-9 |
| URL الوصول: | https://doaj.org/article/a78e8a5aaf1b418aad19cb31016ef049 |
| رقم الأكسشن: | edsdoj.78e8a5aaf1b418aad19cb31016ef049 |
| قاعدة البيانات: | Directory of Open Access Journals |
Find this article in full text from Springer Verlag. 
Full Text Finder | تدمد: | 21961115 |
|---|---|
| DOI: | 10.1186/s40537-023-00801-9 |