Design, implementation, and evaluation of transparent pNFS on Lustre

التفاصيل البيبلوغرافية
العنوان: Design, implementation, and evaluation of transparent pNFS on Lustre
المؤلفون: Oleg Drokin, Jeffrey S. Vetter, Weikuan Yu
المصدر: IPDPS
بيانات النشر: IEEE, 2009.
سنة النشر: 2009
مصطلحات موضوعية: Data flow diagram, File server, Open standard, Computer science, Server, Scalability, Operating system, Lustre (file system), computer.software_genre, Supercomputer, computer
الوصف: Parallel NFS (pNFS) is an emergent open standard for parallelizing data transfer over a variety of I/O protocols. Prototypes of pNFS are actively being developed by industry and academia to examine its viability and possible enhancements. In this paper, we present the design, implementation, and evaluation of lpNFS, a Lustre-based parallel NFS. We achieve our primary objective in designing lpNFS as an enabling technology for transparent pNFS accesses to an opaque Lustre file system. We optimize the data flow paths in lpNFS by using two techniques: (a) fast memory coping for small messages, and (b) page sharing for zero-copy bulk data transfer. Our initial performance evaluation shows that the performance of lpNFS is comparable to that of original Lustre. Given these results, we assert that lpNFS is a promising approach to combining the benefits of pNFS and Lustre, and it exposes the underlying capabilities of Lustre file systems while transparently supporting pNFS clients.
URL الوصول: https://explore.openaire.eu/search/publication?articleId=doi_________::46a40bf40683ccd5f3bc57c056cbf51f
https://doi.org/10.1109/ipdps.2009.5160993
رقم الأكسشن: edsair.doi...........46a40bf40683ccd5f3bc57c056cbf51f
قاعدة البيانات: OpenAIRE