تقرير
PyTond: Efficient Python Data Science on the Shoulders of Databases
| العنوان: | PyTond: Efficient Python Data Science on the Shoulders of Databases |
|---|---|
| المؤلفون: | Shahrokhi, Hesam, Kaboli, Amirali, Ghorbani, Mahdi, Shaikhha, Amir |
| سنة النشر: | 2024 |
| المجموعة: | Computer Science |
| مصطلحات موضوعية: | Computer Science - Databases, Computer Science - Programming Languages |
| الوصف: | Python data science libraries such as Pandas and NumPy have recently gained immense popularity. Although these libraries are feature-rich and easy to use, their scalability limitations require more robust computational resources. In this paper, we present PyTond, an efficient approach to push the processing of data science workloads down into the database engines that are already known for their big data handling capabilities. Compared to the previous work, by introducing TondIR, our approach can capture a more comprehensive set of workloads and data layouts. Moreover, by doing IR-level optimizations, we generate better SQL code that improves the query processing by the underlying database engine. Our evaluation results show promising performance improvement compared to Python and other alternatives for diverse data science workloads. Comment: Extended version of ICDE 2024 |
| نوع الوثيقة: | Working Paper |
| URL الوصول: | http://arxiv.org/abs/2407.11616 |
| رقم الأكسشن: | edsarx.2407.11616 |
| قاعدة البيانات: | arXiv |
| الوصف غير متاح. |