دورية أكاديمية
Identification of Parallel Passages Across a Large Hebrew/Aramaic Corpus
العنوان: | Identification of Parallel Passages Across a Large Hebrew/Aramaic Corpus |
---|---|
المؤلفون: | Avi Shmidman, Moshe Koppel, Ely Porat |
المصدر: | Journal of Data Mining and Digital Humanities, Vol Special Issue on..., Iss Towards a Digital Ecosystem:... (2018) |
بيانات النشر: | Nicolas Turenne, 2018. |
سنة النشر: | 2018 |
المجموعة: | LCC:History of scholarship and learning. The humanities LCC:Bibliography. Library science. Information resources |
مصطلحات موضوعية: | computer science - computation and language, History of scholarship and learning. The humanities, AZ20-999, Bibliography. Library science. Information resources |
الوصف: | We propose a method for efficiently finding all parallel passages in a large corpus, even if the passages are not quite identical due to rephrasing and orthographic variation. The key ideas are the representation of each word in the corpus by its two most infrequent letters, finding matched pairs of strings of four or five words that differ by at most one word and then identifying clusters of such matched pairs. Using this method, over 4600 parallel pairs of passages were identified in the Babylonian Talmud, a Hebrew-Aramaic corpus of over 1.8 million words, in just over 30 seconds. Empirical comparisons on sample data indicate that the coverage obtained by our method is essentially the same as that obtained using slow exhaustive methods. |
نوع الوثيقة: | article |
وصف الملف: | electronic resource |
اللغة: | English |
تدمد: | 2416-5999 |
Relation: | https://jdmdh.episciences.org/1388/pdf; https://doaj.org/toc/2416-5999 |
DOI: | 10.46298/jdmdh.1388 |
URL الوصول: | https://doaj.org/article/b15a5f02cde543f5819dd56cfde9fdbe |
رقم الأكسشن: | edsdoj.b15a5f02cde543f5819dd56cfde9fdbe |
قاعدة البيانات: | Directory of Open Access Journals |
تدمد: | 24165999 |
---|---|
DOI: | 10.46298/jdmdh.1388 |