Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 12, Issue 3


Published
on

April 5, 2021


Pages

2163-2171


DOI

Article

Kelantan and Sarawak Malay Dialects: Parallel Dialect Text Collection and Alignment Using Hybrid Distance-Statistical-Based Phrase Alignment Algorithm


Authors

Jasmina Yen Min Khaw Affiliation:
Faculty of Information Communication and Technology, Universiti Tunku Abdul Rahman, Kampar, Malaysia
, Tien-Ping Tan* Affiliation:
School of Computer Sciences, Universiti Sains Malaysia, Penang, Malaysia
and Bali Ranaivo-Malancon Affiliation:
Faculty of Computer Science and Information Technology, Universiti Malaysia Sarawak, Malaysia


Abstract

Parallel texts corpora are essential resources especially in translation and multilingual information retrieval. However, the publicly available parallel text corpora are limited to certain types and domains. Besides, Malay dialects are not standardized in term of writing. The existing alignment algorithms that is used to analyze the writing will require a large training data to obtain a good result. The paper describes our methodology in acquiring a parallel text corpus of Standard Malay and Malay dialects, particularly Kelantan Malay and Sarawak Malay. Second, we propose a hybrid of distance-based and statistical-based alignment algorithm to align words and phrases of the parallel text. The proposed approach has a better precision and recall than the state-of-the-art GIZA++. In the paper, the alignment obtained were also compared to find out the lexical similarities and differences between SM and the two dialects.


Keywords

Malay dialects, parallel text, word alignment


Citation

Khaw, J. Y. M., Tan, T., & Ranaivo-Malancon, B. (2021). Kelantan and sarawak malay dialects: Parallel dialect text collection and alignment using hybrid distance-statistical-based phrase alignment algorithm. Turkish Journal of Computer and Mathematics Education, 12(3), 2163–2171.

Published by: Engineering Journals

Engineering Journals Logo