Turkish Journal of Computer and Mathematics Education
Journal license

Journal

Turkish Journal of Computer and Mathematics Education


Volume
& Issue

Volume 11, Issue 3


Published
on


Pages

2570-2582


DOI

Article

SPEAKER DIARIZATION WITH DEEP LEARNING TECHNIQUES


Authors

Kshirod Sarmah Affiliation:
Department of Computer Science, Pandit Deendayal Upadhyaya Adarsha Mahavidyalaya (A Govt. Model College) Amjonga, Goalpara, Assam, Pin 783124, INDIA
and Swapnanil Gogoi Affiliation:
Gauhati University IDOL, Guwahati, Assam Pin 781014, INDIA


Abstract

Speaker diarization is a task to identify the speaker when different speakers spoke in an audio or video recording environment. Artificial intelligence (AI) fields have effectively used Deep Learning (DL) to solve a variety of real-world application challenges. With effective applications in a wide range of subdomains, such as natural language processing, image processing, computer vision, speech and speaker recognition, and emotion recognition, cyber security, and many others, DL, a very innovative field of Machine Learning (ML), that is quickly emerging as the most potent machine learning technique. DL techniques have outperformed conventional approaches recently in speaker diarization as well as speaker recognition. The technique of assigning classes to speech recordings that correspond to the speaker's identity is known as speaker diarization, and it allows one to determine who spoke when. A crucial step in speech processing is speaker diarization, which divides an audio recording into different speaker areas. In-depth analysis of speaker diarization utilizing a variety of deep learning algorithms that are presented in this research paper. NIST-2000 CALLHOME and our in-house database ALSD-DB are the two voice corpora we used for this study's tests. TDNN-based embeddings with x-vectors, LSTM-based embeddings with d-vectors, and lastly embeddings fusion of both x-vector and d-vector are used in the tests for the basic system. For the NIST-2000 CALLHOME database, LSTM based embeddings with d-vector and embeddings integrating both x-vector and d-vector exhibit improved performance with DER of 8.25% and 7.65%, respectively, and of 10.45% and 9.65% for the local ALSD-DB database.


Keywords

Speaker Diarization, Machine Learning, MFCC, Deep Learning


Citation

Sarmah, K. & Gogoi, S. (2020). SPEAKER diarization WITH DEEP LEARNING TECHNIQUES. Turkish Journal of Computer and Mathematics Education, 11(3), 2570–2582.

Published by: Engineering Journals

Engineering Journals Logo