User Tools

Site Tools


fa-evaluation

This is an old revision of the document!


Evaluation of Forced aligners

This page contains information on forced alignment tools available here at CLST and from other third parties. They are compared and evaluated. It is in no way a formal evaluation, but more an evaluation of experiences and intuitions while working with them.

Montreal Forced Aligner

Montreal Forced Aligner (MFA): https://github.com/MontrealCorpusTools/Montreal-Forced-Aligner
“MFA is quite user-friendly and easy to use. There are several options, you can use the pre-trained models or you can train the models on your own data/speakers. Attached you will find some examples of why I am not too happy with MFA (especially with the pretrained models), but I am not quite sure how to get a better system. It is especially hard because some of the speakers reduce and the dictionary is not equipped to handle reduction. I have not formally evaluated MFA yet, so I cannot make a general statement about its performance. However looking at just a few files, it seems like that training on the speaker yields better results.” (Katherine Marcoux)

Kaldi vs. HTK

Kaldi ASR toolkit: http://kaldi-asr.org
HTK ASR toolkit: http://htk.eng.cam.ac.uk
“KALDI outperforms HTK, in general, but the output quality largely depends on the adequacy of the orthographic input.” (Louis ten Bosch, Katherine Marcoux)

fa-evaluation.1543315444.txt.gz · Last modified: 2018/11/27 11:44 by mganzeboom