Spring 2006 DLF Forum: Melvyl Recommender Project,
14
3 April, 2006
Spelling Correction
●
Goal:
90% correct on first try
●
Dictionary-based (aspell) vs. index-based
–
Proper nouns
–
Multilingual environment
Work done by Martin Haye.
Modifications:
- adjust to recognize that transpositions and insertions are the most common errors
- applied “double metaphone” algorithm used in aspell (captures similar words based on phonetics)
- boosted based on word frequencies in index