1. tokenizer.perl included in Moses toolkit in English (Kohen et al, 2007)
2. ChaSen (Matsumoto et al. 1999) in Japanese
3. CRF-based Japanese Morphologizer in Sourceforge
4. Korean - Sejong morphological analyzer
--
5. GIZA++ (Och and Ney, 2003) for SMT
6. BLEU scoring 9Papineni et al., 2002)
No comments:
Post a Comment