edu.umd.hooka
Class AlignmentWordPreprocessor
java.lang.Object
edu.umd.hooka.AlignmentWordPreprocessor
public abstract class AlignmentWordPreprocessor
- extends Object
This class contains tokenizers for several languages.
The method to tokenize a sentence is preprocessWordsImpl. The input is an array of Strings, generated by splitting the input sentence by space characters.
- Author:
- ferhanture
AlignmentWordPreprocessor
public AlignmentWordPreprocessor()
preprocessWordsForAlignment
public final String[] preprocessWordsForAlignment(String[] arg)
CreatePreprocessor
public static AlignmentWordPreprocessor CreatePreprocessor(LanguagePair lp,
Language l,
Configuration conf)