public final class AnsjTokenizer
extends org.apache.lucene.analysis.Tokenizer
| 限定符和类型 | 字段和说明 |
|---|---|
protected org.ansj.splitWord.Analysis |
ta |
| 构造器和说明 |
|---|
AnsjTokenizer(org.ansj.splitWord.Analysis ta,
List<org.ansj.recognition.impl.StopRecognition> stops,
List<org.ansj.recognition.impl.SynonymsRecgnition> synonyms) |
| 限定符和类型 | 方法和说明 |
|---|---|
boolean |
incrementToken() |
void |
reset()
必须重载的方法,否则在批量索引文件时将会导致文件索引失败
|
addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toStringpublic final boolean incrementToken()
throws IOException
incrementToken 在类中 org.apache.lucene.analysis.TokenStreamIOExceptionpublic void reset()
throws IOException
reset 在类中 org.apache.lucene.analysis.TokenizerIOExceptionCopyright © 2019. All rights reserved.