类 AnsjTokenizer

java.lang.Object
org.apache.lucene.util.AttributeSource
org.apache.lucene.analysis.TokenStream
org.apache.lucene.analysis.Tokenizer
org.ansj.lucene.util.AnsjTokenizer
所有已实现的接口:
Closeable, AutoCloseable

public final class AnsjTokenizer extends org.apache.lucene.analysis.Tokenizer
  • 嵌套类概要

    从类继承的嵌套类/接口 org.apache.lucene.util.AttributeSource

    org.apache.lucene.util.AttributeSource.State
  • 字段概要

    字段
    修饰符和类型
    字段
    说明
    protected org.ansj.splitWord.Analysis
     

    从类继承的字段 org.apache.lucene.analysis.Tokenizer

    input

    从类继承的字段 org.apache.lucene.analysis.TokenStream

    DEFAULT_TOKEN_ATTRIBUTE_FACTORY
  • 构造器概要

    构造器
    构造器
    说明
    AnsjTokenizer(org.ansj.splitWord.Analysis ta, List<org.ansj.recognition.impl.StopRecognition> stops, List<org.ansj.recognition.impl.SynonymsRecgnition> synonyms)
     
  • 方法概要

    修饰符和类型
    方法
    说明
    void
    end()
     
    final boolean
     
    void
    必须重载的方法,否则在批量索引文件时将会导致文件索引失败

    从类继承的方法 org.apache.lucene.analysis.Tokenizer

    close, correctOffset, setReader, setReaderTestPoint

    从类继承的方法 org.apache.lucene.util.AttributeSource

    addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString

    从类继承的方法 java.lang.Object

    clone, finalize, getClass, notify, notifyAll, wait, wait, wait
  • 字段详细资料

    • ta

      protected org.ansj.splitWord.Analysis ta
  • 构造器详细资料

    • AnsjTokenizer

      public AnsjTokenizer(org.ansj.splitWord.Analysis ta, List<org.ansj.recognition.impl.StopRecognition> stops, List<org.ansj.recognition.impl.SynonymsRecgnition> synonyms)
  • 方法详细资料

    • incrementToken

      public final boolean incrementToken() throws IOException
      指定者:
      incrementToken 在类中 org.apache.lucene.analysis.TokenStream
      抛出:
      IOException
    • end

      public void end() throws IOException
      覆盖:
      end 在类中 org.apache.lucene.analysis.TokenStream
      抛出:
      IOException
    • reset

      public void reset() throws IOException
      必须重载的方法,否则在批量索引文件时将会导致文件索引失败
      覆盖:
      reset 在类中 org.apache.lucene.analysis.Tokenizer
      抛出:
      IOException