org.wltea.analyzer.lucene

类 IKTokenizer

java.lang.Object

org.apache.lucene.util.AttributeSource

org.apache.lucene.analysis.TokenStream

org.apache.lucene.analysis.Tokenizer

org.wltea.analyzer.lucene.IKTokenizer

所有已实现的接口:

Closeable, AutoCloseable

public final class IKTokenizer
extends org.apache.lucene.analysis.Tokenizer

IK分词器 Lucene Tokenizer适配器类 兼容Lucene 6.2.1版本

嵌套类概要

从类继承的嵌套类/接口 org.apache.lucene.util.AttributeSource

org.apache.lucene.util.AttributeSource.State

字段概要

从类继承的字段 org.apache.lucene.analysis.Tokenizer

input

从类继承的字段 org.apache.lucene.analysis.TokenStream

DEFAULT_TOKEN_ATTRIBUTE_FACTORY

构造器概要

构造器

构造器和说明
IKTokenizer(Reader in)
IKTokenizer(Reader in, boolean useSmart) Lucene 6.2.1 Tokenizer适配器类构造函数

方法概要

限定符和类型	方法和说明
void	end()
boolean	incrementToken()
void	reset()

从类继承的方法 org.apache.lucene.analysis.Tokenizer

close, correctOffset, setReader

从类继承的方法 org.apache.lucene.util.AttributeSource

addAttribute, addAttributeImpl, captureState, clearAttributes, cloneAttributes, copyTo, endAttributes, equals, getAttribute, getAttributeClassesIterator, getAttributeFactory, getAttributeImplsIterator, hasAttribute, hasAttributes, hashCode, reflectAsString, reflectWith, removeAllAttributes, restoreState, toString

从类继承的方法 java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

构造器详细资料

IKTokenizer

public IKTokenizer(Reader in)

参数:

in - 默认不使用智能分词

IKTokenizer

public IKTokenizer(Reader in,
                   boolean useSmart)

Lucene 6.2.1 Tokenizer适配器类构造函数

参数:

useSmart - 为true，使用智能分词策略 非智能分词：细粒度输出所有可能的切分结果 智能分词： 合并数词和量词，对分词结果进行歧义判断

方法详细资料

incrementToken

public boolean incrementToken()
                       throws IOException

指定者:

incrementToken 在类中 org.apache.lucene.analysis.TokenStream

抛出:

IOException

reset

public void reset()
           throws IOException

覆盖:

reset 在类中 org.apache.lucene.analysis.Tokenizer

抛出:

IOException

end

public final void end()

覆盖:

end 在类中 org.apache.lucene.analysis.TokenStream