public class StandardTokenizerFactory extends TokenizerFactory
StandardTokenizer
.
<fieldType name="text_stndrd" class="solr.TextField" positionIncrementGap="100"> <analyzer> <tokenizer class="solr.StandardTokenizerFactory" maxTokenLength="255"/> </analyzer> </fieldType>
Modifier and Type | Field and Description |
---|---|
private int |
maxTokenLength |
static java.lang.String |
NAME
SPI name
|
LUCENE_MATCH_VERSION_PARAM, luceneMatchVersion
Constructor and Description |
---|
StandardTokenizerFactory(java.util.Map<java.lang.String,java.lang.String> args)
Creates a new StandardTokenizerFactory
|
Modifier and Type | Method and Description |
---|---|
StandardTokenizer |
create(AttributeFactory factory)
Creates a TokenStream of the specified input using the given AttributeFactory
|
availableTokenizers, create, findSPIName, forName, lookupClass, reloadTokenizers
get, get, get, get, get, getBoolean, getChar, getClassArg, getFloat, getInt, getLines, getLuceneMatchVersion, getOriginalArgs, getPattern, getSet, getSnowballWordSet, getWordSet, isExplicitLuceneMatchVersion, require, require, require, requireBoolean, requireChar, requireFloat, requireInt, setExplicitLuceneMatchVersion, splitAt, splitFileNames
public static final java.lang.String NAME
private final int maxTokenLength
public StandardTokenizerFactory(java.util.Map<java.lang.String,java.lang.String> args)
public StandardTokenizer create(AttributeFactory factory)
TokenizerFactory
create
in class TokenizerFactory