Setting the "tokenizer" parameter to a new factory does not work; it always set the tokenizer to solr.ICUTokenizerFactory. However, if I use "tokenizer-index" and "tokenizer-query", those two work as expected.
Solr version 4.1
buildout snippet (generates a schema.xml file with solr.ICUTokenizerFactory as the tokenizer):
...
char-filter =
text solr.HTMLStripCharFilterFactory
tokenizer =
text solr.WhitespaceTokenizerFactory
filter =
filter-index =
text solr.ICUFoldingFilterFactory
...
build snippet (works as expected):
...
char-filter =
text solr.HTMLStripCharFilterFactory
tokenizer-index =
text solr.WhitespaceTokenizerFactory
tokenizer-query =
text solr.WhitespaceTokenizerFactory
filter =
filter-index =
text solr.ICUFoldingFilterFactory
...
Setting the "tokenizer" parameter to a new factory does not work; it always set the tokenizer to solr.ICUTokenizerFactory. However, if I use "tokenizer-index" and "tokenizer-query", those two work as expected.
Solr version 4.1
buildout snippet (generates a schema.xml file with solr.ICUTokenizerFactory as the tokenizer): ... char-filter = text solr.HTMLStripCharFilterFactory tokenizer = text solr.WhitespaceTokenizerFactory filter = filter-index = text solr.ICUFoldingFilterFactory ...
build snippet (works as expected): ... char-filter = text solr.HTMLStripCharFilterFactory tokenizer-index = text solr.WhitespaceTokenizerFactory tokenizer-query = text solr.WhitespaceTokenizerFactory filter = filter-index = text solr.ICUFoldingFilterFactory ...