accents gives different results (when it should not due to asciifolding)

[ComLock]

These give different results fulltext('from', 'diare', 'OR', 'standard') fulltext('from', 'diaré', 'OR', 'standard')

https://github.com/enonic/lib-yase/issues/57

[GlennRicaud]

"standard" analyzer does not have asciifolding.

[GlennRicaud]

Your problem is that you are using the "standard" analyzer.

In Enonic XP 6, you could specify analyzer per document that was used mostly for fulltext. For issues or contents, this one is "document_index_default" (which has ascii folding). When you created your nodes you did not set an analyzer, so it took the the "standard" one.

In Enonic XP 7, there is no more analyzer per document. So it will always be "document_index_default"

So two solutions for me: Solution 1: You update the indexconfig of your nodes to have this analyzer "document_index_default" (both in your application and the existing data) Solution 2: You wait for / upgrade to Enonic XP 7

[GlennRicaud]

Note to self: Default analyzer taken for fulltext in 6.15: fulltext_search_default (identical to "document_index_default") Thus the need to use 'standard' in the queries of ComLock

[GlennRicaud]

@ComLock From code reading, it seems to be possible to set the analyzer, even though I have never tried it myself. It is not documented at all

For creation by passing the following index config

"_indexConfig": {
       "analyzer": "document_index_default"
        "default": {
            "decideByType": true,
            "enabled": true,
            "nGram": false,
            "fulltext": false,
            "includeInAllText": false,
            "path": false,
            "indexValueProcessors": []
        },
        "configs": []
    }

And to patch existing data by setting the analyzer:

node._indexConfig.analyzer = 'document_index_default';

To be tested

[ComLock]

@GlennRicaud

In Enonic XP 7.0

diare gives 3 results while diaré gives 0

So the "bug" is still present in Enonic XP 7.0

[GlennRicaud]

Have you removed the "standard" parameter from the fulltext query?

[ComLock]

When I remove "standard" it works :)

I guess this issue can be closed now?