http 500 on NC and 400 Bad Request to Elasticsearch when exceeding index.highlight.max_analyzed_offset

[cue108]

Error logging:

{\"type\":\"illegal_argument_exception\",\"reason\":\"The length [2049605] of field [content] in doc[724]\/index[nc_fulltextsearch] exceeds the [index.highlight.max_analyzed_offset] limit [1000000]. To avoid this error, set the query parameter [max_analyzed_offset] to a value less than index setting [1000000] and this will tolerate long field values by truncating them.\"}}},\"status\":400}"}

There are two ways to handle this:

1. On the connector side, hence "fulltextsearch_elasticsearch" a simple determine the max content size:

   GET yourindexname/_search
   {
   "size": 0,
   "aggs": {
   "max_content_length": {
     "max": {
       "field": "attachment.content_length"
     }
   }
   }
   }

   and increase the max_analyzed_offset accordingly:

   PUT indexname/_settings
   {
   "index" : {
   "highlight.max_analyzed_offset" : 3000000
   }
   }

   Will mitigate this error already

2. On the Elasticsearch side an index template will do:

   PUT /_index_template/indexname
   {
   "index_patterns" : ["indexname"],
   "priority" : 1,
   "template": {
   "settings" : {
     "highlight.max_analyzed_offset" : 3000000
   }
   }
   }

[meonkeys]

I'm also seeing that illegal_argument_exception error in my browser console for about half the XHR requests to https://mycloud.example.com/apps/fulltextsearch/v1/search.

I've got:

• nc server: 27.1.1
• fulltextsearch: 27.0.2
• files_fulltextsearch: 27.0.1
• fulltextsearch_elasticsearch: 27.0.4