search

Smile-SA / elasticsuite

Smile ElasticSuite - Magento 2 merchandising and search engine built on ElasticSearch
https://elasticsuite.io
Open Software License 3.0
761 stars 340 forks source link

illegal_argument_exception - Failed to parse value [0] as only [true] or [false] are allowed #1651

Closed lcampanella-dev closed 4 years ago

lcampanella-dev commented 4 years ago

Preconditions

PHP version: 7.1.33-2+ubuntu18.04.1+deb.sury.org+1 (cli) ElasticSearch version: 6.5.4

Magento Version : 2.3.3 (Enterprise)

ElasticSuite Version : 2.8.3

Environment : Developer

Third party modules :

"amasty/base": "^1.3.0", "amasty/geoip": "^1.3.0", "amasty/module-store-locator": "^1.3.0", "firegento/fastsimpleimport": "dev-master as 1.1.0", "aheadworks/module-blog": "^2.4", "mgs/lookbook": "^0.0.1", "vladimirpopov/webforms": "^2.9", "weprovide/magento2-module-dompdf": "^1.2", "staempfli/magento2-module-seo": "^1.7", "tecnickcom/tcpdf": "@dev", "snowdog/module-menu": "^2.10", "ebizcharge/ebizcharge": "^1.0", "avalara/avatax-magento": "^1.5", "weltpixel/m2-weltpixel-backend": "^1.9", "weltpixel/module-google-tag-manager": "^1.9", "dotmailer/dotmailer-magento2-extension": ">=3.1.2", "webonyx/graphql-php": "^0.12.6",

Steps to reproduce

  1. bin/magento index:reindex catalog_category_product elasticsuite_categories_fulltext

Expected result

  1. Reindexes should finish successfully

Actual result

  1. Error is shown: 
    Category Products index has been rebuilt successfully in 00:00:06
Catalog Search indexer process unknown error:
{"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Failed to parse value [0] as only [true] or [false] are allowed."}],"type":"illegal_argument_exception","reason":"Failed to parse value [0] as only [true] or [false] are allowed."},"status":400}
ElasticSuite Category Indexing indexer process unknown error:
{"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Failed to parse value [0] as only [true] or [false] are allowed."}],"type":"illegal_argument_exception","reason":"Failed to parse value [0] as only [true] or [false] are allowed."},"status":400}

Additional information

We were previously using ES 5.2.2 and 5.6.16 without any issue. Once we updated to 6.5.4, this issue started to show.

composer info | grep elastic

elasticsearch/elasticsearch                                       v6.7.2             PHP Client for Elasticsearch
magento/module-elasticsearch                                      100.3.3            N/A
magento/module-elasticsearch-6                                    100.3.2            N/A
magento/module-elasticsearch-catalog-permissions                  100.3.1            N/A
magento/module-inventory-elasticsearch                            1.0.2              N/A
smile/elasticsuite                                                2.8.3              Magento 2 merchandising and search engine built on ElasticSearch

curl http://localhost:9200

{
  "name" : "dpkJmap",
  "cluster_name" : "elasticsearch",
  "cluster_uuid" : "zKkn2bp0R7C1ctZzN-_6pg",
  "version" : {
    "number" : "6.5.4",
    "build_flavor" : "default",
    "build_type" : "deb",
    "build_hash" : "d2ef93d",
    "build_date" : "2018-12-17T21:17:40.758843Z",
    "build_snapshot" : false,
    "lucene_version" : "7.5.0",
    "minimum_wire_compatibility_version" : "5.6.0",
    "minimum_index_compatibility_version" : "5.0.0"
  },
  "tagline" : "You Know, for Search"
}
androshchuk commented 4 years ago

Hello @lcampanella-dev Thank you for your report.

Did you setup upgrade modules and clear cache after an update? Did you remove old indexes previous update Elasticsearch server?

Also, enable elasticsearch debug: Stores > Configuration > Elasticsuite > Base Settings > Elasticsearch Client > Enable Debug Mode = Yes OR php bin/magento config:set "smile_elasticsuite_core_base_settings/es_client/enable_debug_mode" 1

and check Magento logs for more information about errors.

Regards.

lcampanella-dev commented 4 years ago

Hi @androshchuk ! We deleted old indexes, but that was right after the update for Elasticsearch, because of this error. This didn't fix it, indexes weren't regenerated, and error when trying to reindex was still there.

Here is the debug log when running the indexes (CLI):

[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_outdated_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_outdated_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_outdated_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_outdated_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_replica_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_replica_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_replica_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store1_replica_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_outdated_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_outdated_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_outdated_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_outdated_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_replica_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_replica_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_replica_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store2_replica_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_outdated_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_outdated_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_outdated_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_outdated_4"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_replica_1"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_replica_2"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_replica_3"}} []
[2019-12-27 12:17:29] report.DEBUG: cache_invalidate:  {"method":"GET","url":"http:/","invalidateInfo":{"identifier":"DB_PDO_MYSQL_DDL_catalog_category_product_index_store7_replica_4"}} []
[2019-12-27 12:17:29] report.DEBUG: Request Body [null] []
[2019-12-27 12:17:29] report.INFO: Request Success: {"method":"HEAD","uri":"http://127.0.0.1:9200/","headers":{"Host":["127.0.0.1:9200"],"Content-Type":["application/json"],"Accept":["application/json"],"User-Agent":["elasticsearch-php/6.7.1 (Linux 4.15.0-72-generic, PHP 7.1.33-2+ubuntu18.04.1+deb.sury.org+1)"]},"HTTP code":200,"duration":0.006837} []
[2019-12-27 12:17:29] report.DEBUG: Response [""] []
[2019-12-27 12:17:29] report.INFO: curl -XHEAD 'http://127.0.0.1:9200/?pretty=true' [] []
[2019-12-27 12:17:29] report.DEBUG: Response: {"response":"","method":"HEAD","uri":"http://127.0.0.1:9200/","HTTP code":200,"duration":0.006837} []
[2019-12-27 12:17:29] report.DEBUG: Request Body ["{\"settings\":{\"requests.cache.enable\":true,\"number_of_replicas\":0,\"number_of_shards\":3,\"refresh_interval\":\"30s\",\"merge.scheduler.max_thread_count\":1,\"translog.durability\":\"async\",\"codec\":\"best_compression\",\"max_result_window\":300000,\"mapping.total_fields.limit\":20000,\"analysis\":{\"char_filter\":{\"html_strip\":{\"type\":\"html_strip\"}},\"filter\":{\"trim\":{\"type\":\"trim\"},\"lowercase\":{\"type\":\"lowercase\"},\"word_delimiter\":{\"type\":\"word_delimiter\",\"generate_word_parts\":true,\"catenate_words\":true,\"catenate_numbers\":true,\"catenate_all\":true,\"split_on_case_change\":true,\"split_on_numerics\":true,\"preserve_original\":true},\"shingle\":{\"type\":\"shingle\",\"min_shingle_size\":2,\"max_shingle_size\":2,\"output_unigrams\":true},\"reference_shingle\":{\"type\":\"shingle\",\"min_shingle_size\":2,\"max_shingle_size\":10,\"output_unigrams\":true,\"token_separator\":\"\"},\"reference_word_delimiter\":{\"type\":\"word_delimiter\",\"generate_word_parts\":true,\"catenate_words\":false,\"catenate_numbers\":false,\"catenate_all\":false,\"split_on_case_change\":true,\"split_on_numerics\":true,\"preserve_original\":false},\"ascii_folding\":{\"type\":\"asciifolding\",\"preserve_original\":false},\"standard\":{\"type\":\"stemmer\",\"language\":\"english\"},\"phonetic\":{\"type\":\"phonetic\",\"encoder\":\"metaphone\"},\"technical_delimiter\":{\"type\":\"word_delimiter\",\"generate_word_parts\":0,\"catenate_words\":0,\"catenate_numbers\":0,\"catenate_all\":0,\"split_on_case_change\":0,\"split_on_numerics\":0,\"preserve_original\":1}},\"analyzer\":{\"standard\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\",\"standard\"],\"char_filter\":[\"html_strip\"]},\"whitespace\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\"],\"char_filter\":[\"html_strip\"]},\"reference\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"reference_word_delimiter\",\"lowercase\",\"reference_shingle\"],\"char_filter\":[\"html_strip\"]},\"shingle\":{\"tokenizer\":\"whitespace\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\",\"shingle\"],\"char_filter\":[\"html_strip\"]},\"sortable\":{\"tokenizer\":\"keyword\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"lowercase\"],\"char_filter\":[\"html_strip\"]},\"phonetic\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\",\"phonetic\"],\"char_filter\":[\"html_strip\"]},\"technical\":{\"tokenizer\":\"whitespace\",\"type\":\"custom\",\"filter\":[\"technical_delimiter\",\"lowercase\",\"ascii_folding\",\"trim\"],\"char_filter\":[\"html_strip\"]}}}}}"] []
[2019-12-27 12:17:29] report.WARNING: Request Failure: {"method":"PUT","uri":"http://127.0.0.1:9200/hinkley_prod_default_catalog_product_20191227_121729","headers":{"Host":["127.0.0.1:9200"],"Content-Type":["application/json"],"Accept":["application/json"],"User-Agent":["elasticsearch-php/6.7.1 (Linux 4.15.0-72-generic, PHP 7.1.33-2+ubuntu18.04.1+deb.sury.org+1)"]},"HTTP code":400,"duration":0.004988,"error":"{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"},\"status\":400}"} []
[2019-12-27 12:17:29] report.WARNING: Response ["{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"},\"status\":400}"] []
[2019-12-27 12:17:29] report.INFO: curl -XPUT 'http://127.0.0.1:9200/hinkley_prod_default_catalog_product_20191227_121729?pretty=true' -d '{"settings":{"requests.cache.enable":true,"number_of_replicas":0,"number_of_shards":3,"refresh_interval":"30s","merge.scheduler.max_thread_count":1,"translog.durability":"async","codec":"best_compression","max_result_window":300000,"mapping.total_fields.limit":20000,"analysis":{"char_filter":{"html_strip":{"type":"html_strip"}},"filter":{"trim":{"type":"trim"},"lowercase":{"type":"lowercase"},"word_delimiter":{"type":"word_delimiter","generate_word_parts":true,"catenate_words":true,"catenate_numbers":true,"catenate_all":true,"split_on_case_change":true,"split_on_numerics":true,"preserve_original":true},"shingle":{"type":"shingle","min_shingle_size":2,"max_shingle_size":2,"output_unigrams":true},"reference_shingle":{"type":"shingle","min_shingle_size":2,"max_shingle_size":10,"output_unigrams":true,"token_separator":""},"reference_word_delimiter":{"type":"word_delimiter","generate_word_parts":true,"catenate_words":false,"catenate_numbers":false,"catenate_all":false,"split_on_case_change":true,"split_on_numerics":true,"preserve_original":false},"ascii_folding":{"type":"asciifolding","preserve_original":false},"standard":{"type":"stemmer","language":"english"},"phonetic":{"type":"phonetic","encoder":"metaphone"},"technical_delimiter":{"type":"word_delimiter","generate_word_parts":0,"catenate_words":0,"catenate_numbers":0,"catenate_all":0,"split_on_case_change":0,"split_on_numerics":0,"preserve_original":1}},"analyzer":{"standard":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","standard"],"char_filter":["html_strip"]},"whitespace":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase"],"char_filter":["html_strip"]},"reference":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","reference_word_delimiter","lowercase","reference_shingle"],"char_filter":["html_strip"]},"shingle":{"tokenizer":"whitespace","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","shingle"],"char_filter":["html_strip"]},"sortable":{"tokenizer":"keyword","type":"custom","filter":["ascii_folding","trim","lowercase"],"char_filter":["html_strip"]},"phonetic":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","phonetic"],"char_filter":["html_strip"]},"technical":{"tokenizer":"whitespace","type":"custom","filter":["technical_delimiter","lowercase","ascii_folding","trim"],"char_filter":["html_strip"]}}}}}' [] []
[2019-12-27 12:17:29] report.DEBUG: Response: {"response":"{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"},\"status\":400}","method":"PUT","uri":"http://127.0.0.1:9200/hinkley_prod_default_catalog_product_20191227_121729","HTTP code":400,"duration":0.004988} []
[2019-12-27 12:17:29] report.DEBUG: Request Body ["{\"settings\":{\"requests.cache.enable\":true,\"number_of_replicas\":0,\"number_of_shards\":3,\"refresh_interval\":\"30s\",\"merge.scheduler.max_thread_count\":1,\"translog.durability\":\"async\",\"codec\":\"best_compression\",\"max_result_window\":300000,\"mapping.total_fields.limit\":20000,\"analysis\":{\"char_filter\":{\"html_strip\":{\"type\":\"html_strip\"}},\"filter\":{\"trim\":{\"type\":\"trim\"},\"lowercase\":{\"type\":\"lowercase\"},\"word_delimiter\":{\"type\":\"word_delimiter\",\"generate_word_parts\":true,\"catenate_words\":true,\"catenate_numbers\":true,\"catenate_all\":true,\"split_on_case_change\":true,\"split_on_numerics\":true,\"preserve_original\":true},\"shingle\":{\"type\":\"shingle\",\"min_shingle_size\":2,\"max_shingle_size\":2,\"output_unigrams\":true},\"reference_shingle\":{\"type\":\"shingle\",\"min_shingle_size\":2,\"max_shingle_size\":10,\"output_unigrams\":true,\"token_separator\":\"\"},\"reference_word_delimiter\":{\"type\":\"word_delimiter\",\"generate_word_parts\":true,\"catenate_words\":false,\"catenate_numbers\":false,\"catenate_all\":false,\"split_on_case_change\":true,\"split_on_numerics\":true,\"preserve_original\":false},\"ascii_folding\":{\"type\":\"asciifolding\",\"preserve_original\":false},\"standard\":{\"type\":\"stemmer\",\"language\":\"english\"},\"phonetic\":{\"type\":\"phonetic\",\"encoder\":\"metaphone\"},\"technical_delimiter\":{\"type\":\"word_delimiter\",\"generate_word_parts\":0,\"catenate_words\":0,\"catenate_numbers\":0,\"catenate_all\":0,\"split_on_case_change\":0,\"split_on_numerics\":0,\"preserve_original\":1}},\"analyzer\":{\"standard\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\",\"standard\"],\"char_filter\":[\"html_strip\"]},\"whitespace\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\"],\"char_filter\":[\"html_strip\"]},\"reference\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"reference_word_delimiter\",\"lowercase\",\"reference_shingle\"],\"char_filter\":[\"html_strip\"]},\"shingle\":{\"tokenizer\":\"whitespace\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\",\"shingle\"],\"char_filter\":[\"html_strip\"]},\"sortable\":{\"tokenizer\":\"keyword\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"lowercase\"],\"char_filter\":[\"html_strip\"]},\"phonetic\":{\"tokenizer\":\"standard\",\"type\":\"custom\",\"filter\":[\"ascii_folding\",\"trim\",\"word_delimiter\",\"lowercase\",\"phonetic\"],\"char_filter\":[\"html_strip\"]},\"technical\":{\"tokenizer\":\"whitespace\",\"type\":\"custom\",\"filter\":[\"technical_delimiter\",\"lowercase\",\"ascii_folding\",\"trim\"],\"char_filter\":[\"html_strip\"]}}}}}"] []
[2019-12-27 12:17:29] report.WARNING: Request Failure: {"method":"PUT","uri":"http://127.0.0.1:9200/hinkley_prod_default_catalog_category_20191227_121729","headers":{"Host":["127.0.0.1:9200"],"Content-Type":["application/json"],"Accept":["application/json"],"User-Agent":["elasticsearch-php/6.7.1 (Linux 4.15.0-72-generic, PHP 7.1.33-2+ubuntu18.04.1+deb.sury.org+1)"]},"HTTP code":400,"duration":0.010174,"error":"{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"},\"status\":400}"} []
[2019-12-27 12:17:29] report.WARNING: Response ["{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"},\"status\":400}"] []
[2019-12-27 12:17:29] report.INFO: curl -XPUT 'http://127.0.0.1:9200/hinkley_prod_default_catalog_category_20191227_121729?pretty=true' -d '{"settings":{"requests.cache.enable":true,"number_of_replicas":0,"number_of_shards":3,"refresh_interval":"30s","merge.scheduler.max_thread_count":1,"translog.durability":"async","codec":"best_compression","max_result_window":300000,"mapping.total_fields.limit":20000,"analysis":{"char_filter":{"html_strip":{"type":"html_strip"}},"filter":{"trim":{"type":"trim"},"lowercase":{"type":"lowercase"},"word_delimiter":{"type":"word_delimiter","generate_word_parts":true,"catenate_words":true,"catenate_numbers":true,"catenate_all":true,"split_on_case_change":true,"split_on_numerics":true,"preserve_original":true},"shingle":{"type":"shingle","min_shingle_size":2,"max_shingle_size":2,"output_unigrams":true},"reference_shingle":{"type":"shingle","min_shingle_size":2,"max_shingle_size":10,"output_unigrams":true,"token_separator":""},"reference_word_delimiter":{"type":"word_delimiter","generate_word_parts":true,"catenate_words":false,"catenate_numbers":false,"catenate_all":false,"split_on_case_change":true,"split_on_numerics":true,"preserve_original":false},"ascii_folding":{"type":"asciifolding","preserve_original":false},"standard":{"type":"stemmer","language":"english"},"phonetic":{"type":"phonetic","encoder":"metaphone"},"technical_delimiter":{"type":"word_delimiter","generate_word_parts":0,"catenate_words":0,"catenate_numbers":0,"catenate_all":0,"split_on_case_change":0,"split_on_numerics":0,"preserve_original":1}},"analyzer":{"standard":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","standard"],"char_filter":["html_strip"]},"whitespace":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase"],"char_filter":["html_strip"]},"reference":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","reference_word_delimiter","lowercase","reference_shingle"],"char_filter":["html_strip"]},"shingle":{"tokenizer":"whitespace","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","shingle"],"char_filter":["html_strip"]},"sortable":{"tokenizer":"keyword","type":"custom","filter":["ascii_folding","trim","lowercase"],"char_filter":["html_strip"]},"phonetic":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","phonetic"],"char_filter":["html_strip"]},"technical":{"tokenizer":"whitespace","type":"custom","filter":["technical_delimiter","lowercase","ascii_folding","trim"],"char_filter":["html_strip"]}}}}}' [] []
[2019-12-27 12:17:29] report.DEBUG: Response: {"response":"{\"error\":{\"root_cause\":[{\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"}],\"type\":\"illegal_argument_exception\",\"reason\":\"Failed to parse value [0] as only [true] or [false] are allowed.\"},\"status\":400}","method":"PUT","uri":"http://127.0.0.1:9200/hinkley_prod_default_catalog_category_20191227_121729","HTTP code":400,"duration":0.010174} []

What would you suggest?

Thank you!

lcampanella-dev commented 4 years ago

While testing the requests present in the debug, particularly this one:

curl -XPUT 'http://127.0.0.1:9200/hinkley_prod_default_catalog_product_20191227_121729?pretty=true' -d '{"settings":{"requests.cache.enable":true,"number_of_replicas":0,"number_of_shards":3,"refresh_interval":"30s","merge.scheduler.max_thread_count":1,"translog.durability":"async","codec":"best_compression","max_result_window":300000,"mapping.total_fields.limit":20000,"analysis":{"char_filter":{"html_strip":{"type":"html_strip"}},"filter":{"trim":{"type":"trim"},"lowercase":{"type":"lowercase"},"word_delimiter":{"type":"word_delimiter","generate_word_parts":true,"catenate_words":true,"catenate_numbers":true,"catenate_all":true,"split_on_case_change":true,"split_on_numerics":true,"preserve_original":true},"shingle":{"type":"shingle","min_shingle_size":2,"max_shingle_size":2,"output_unigrams":true},"reference_shingle":{"type":"shingle","min_shingle_size":2,"max_shingle_size":10,"output_unigrams":true,"token_separator":""},"reference_word_delimiter":{"type":"word_delimiter","generate_word_parts":true,"catenate_words":false,"catenate_numbers":false,"catenate_all":false,"split_on_case_change":true,"split_on_numerics":true,"preserve_original":false},"ascii_folding":{"type":"asciifolding","preserve_original":false},"standard":{"type":"stemmer","language":"english"},"phonetic":{"type":"phonetic","encoder":"metaphone"},"technical_delimiter":{"type":"word_delimiter","generate_word_parts":0,"catenate_words":0,"catenate_numbers":0,"catenate_all":0,"split_on_case_change":0,"split_on_numerics":0,"preserve_original":1}},"analyzer":{"standard":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","standard"],"char_filter":["html_strip"]},"whitespace":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase"],"char_filter":["html_strip"]},"reference":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","reference_word_delimiter","lowercase","reference_shingle"],"char_filter":["html_strip"]},"shingle":{"tokenizer":"whitespace","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","shingle"],"char_filter":["html_strip"]},"sortable":{"tokenizer":"keyword","type":"custom","filter":["ascii_folding","trim","lowercase"],"char_filter":["html_strip"]},"phonetic":{"tokenizer":"standard","type":"custom","filter":["ascii_folding","trim","word_delimiter","lowercase","phonetic"],"char_filter":["html_strip"]},"technical":{"tokenizer":"whitespace","type":"custom","filter":["technical_delimiter","lowercase","ascii_folding","trim"],"char_filter":["html_strip"]}}}}}'

I realized that if I update this:

"technical_delimiter": {
    "type": "word_delimiter",
    "generate_word_parts": 0,
    "catenate_words": 0,
    "catenate_numbers": 0,
    "catenate_all": 0,
    "split_on_case_change": 0,
    "split_on_numerics": 0,
    "preserve_original": 1
}

To this, the call works without error:

"technical_delimiter": {
    "type": "word_delimiter",
    "generate_word_parts": false,
    "catenate_words": false,
    "catenate_numbers": false,
    "catenate_all": false,
    "split_on_case_change": false,
    "split_on_numerics": false,
    "preserve_original": true
}

Maybe we need to update: vendor/smile/elasticsuite/src/module-elasticsuite-core/etc/elasticsuite_analysis.xml And set boolean values instead of int.

Thoughts?

Thanks!

androshchuk commented 4 years ago

So. I found the same problems with section 'word_delimiter' (I don't have section 'technical_delimiter' in 2.8.3 https://github.com/Smile-SA/elasticsuite/blob/2.8.3/src/module-elasticsuite-core/etc/elasticsuite_analysis.xml) and we fixed it on https://github.com/Smile-SA/elasticsuite/commit/6450515abe7fb4f08b98dc11034ebba0b108fc4c

Please check your version of ElasticSuite.

Regards

lcampanella-dev commented 4 years ago

That fix is in place. What I needed to change was the 'technical_delimiter' section (introduced in a custom patch), to use booleans. Now reindex is working again.

Thanks for your help!

androshchuk commented 4 years ago

You're welcome!