Catalog Search index process always fail

[amouri82]

Hello,

Catalog Search indexation never end succefully.

I am using Opensearch with elasticsuite. I have 3 Vms

1. VmM1 : Magento
2. VM2 : Mysql
3. VM3: Opensearch

• Magento : I have Magento with 7 stores and more than 90 000 products

• Configuration Mysql :

  `+------------------------------------------+--------------------+
  |                          key_buffer_size |          64.000 MB |
  |                         query_cache_size |           0.000 MB |
  |                  innodb_buffer_pool_size |        8192.000 MB |
  |          innodb_additional_mem_pool_size |           0.000 MB |
  |                   innodb_log_buffer_size |           8.000 MB |
  |                         table_open_cache |           0.001 MB |
  |                      max_heap_table_size |        4096.000 MB |
  |                         query_cache_type |           0.000 MB |
  |                        thread_cache_size |           8.000 MB |
  +------------------------------------------+--------------------+
  |                              BASE MEMORY |        8264.000 MB |
  +------------------------------------------+--------------------+
  |                         sort_buffer_size |           0.250 MB |
  |                         read_buffer_size |           0.125 MB |
  |                     read_rnd_buffer_size |           0.250 MB |
  |                         join_buffer_size |           0.250 MB |
  |                             thread_stack |           0.188 MB |
  |                        binlog_cache_size |           0.031 MB |
  |                           tmp_table_size |        4096.000 MB |
  +------------------------------------------+--------------------+
  |                    MEMORY PER CONNECTION |        4097.094 MB |
  +------------------------------------------+--------------------+
  |                     Max_used_connections |                 11 |
  |                          max_connections |                550 |
  +------------------------------------------+--------------------+
  |                              TOTAL (MIN) |       53332.031 MB |
  |                              TOTAL (MAX) |     2261665.562 MB |
  +------------------------------------------+--------------------+
  `

• Opensearch : Jvm options configuration -Xms4g -Xmx4g The command bin/magento indexer:reindex catalogsearch_fulltext CPU take 100%.

When i configure the indexation with 1 process, i get this error message :

Catalog Search index process killed

With 2 processes,

Catalog Search index process error during indexation process:
Fail in child process

Any help please ?

Thanks

[amouri82]

Re, Now when i execute the same command with memory limit in parameter,

php -dmemory_limit=15G bin/magento indexer:reindex catalogsearch_fulltext

I got :

Catalog Search index PHP Fatal error: Allowed memory size of 16106127360 bytes exhausted (tried to allocate 262144 bytes) in www/vendor/smile/elasticsuite/src/module-elasticsuite-catalog/Helper/AbstractAttribute.php on line 172 PHP Fatal error: Allowed memory size of 16106127360 bytes exhausted (tried to allocate 262144 bytes) in Unknown on line 0

[romainruaud]

Hi @amouri82

This is out-of-scope of the Open Source support we can provide here.

We have plenty of clients with hundreds of thousands of products running live websites with Elasticsuite without any issue.

If you are not able to run the reindexing even with 15G of RAM, that's likely to be due to :

• erratic data being indexed in your catalog
• erratic customizations made on top of Elasticsuite

Please ask your client 1001pneus to contact the elasticsuite team via elasticsuite@smile.fr so that we'll be able to provide them a quotation for helping on a T&M basis as part of our professional services offer.

Regards

[amouri82]

Hi, Thanks for your replay. I close my requet