ICIJ / datashare

A self-hosted search engine for documents.
https://datashare.icij.org
GNU Affero General Public License v3.0
598 stars 54 forks source link

Failing to add new files #1576

Closed abdelhakel closed 3 weeks ago

abdelhakel commented 2 months ago

Describe the bug When adding new documents, Datashare is not processing them. In Terminal i got the error message :

[Worker: RequestDispatcher: Thread-38] ERROR Fluent - Unable to POST /api/task/batchUpdate/index/Users/MBPRO/Datashare/Folder/Sub Folder
[Worker: RequestDispatcher: Thread-38] ERROR Fluent - Unexpected error:
co.elastic.clients.elasticsearch._types.ElasticsearchException: [es/scroll] failed: [search_phase_execution_exception] all shards failed

I don't know if it can be related to the volume of files in the Datashare folder : more than 500,000.

When i do : curl http://localhost:9200/_count i get :

{
  "count": 2826880,
  "_shards": {
    "total": 2,
    "successful": 2,
    "skipped": 0,
    "failed": 0
  }
}

Also, for several weeks, i often got "The server encountered an error" message when making in search on a simple word. It's working back and i exclude PDF and someitmes Excel format from the file formats list.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop :

github-actions[bot] commented 3 weeks ago

This issue is stale because it has been open for 40 days with no activity.