4teamwork / ftw.solr

Solr integration for Plone
5 stars 5 forks source link

Add support for uploading blobs to extract handler. #149

Closed lukasgraf closed 4 years ago

lukasgraf commented 4 years ago

Add support for uploading blobs to Solr Cells extract handler via HTTP POST (instead of passing it a file path that causes the extract handler retrieve the blob from the blob storage on the filesystem).

This introduces a new connection configuration option upload_blobs (default: False). If set, ftw.solr will upload the blob's content with the HTTP POST request made to the extract handler. This allows setups where Solr doesn't run on the same machine where the blob storage is located.

File upload is performed in a streaming fashion with HTTP/1.1 chunked transfer to avoid loading the entire blob into memory.

This is part of 4teamwork/opengever.core#6023.