vitrivr / cineast

Cineast is a multi-feature content-based mulitmedia retrieval engine. It is capable of retrieving images, audio- and video sequences as well as 3d models based on edge or color sketches, textual descriptions and example objects.
MIT License
56 stars 51 forks source link

Fix Parallel Execution of CLIP Feature #334

Closed silvanheller closed 1 year ago

silvanheller commented 2 years ago

This PR solves parallel calls to to the CLIP feature (#330), which were caused by initialization problems of CLIP & the tokenizer in heavily parallel scenarios.

It does not prevent parallel model-calls, nor parallel execution of the feature.

As the new Tensorflow version is still on SNAPSHOT, this PR remains on 0.4.1 and is thus ready for review as a slightly updated version of #331 #332

Functionality is fully tested with large-scale evaluation runs for parallel model execution.