meilisearch / scrapix

MIT License
21 stars 9 forks source link

Scrapix Docker image configuration: JSON string parsing and Liquid syntax compatibility #95

Open CaroFG opened 6 months ago

CaroFG commented 6 months ago

Scrapix docker image only accepts a JSON string to pass the configuration. The problem arises when trying to pass a documentTemplate, which uses Liquid syntax:

the JSON string should not have any space, because it returns an “unexpected end of json input”. But when it does not have any spaces, I get a Meilisearch API error:

.embedders.default.documentTemplate`: Invalid template: user error: cannot parse template: liquid: 

Ideally, I'd like to have the cloud crawler accept a configuration file. It would simplify the process and enable cloud users to add hybrid search capabilities to their documentation