wellcometrust / reach

Wellcome tool to parse references scraped from policy documents using machine learning
MIT License
26 stars 4 forks source link

Use PostgreSQL instead of ES in Reach web backend #496

Closed SamDepardieu closed 4 years ago

SamDepardieu commented 4 years ago

Rationale

At the moment, Reach is using Elasticsearch as its backend database.

Elasticsearch is great to perform search operation in an optimised way, leading to better search speed into the huge number of publication we store.

This speed comes with a loss of customisation in our requests, that we currently want to get back to implement the new search features.

PostgreSQL offers good search speed and a better customisation level in the queries.

Expected outcomes

Success criteria

dd207 commented 4 years ago

Can this be closed now @SamDepardieu ?

SamDepardieu commented 4 years ago

Sadly, not yet... I'm still fixing some stuff in there