Implement a search endpoint using solr

mapping-commons / sssom-api

Apache License 2.0

7 stars 0 forks source link

Implement a search endpoint using solr #17

Open anitacaron opened 1 year ago

anitacaron commented 1 year ago

[x] Add solr docker image to the docker-compose
[ ] Do a 2 SOLR tutorials like https://www.youtube.com/watch?v=v4GNOnvdgtY (didnt check this)
[ ] Use sssom CLI to turn mapping sets to JSON
[x] Write some code to load JSON into SOLR core
[ ] Create endpoint to search any field
[ ] Create endpoint to search a range for confidence field

matentzn commented 1 year ago

Here is some ancient code I wrote:

https://github.com/VirtualFlyBrain/vfb-pipeline-dumps/blob/master/scripts/obographs-solr.py

Something that's maybe irrelevant: https://github.com/VirtualFlyBrain/vfb-solr

Be very careful with this, don't just copy blindly: https://github.com/VirtualFlyBrain/Docker-VFB-SOLR/blob/master/loadOLS.sh

anitacaron commented 1 year ago

Use sssom CLI to turn mapping sets to JSON

This also needs a script to flat the data. The decision would be to add all mapping_set information to each of its mappings, but there are the same attributes' names in both levels. Discussing with Nico, he said that the policy (not official) is to prioritise the field at the mapping level. And only take the mapping_set field if it's not available in the mapping. However, this is still in discussion on a case by case.

The list of terms present in mapping set and mapping: TBD