Update neo4J regularly - Githubissues

ncats / RDAS

5 stars 7 forks source link

Closed wzkariampuzha closed 11 months ago

wzkariampuzha commented 2 years ago

query PubMed regularly and update neo4J db

qianzhu2018 commented 2 years ago

We also need to query OMIM API regularly and check any newly added references

wzkariampuzha commented 2 years ago

Devon is working on PubMed and Richard is working on OMIM

qianzhu2018 commented 2 years ago

We should add all references from OMIM, including PubMed indexed ones and non-PubMed indexed ones

wzkariampuzha commented 2 years ago

Also remove publications older than 50 years. and update weekly @qianzhu2018 Do you want to do a sliding date window

devonleadman commented 2 years ago

Edit the initial_loading python script to support full database creation and reoccurring updates

Check txt or json file to see if a "database_exists" variable is set to True
- if "database_exists" == False, set minimum date to lowest date needed for full creation
- if "database_exists" == True, access the txt or json file for the last time the script was ran and set the minimum retrieval date to that date

wzkariampuzha commented 2 years ago

@devonleadman Fixed the update function here: https://github.com/ncats/alert/issues/9

wzkariampuzha commented 2 years ago

Needs to have a cron script or something natively on linux machine that automatically calls the update-neo4j.py script