legumeinfo / jira-issues

placeholder repo for issues migrating from JIRA system, to be moved to their appropriate places later
0 stars 0 forks source link

germplasm/map geocoding of grin accessions without geographic coords #521

Open adf-ncgr opened 8 years ago

adf-ncgr commented 8 years ago

It should be possible to use a web service for geocoding to place grin accessions on the map, using the fields orig country and collection site. This could be done with a python script on the server side-- and added to the loader scripts.

[LEGUME-554] created by agr

adf-ncgr commented 7 years ago

I wrote a geocoding script which reads and writes .csv files. This script is only useful for supplementing user-provided data with missing geographic information from the lis_gis database plus from google geocoding api. From the command line:

https://github.com/legumeinfo/lis_gis/blob/master/scripts/geocode.py

The free geocoding api is rate limited, so this is mainly only useful in for running batches of updates on the server side. This script could be changed to update the current database instead of writing out a .csv file.

I balked doing that, before, because the lis_gis database would no longer represent exactly what is in GRIN. At least the missing lat/lngs would be filled in with something, so maybe it would be an overall win? I want to ge consensus from others about this.

I estimate about 1/2 day to edit the script to make it do lis_gis database updates, and then some period of time running batch updates via a cron job at a rate about 2500/day. On LIS and peanutbase.

A separate set of issues/concerns is:

Geocoding could be integrated into the lis_gis web app as a Search feature, or as an enhancement to the user-provided-data loading feature. Those would be separate Jira tasks/issues with more development time. Some security would need to implemented because it involves ian api key for a rate-limited service from google. So I need to prevent abuse, and show the user messages if the service is unavailable, etc.

by agr