givedirectly / Google-Partnership

Repository to store the work done by Google Fellows during 2019
MIT License
2 stars 0 forks source link

Consider flexible data sources #17

Open janakdr opened 5 years ago

janakdr commented 5 years ago

A number of feature requests from GiveDirectly pertain to bringing in specific data sources. Since the best data sources may change over time, it might be helpful to rephrase this request as the ability to import arbitrary (already well-formatted) data sources and display them as desired. As a starting point, we could provide an interface where arbitrary geotiff (raster) data could be uploaded by GD admins and viewable as a layer. Same for arbitrary Shapefile data.

It gets more complicated once that data has to be used to compute a score, rather than as an overlay. But I think we might be able to do something interesting there as well with a preprocessing pipeline that extracts the necessary properties from such data. In any case, the above feature already seems like a good one to have.

janakdr commented 4 years ago

The layer aspect of this is done. The score part is definitely still an issue, and something I'm thinking about now.

janakdr commented 4 years ago

This is basically done. The only remaining issue is that score asset creation seems to be slower than state-based, especially with buildings, to a level that might make it unworkable. I don't really understand why it's slower, though. Will continue to investigate if I have time.