bcgov / designatedlands

Python script to combine conservation related spatial data from many sources to create a single 'Designated Lands' layer for British Columbia
Apache License 2.0
9 stars 4 forks source link

non-bcgw download duplications #17

Closed smnorris closed 6 years ago

smnorris commented 7 years ago

The downloads function creates a new folder for each layer. For example, VQO gets written to the downloads folder 5 times.

smnorris commented 6 years ago

https://github.com/smnorris/conservationlands/commit/ebf3b2afedf85f5a6434f3f9ef028e1fa106411e ensures that the data only gets downloaded once, but as folders in source_data are named based on alias, a full copy of the source is still made for each layer. Some kind of folder name generation is required, concatenating url,file_in_url,layer_in_file