search

BCCN-Prog / weather_2016

For the BCCN 2016 advanced programming project
3 stars 1 forks source link

Scraping: extending file existence checking to all scrapers #27

Closed daveh19 closed 8 years ago

daveh19 commented 8 years ago

As @janfb solved in #13 the other scrapers need to add file exists checking before saving their downloaded files.

@ClaudiaWinklmayr @clauslang @inesw @akresnia

Use the file_existence_check() function defined in this commit: https://github.com/BCCN-Prog/weather_2016/commit/8aa3fc63ce7e9781544235d559f5dd84ec958b12#diff-160c108f701e3f1d045e857ab140a408

janfb commented 8 years ago

I can help to integrate the function I wrote in everyone's script. But I think we don't need it because the time stamp in the file name has second precision. We will overwrite only if we save twice within a second.

janfb commented 8 years ago

We close it since the time stamp is in seconds.