WilhelmusLab / Segmentation_EB

new segmentation routine used for FSD and accurate floe characteristics (Buckley et al., 2024)
0 stars 0 forks source link

Input data provenance #9

Open cpaniaguam opened 6 months ago

cpaniaguam commented 6 months ago

@ellenbuckley I'm thinking there is a programmatic way to get the input data. Were these files fetched with a tool like fetchdata or some other tool?

8

ellenbuckley commented 6 months ago

they were fetched with requests.get() and an input url. I'm sure there is a better way to do this. And after implementing new cloud mask, it can just use the files fetched from the fetchdata script.

ellenbuckley commented 6 months ago

and maybe the fetchdata script can also pull the current cloud mask with some tweaks?

cpaniaguam commented 6 months ago

they were fetched with requests.get() and an input url. I'm sure there is a better way to do this. And after implementing new cloud mask, it can just use the files fetched from the fetchdata script.

@ellenbuckley Consider adding that script you used to get the input data files to the repo. We could use it to update fetchdata.

ellenbuckley commented 4 months ago

@cpaniaguam i added the modis_download_short.ipynb notebook if you want to take a look on the sketchy way I downloaded the data.

cpaniaguam commented 4 months ago

@cpaniaguam i added the modis_download_short.ipynb notebook if you want to take a look on the sketchy way I downloaded the data.

@ellenbuckley Thanks! I will look at it and probably follow up with some questions!