search

allenai / satlas-super-resolution

Apache License 2.0
190 stars 24 forks source link

About the dataset #3

Closed wwangcece closed 8 months ago

wwangcece commented 8 months ago

Hello! Your work is excellent and has inspired and helped me a lot. However, this dataset seems to be too large, can you block it up and provide download links separately?

piperwolters commented 8 months ago

Hi there! Yes, I will start uploading individual sets today and hopefully you will be able to download them then.

wwangcece commented 8 months ago

Many thanks!

wwangcece commented 8 months ago

One more problem, I'm doing a large-factor super-resolution study, so I need some paired images with resolution of 3232 and 512512 to accomplish 16x super-resolution. I had been training and testing on synthetic data, and now I was eager to test my algorithms using real-world data. But I find that the data you publish seems to have been downsampled by a factor of four for NAIP. So can you provide NAIP data before downsampling? I would appreciate it if you can, and I will indicate the source of data in my research!

piperwolters commented 8 months ago

Ah, I see. I do have the original resolution NAIP data. It is obviously much larger than the downsampled version. Are you looking to train on this data or just test? If just test, I can quickly upload the val/test sets in full resolution.

wwangcece commented 8 months ago

Yes, in reality, I only need the validation set(8192 images). If possible, you can directly send the data to my email (2692809763@qq.com). Once again, express my gratitude for your open-source work!

piperwolters commented 8 months ago

Okay, awesome. I have uploaded the validation set in full resolution here. The directory structure is the same as the low-res version (naip/{image_uuid}/{zoom17_tile}/rgb.png), except for the image_uuid is now just '2019' or '2020' because the NAIP API recently changed the format in which files are downloaded. And I uploaded the urban train set as three parts. Part1, Part2, Part3.

Could you try downloading both of these to 1) make sure the validation set is how you expect it and 2) confirm that the new size of the training set chunks is small enough for you to download successfully?

wwangcece commented 8 months ago

Thank you very much, I can now download and use the validation and training sets as normal!