worldbank / blackmarblepy

Georeferenced Rasters and Statistics of Nightlights from NASA Black Marble
https://worldbank.github.io/blackmarblepy/
Mozilla Public License 2.0
32 stars 7 forks source link

OSError: Unable to synchronously open file (file signature not found) #55

Closed dpatil-fw closed 4 months ago

dpatil-fw commented 9 months ago

Describe the bug OSError: Unable to synchronously open file (file signature not found)

To Reproduce Steps to reproduce the behavior: Just running a simple bm_raster call from the examples is giving this error:

GETTING MANIFEST...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████████████████| 4/4 [00:03<00:00, 1.10it/s] QUEUEING TASKS | Downloading...: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████| 360/360 [00:00<00:00, 2926.85it/s] PROCESSING TASKS | Downloading...: 75%|█████████████████████████████████████████[2024-02-10 22:28:56 - backoff:105 - INFO] Backing off _download_file(...) for 0.0s (httpx.ConnectTimeout: timed out) PROCESSING TASKS | Downloading...: 100%|█████████████████████████████████████████████████████████████████████████████████████████████████| 360/360 [00:30<00:00, 11.77it/s] COLLECTING RESULTS | Downloading...: 100%|███████████████████████████████████████████████████████████████████████████████████████████████████████| 360/360 [00:00<?, ?it/s] COLLATING RESULTS | Processing...: 0%| | 0/90 [00:00<?, ?it/s] Traceback (most recent call last): File "C:\pythonTest\blackMarble.py", line 37, in daily = bm_raster( File "C:\Users\Python310\lib\site-packages\pydantic\validate_call_decorator.py", line 58, in wrapper_function return validate_call_wrapper(*args, **kwargs) File "C:\Users\Python310\lib\site-packages\pydantic_internal_validate_call.py", line 81, in call res = self.pydantic_validator__.validate_python(pydantic_core.ArgsKwargs(args, kwargs)) File "C:\Users\Python310\lib\site-packages\blackmarble\raster.py", line 283, in bm_raster da = [ File "C:\Users\Python310\lib\site-packages\blackmarble\raster.py", line 285, in h5_to_geotiff( File "C:\Users\Python310\lib\site-packages\blackmarble\raster.py", line 66, in h5_to_geotiff with h5py.File(f, "r") as h5_data: File "C:\Users\Python310\lib\site-packages\h5py_hl\files.py", line 562, in init__ fid = make_fid(name, mode, userblock_size, fapl, fcpl, swmr=swmr) File "C:\Users\Python310\lib\site-packages\h5py_hl\files.py", line 235, in make_fid fid = h5f.open(name, flags, fapl=fapl) File "h5py_objects.pyx", line 54, in h5py._objects.with_phil.wrapper File "h5py_objects.pyx", line 55, in h5py._objects.with_phil.wrapper File "h5py\h5f.pyx", line 102, in h5py.h5f.open OSError: Unable to synchronously open file (file signature not found)

Any help is appreciated

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Additional context Add any other context about the problem here.

g4brielvs commented 9 months ago

@dpatil-fw Thank you so much for reporting this issue. It seems that the downloaded HDF5 file might be corrupted. I'll have to investigate further.

dpatil-fw commented 9 months ago

Sure. Found your work and all the documentation, very helpful. Thanks a lot!

aizadyar23 commented 8 months ago

I am facing this issue as well. I followed the steps in the documentation and faced the same error reported here.

cygniv404 commented 4 months ago

Any updates on this ?

mashafif commented 4 months ago

Hi! I was facing the same issue as well.

But when I tried to download the blackmarble HDF5 file manually from this website: NASA blackmarble manual download

It prompts me to fill out my "Affiliation" information on my Earthdata login profile.

Earthdata_Required_Profile

After filling out the required affiliation information, now I can download the HDF5 properly, and this error has disappeared.

It seems our TOKEN to access the API will not be valid, unless if we fill out the required "Affiliation" information on our Earthdata profile.

I hope it helps!

g4brielvs commented 4 months ago

@mashafif Thank you so much for your contribution! @aizadyar23 @cygniv404 Could you please check if the "Affiliation" might be missing and confirm if filling it out solves the issue?