ValueError: could not broadcast input array from shape (0,) into shape (366,)

[fmoraess]

I am using Daymet data (netcdf) to run the climate-indices for the Caribbean. When trying to run the daily SPI for scales 30 days, I am using a netcdf with 2 years of daily precipiration data (lat=231, lon=364, time=730). However, I am getting the following error regarding the shape of the array:

"process_climate_indices --index spi --periodicity daily --netcdf_precip input/PR_precip_V4.nc --var_name_precip prcp --output_file_base output/PR_spi --scales 30 --calibration_start_year 1980 --calibration_end_year 1981 --multiprocessing all 2021-03-09 21:39:56 INFO Start time: 2021-03-09 21:39:56.448634 2021-03-09 21:39:56 INFO Computing 30-day SPI/Pearson 2021-03-09 21:39:58 ERROR Failed to complete Traceback (most recent call last): File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 1684, in main _compute_write_index(kwrgs) File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 798, in _compute_write_index _drop_data_into_shared_arrays_grid(dataset, File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 614, in _drop_data_into_shared_arrays_grid var_values = np.apply_along_axis(utils.transform_to_366day, File "<__array_function__ internals>", line 5, in apply_along_axis File "/home/fdsm/.local/lib/python3.8/site-packages/numpy/lib/shape_base.py", line 379, in apply_along_axis res = asanyarray(func1d(inarr_view[ind0], *args, kwargs)) ValueError: could not broadcast input array from shape (0,) into shape (366,)* Traceback (most recent call last): File "/home/fdsm/.local/bin/process_climate_indices", line 8, in sys.exit(main()) File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 1684, in main _compute_write_index(kwrgs) File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 798, in _compute_write_index _drop_data_into_shared_arrays_grid(dataset, File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 614, in _drop_data_into_shared_arrays_grid var_values = np.apply_along_axis(utils.transform_to_366day, File "<__array_function__ internals>", line 5, in apply_along_axis File "/home/fdsm/.local/lib/python3.8/site-packages/numpy/lib/shape_base.py", line 379, in apply_along_axis res = asanyarray(func1d(inarr_view[ind0], args, kwargs)) ValueError: could not broadcast input array from shape (0,) into shape (366,)"**

If anyone has an idea about what could be causing this error, it would be helpful!

Thank you!

[monocongo]

This may have to do with the requirement to use 366-day years. It looks like you are using 365-day years.

To fix this you need to add a time step for Feb 29th in each year, and have the precipitation value be NaN for all years except the leap year. Or you may be able to use this function in utils.py which converts normal daily data (Feb 29th only represented in leap years) to all 366-day years.

[fmoraess]

Thank you, James! I tried what you suggested and converted my years into 366-days years, but when trying to run the "spi_pearson_30' I got this error complaining about my time dimension being 366 instead of length 365 (below)

(clim_ind) fdsm@fdsm-VirtualBox:~/NOAA_Clim_In$ process_climate_indices --index spi --periodicity daily --netcdf_precip /home/fdsm/NOAA_Clim_In/input/daymet_v3_prcp_1981_366day_puertorico_TEST.nc4 --var_name_precip prcp --output_file_base /home/fdsm/NOAA_Clim_In/output/TEST --scales 30 --calibration_start_year 1981 --calibration_end_year 1981 --multiprocessing all 2021-04-12 21:36:43 INFO Start time: 2021-04-12 21:36:43.277189 2021-04-12 21:36:43 INFO Computing 30-day SPI/Pearson 2021-04-12 21:37:28 ERROR Failed to complete Traceback (most recent call last): File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 1684, in main _compute_write_index(kwrgs) File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 1084, in _compute_write_index dataset[output_var_name] = variable File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/dataset.py", line 1429, in setitem self.update({key: value}) File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/dataset.py", line 3899, in update merge_result = dataset_update_method(self, other) File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/merge.py", line 956, in dataset_update_method return merge_core( File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/merge.py", line 619, in merge_core dims = calculate_dimensions(variables) File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/dataset.py", line 206, in calculate_dimensions raise ValueError( ValueError: conflicting sizes for dimension 'time': length 365 on 'spi_pearson_30' and length 366 on 'time' Traceback (most recent call last): File "/home/fdsm/.local/bin/process_climate_indices", line 8, in sys.exit(main()) File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 1684, in main _compute_write_index(kwrgs) File "/home/fdsm/.local/lib/python3.8/site-packages/climate_indices/main.py", line 1084, in _compute_write_index dataset[output_var_name] = variable File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/dataset.py", line 1429, in setitem self.update({key: value}) File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/dataset.py", line 3899, in update merge_result = dataset_update_method(self, other) File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/merge.py", line 956, in dataset_update_method return merge_core( File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/merge.py", line 619, in merge_core dims = calculate_dimensions(variables) File "/home/fdsm/.local/lib/python3.8/site-packages/xarray/core/dataset.py", line 206, in calculate_dimensions raise ValueError( ValueError: conflicting sizes for dimension 'time': length 365 on 'spi_pearson_30' and length 366 on 'time'

What should I do? Thank you for any help!