search

SpatioTemporal / STAREPandas

STAREpandas adds SpatioTemporal Adaptive Resolution Encoding (STARE) support to pandas DataFrames. https://starepandas.readthedocs.io/en/latest/
MIT License
4 stars 1 forks source link

Error making trixels #160

Closed mbauer288 closed 9 months ago

mbauer288 commented 9 months ago

Any idea why I can't make trixels? pystare throughs an error.

ValueError: invalid literal for int() with base 10: '[ 668854913408696327  668960466524962823  669101204013318151\n  669136388385406983  669171572757495815  669206757129584647\n  669312310245851143  669699338338828295  669734522710917127\n  66994562894

File "/Users/mbauer/myDev/imergview/src/imergview/util/merra2_stare_db.py", line 360, in make_featuredb _trixels = sdf_1.make_trixels(wrap_lon=False, n_partitions=opts.n_parts, num_workers=opts.n_cores) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/STAREPandas/starepandas/staredataframe.py", line 368, in make_trixels trixels_series = starepandas.tools.trixel_conversions.trixels_from_stareseries(self[sid_column], ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/STAREPandas/starepandas/tools/trixel_conversions.py", line 551, in trixels_from_stareseries trixels_series = res.compute(scheduler='processes', num_workers=num_workers) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/mbauer/miniconda3/envs/stare/lib/python3.11/site-packages/dask/base.py", line 342, in compute (result,) = compute(self, traverse=False, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/mbauer/miniconda3/envs/stare/lib/python3.11/site-packages/dask/base.py", line 628, in compute results = schedule(dsk, keys, kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/STAREPandas/starepandas/tools/trixel_conversions.py", line 549, in trixels_from_stareseries(df, n_partitions=1, wrap_lon=wrap_lon)).flatten(),

File "/Users/mbauer/SpatioTemporal/STAREPandas/starepandas/tools/trixel_conversions.py", line 542, in trixels_from_stareseries trixels = to_trixels(sids, as_multipolygon=True, wrap_lon=wrap_lon) ^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/STAREPandas/starepandas/tools/trixel_conversions.py", line 494, in to_trixels vertices = to_corners(sids, wrap_lon=wrap_lon) ^^^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/STAREPandas/starepandas/tools/trixel_conversions.py", line 380, in to_corners vertices = to_vertices(sids, wrap_lon=wrap_lon) ^^^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/STAREPandas/starepandas/tools/trixel_conversions.py", line 46, in to_vertices vs = pystare.to_vertices_latlon(sids) ^^^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/pystare/pystare/spatial.py", line 590, in to_vertices_latlon lats, lons = pystare.core._to_vertices_latlon(sids) ^^^^^^^^^^^^^^^^^ File "/Users/mbauer/SpatioTemporal/pystare/pystare/core.py", line 256, in _to_vertices_latlon return _core._to_vertices_latlon(indices) ^^^^^^^^^^^^^^^^^ ValueError: invalid literal for int() with base 10: '[ 668854913408696327 668960466524962823 669101204013318151\n 669136388385406983 669171572757495815 669206757129584647\n 669312310245851143 669699338338828295 669734522710917127\n 66994562894

NiklasPhabian commented 9 months ago

The error almost makes it seem like the sids are a string rather than an int or an in array. Can we see the contents of 'sdf_1'?

mbauer288 commented 9 months ago

I figured it out. It was the exact way I used the DF to make the trixels... thanks for looking into it though.