Traceback (most recent call last):
File "C:\Users\C\AppData\Local\Temporary Projects\pystore_Test\pystore_Test.py", line 30, in <module>
collection.write(item='spx', data=df, metadata={'source': 'ivolatility'}, npartitions=5, overwrite=True)
File "F:\anaconda3\envs\envTensorflow\lib\site-packages\pystore\collection.py", line 111, in write
chunksize=int(chunksize))
File "F:\anaconda3\envs\envTensorflow\lib\site-packages\dask\dataframe\io\io.py", line 177, in from_pandas
raise ValueError('Exactly one of npartitions and chunksize must be specified.')
ValueError: Exactly one of npartitions and chunksize must be specified.
I tried a couple different ways to apply partitions -vs- chunksize, but because the chunksize is specified I can't seem to find an easy way to execute the code using partitions
any suggestions on how to utilize partitions over chunksize?
I was hoping to set the number of partitions while writing a collection, but the code currently provides at error when executing:
In the following example I tried to execute the following code
collection.write(item='spx', data=df, metadata={'source': 'ivolatility'}, npartitions=5, overwrite=True)
The error I receive is:
I tried a couple different ways to apply partitions -vs- chunksize, but because the chunksize is specified I can't seem to find an easy way to execute the code using partitions
any suggestions on how to utilize partitions over chunksize?