ranaroussi / pystore

Fast data store for Pandas time-series data
Apache License 2.0
565 stars 101 forks source link

issue reading back an item with metadata.json but no "_metadata" #62

Open sdementen opened 2 years ago

sdementen commented 2 years ago

If I read back an item with no _metadata files but a metadata.json, I end up with the error below when fastparquet attemps to read the metadata.json as a parquet file.

File ".../fastparquet/api.py", line 121, in _parse_header
 f.seek(-(head_size+8), 2)
 OSError: [Errno 22] Invalid argument

I need to add write_metadata_file=True to my collection.write calls to ensure I always have a _metadata file created.