Open seatunneltrailuser opened 7 months ago
error while getting created time for file "919-sgnl1jjo.parquet":creation time is not available for the filesystem
@seatunneltrailuser What are you using a the filesystem? Could you please describe your setup?
I have seen the same error on my tests. My host file system is xfs.
Describe the bug While the Refresh Worker is performing pre-aggregations, we get multiple of this error
ERROR [cubestore::remotefs::cleanup] error while getting created time for file "919-sgnl1jjo.parquet":creation time is not available for the filesystem
For every intermediary file created by the pre-aggregation process, CUBESTORE is also performing cleanup of these files. It is failing to purge these files due to this issue - Creation time is not available for the filesystem.
To Reproduce Steps to reproduce the behavior:
Expected behavior These files are successfully cleaned up by the [cubestore::remotefs::cleanup] process.
Version: Docker image cube/cubestore:latest
Additional context Is it safe to clear these files manually ? Also, Are we missing any additional parameters to be set while starting up the RefreshWorker the job ?