Debugging issues during import is currently not possible because the import does not output enough log messages. That's why we should update/add log messages in the following places:
FilesDataImporter.run(): Log total number of files & total number of intervals
Fix formatting of FilesDataImporter.getIntervalString(): log message Intervals '[0,1), '
FilesDataEmitter.emitRegularData() and FilesDataEmitter.emitParquetData()
Log filename, number of intervals & number of total rows
Debugging issues during import is currently not possible because the import does not output enough log messages. That's why we should update/add log messages in the following places:
FilesDataImporter.run(): Log total number of files & total number of intervalsFilesDataImporter.getIntervalString(): log messageIntervals '[0,1), 'FilesDataEmitter.emitRegularData()andFilesDataEmitter.emitParquetData()