Latency Version: Only save time information to meta.json.
Accuracy Version: Save the dataframe as soon as one is generated to avoid accumulating dataframes in memory. (Mainly for issues with Q10 and Q20 - large output dataframes)
Both the versions also save a final.csv in the output directory - this can be used for final result.
final.csv
in the output directory - this can be used for final result.