Open PGijsbers opened 1 month ago
Task split files are currently wildly inefficient, having a lot of superfluous data, in addition to using arff instead of e.g., parquet. First, write up a proposal/demo and discuss it during the hackathon. Changes will affect the entire stack.
Task split files are currently wildly inefficient, having a lot of superfluous data, in addition to using arff instead of e.g., parquet. First, write up a proposal/demo and discuss it during the hackathon. Changes will affect the entire stack.