Open torronen opened 2 years ago
I am doing shuffle, and it seems it might be part cause for the low performance. Could that be the case?
TrainDataView = mlContext.Data.ShuffleRows(TrainDataView, 47, 50000, true);
I might be mistaken, but LightGBM, might not benefit from shuffling. Anyone knows if it is correct?
I am running LightGbmBinaryTrainer through AutoML API. The start of training is slow. Are there ways to make it faster? CPU usage is less than 1 core, HDD reading is also very low. The subsequent experiments seem much faster.
For example, should I read the data to memory before starting AutoML.
This is where it seems to spend most of time, on every pause. I have not run profiling though (it has some issues)![image](https://user-images.githubusercontent.com/26261427/146651154-22686c8c-fb47-4cb1-8a0f-712a84e78134.png)