search

alteryx / evalml

EvalML is an AutoML library written in python.
https://evalml.alteryx.com
BSD 3-Clause "New" or "Revised" License
735 stars 83 forks source link

Determine Gaps in AutoML Logging #3283

Open jeremyliweishih opened 2 years ago

jeremyliweishih commented 2 years ago

Currently IterativeAlgorithm logging outputs n pipelines ready for search in the logger when running AutoMLSearch. However, DefaultAlgorithm does not have such output. There could be more places where there are inconsistencies in output and this issue should track investigating where inconsistencies and how to resolve them.

chukarsten commented 2 years ago

@jeremyliweishih were there specific things you were thinking of? Or is this a general ask and you think there's some parity that can be achieved between the logging of both algos?

jeremyliweishih commented 2 years ago

@chukarsten I put this up as a general ask since I didn't do the investigation on what else is different yet. The example I put in the description is just one discrepancy I noticed! I was thinking that this issue would track investigating and if the differences are minimal or acceptable we can just close this issue as well.