ShifuML / shifu

An end-to-end machine learning and data mining framework on Hadoop
https://github.com/ShifuML/shifu/wiki
Apache License 2.0
251 stars 109 forks source link

Overall Log Redesign #659

Open zhangpengshan opened 5 years ago

zhangpengshan commented 5 years ago

So far in each step there are a lot of running logs but most of logs make user lost. According to Shifu pipeline and some issues from users, a new design may be better, three parts may be included in each step console:

  1. Effective configurations and description of each configuration
  2. Running logs
  3. Stats logs like total count, valid count, training count, valid count and others for user to reference if something configured wrong or if running with data volume are as expected