search

logpai / logparser

A machine learning toolkit for log parsing [ICSE'19, DSN'16]
Other
1.61k stars 555 forks source link

Links with Loglizer project #14

Closed haltux closed 6 years ago

haltux commented 6 years ago

Hello,

I am slightly confused about the links between this project and the Loglizer project. It seems to me that the whole goal of parsing logs is to use its output as input of some anomaly detection algorithm, supervised or unsupervised, and that this is handled by the Loglizer project.

However the input of the Loglizer project does not match with the output of the Logparser project. Furthermore, all demos of the Logparser project are now using HDFS.log which seemingly does not have any labeling information, whereas Loglizer expect them.

More generally, is testing the complete chain Logparser + Loglizer possible today with the code and the data provided? If not do you work on another project in order to process the output of Logparser?

Thanks for your help.

zhujiem commented 6 years ago

Yeah, we are building this toolkit to cover the whole process of log processing, but currently the demo is under construction. The lables for hdfs dataset is available at https://github.com/logpai/loghub/tree/master/HDFS