How to define log_format and regex[] for each dataset?

logpai / logparser

A machine learning toolkit for log parsing [ICSE'19, DSN'16]

Other

1.61k stars 555 forks source link

How to define log_format and regex[] for each dataset? #81

Closed charleswu52 closed 2 years ago

charleswu52 commented 2 years ago

How to determine the parameters in the demo code to get the best classification effect.

PinjiaHe commented 2 years ago

You could check a small sample of the logs (e.g., 100) to figure out the log_format. For regex[], you could also start with some simple yet effective ones, such as IP addresses.