SkyAPM / aiops-engine-for-skywalking

This is an incubating repository of the Apache SkyWalking AIOps Engine
https://github.com/apache/skywalking/discussions/8883
Apache License 2.0
37 stars 7 forks source link

[Algorithm] Evaluate a potential new SOTA algorithm on stream log parsing #18

Open Superskyyy opened 1 year ago

Superskyyy commented 1 year ago

The following paper was recently published and claims to outperform Drain with some improvements.

Mainly the classification of logs and templates based on propositional logic.

Details 1) Proposition 1: the log message E belongs to the log template T. (2) Proposition 2: all the variable subsequences in the log message E share the same structure with their counterparts in the template T. (3) Proposition 3: not all the variable subsequences in the log message E share the same structure with their counterparts in the template T. (4) Proposition 4: the log message E does not belong to the log template T.

Although not a priority, it should be evaluated as we aim for better. Note: this algorithm doesn't have open implementation yet. I will send an email to the authors for a replication package. https://downloads.hindawi.com/journals/scn/2022/1559270.pdf