Wapiti08 / LogAnalyzer

Ensemble framework of some log based anomaly detection work.
MIT License
35 stars 16 forks source link

Workflow part missing #4

Closed shoaib-intro closed 2 years ago

shoaib-intro commented 2 years ago

Hi, I readout Deeplog paper is one of the best research have been done. I am trying this in my research work as pre-task and looking for source code but unable to find source code which includes three models features:

  1. logKey based prediction of next key (= log key path stacked LSTM based prediction)
  2. log Parameter based prediction of next parameter (= log parameters LSTM based prediction)
  3. Workflow clustering based creation.

I have looked around different repos with name 'deeplog' and wasted a long time on learning repos but nowhere found complete three models implementation. I looked into following repos:

https://github.com/Wapiti08/DeepLog
https://github.com/wuyifan18/DeepLog

could you please provide any source for Workflow and parameter anomaly with Deeplog approach not PCA to get done as part of pre-work in my research.

Best Regards,

Wapiti08 commented 2 years ago

That workflow part is kind of the process to update model based on prediction result. To be more precise, it is online learning. I have made a separate part from that on the Online Learning.

For secret reason, I am not able to tell you all. But hopefully you can get some ideas from that gist.

For this parameter anomaly with Deeplog approach, I have included in that project. Please check this

shoaib-intro commented 2 years ago

thanks for your quick response! I mean by workflow is clustering based creating workflows mentioned in Deeplog paper: Deeplog workflow second model

I just started working on your repo before starting wanted to make sure is everything implemented according to Deeplog paper especially Workflow model in this paper useful for me to find root cause of problem.

Thanks in advance!

Wapiti08 commented 2 years ago

Oh, I found it out. Sadly I did not implement that part in my resp. Maybe you need to find other projects.

Wapiti08 commented 2 years ago

You can reopen it if you have any other problems.