search

logpai / loglizer

A machine learning toolkit for log-based anomaly detection [ISSRE'16]
MIT License
1.28k stars 426 forks source link

How to report the anomaly sequence #55

Closed Wapiti08 closed 5 years ago

Wapiti08 commented 5 years ago

Hi Guys:

I have used the PCA.py to get the following results: Total: 7940 instances, 313 anomaly, 7627 normal Train: 3969 instances, 156 anomaly, 3813 normal Test: 3971 instances, 157 anomaly, 3814 normal

I am considering how to print out the anomaly sequence or even the original log for processing and analysing. I checked the program, it says you need to check manually. Has it been reality to achieve the function I mentioned above? Or I need to figure it out by myself.

zhujiem commented 5 years ago

If you need the target anomaly sequence, you need to print the variables in the program for that.

Wapiti08 commented 5 years ago

In fact, i print it out. But it does not make sense. It is normalized sequence. I was considering whether i can print out the original log or just the log key.

zhujiem commented 5 years ago

Did you figure it out? You need to keep the orginal eventID in data loader.

Wapiti08 commented 5 years ago

Yeah. I saved the dict with ID and really log and enable to report with really anomaly logs. Really thankful for your reply and helps.

zhujiem commented 5 years ago

Nice to know that. Could you please share your code for this with a pr?

Wapiti08 commented 5 years ago

Sorry, I just check the message. Not sure whether it is what you want, you saved the xx_sliding_24h_3h.csv file before. I just find the anomaly index in that file and trace back through this file.

Wapiti08 commented 5 years ago

I will pull it soon. Hope it will be helpful.

zhujiem commented 5 years ago

Many Thanks!