HelenGuohx / logbert

log anomaly detection via BERT
MIT License
240 stars 102 forks source link

indexing particular sequence in parsed structured log file #35

Open shoaib-intro opened 2 years ago

shoaib-intro commented 2 years ago

Is there any way to index (mark) anomaly log sequence back into parsed file usually named log_structured from drain? I tried to use following workflow for LineId from structured file along sequences to keep track of each logkey location in parsed structured file:

  1. generate_test
  2. fixed_window
  3. LogDataset

Inside LogDateset > random_item I could not pertain the sequence of LineId and sequence of logKey because of random function. could you please suggest another way to mark anomalies back into parsed structured file to visualize actual logline contents!