How to generate vocab file?

HelenGuohx / logbert

log anomaly detection via BERT

MIT License

240 stars 102 forks source link

How to generate vocab file? #2

Closed ChangNamAn closed 3 years ago

ChangNamAn commented 3 years ago

HI,

To perform main_run.py, it needs to vocab file and I found vocab.py to generate it. But vocab.py requests corpus. What corpus should be used for generating vocab file? log files? or normal text files? Note that I want to use your logBert for my custom log files.

Regards, ChangNam

ChangNamAn commented 3 years ago

When I performed run_logbert_bgl_2k.sh, I got the vocab.pkl file. Thank you.