search

salesforce / logai

LogAI - An open-source library for log analytics and intelligence
BSD 3-Clause "New" or "Revised" License
381 stars 56 forks source link

Example of custom file loader config lack of documentation #57

Open podarok opened 1 year ago

podarok commented 1 year ago

image

Any help in how to implement log analysis for syslog?

Prateek12333 commented 1 year ago

Yes those steps have not been mentioned in the documentation. If you want your own custom file to get run for Log Summarization use Custom_YourFileName in the uploaded_files folder(copy paste your file to uploaded_files folder and rename it to Custom_YourFileName) will bring that file in Log File filter for Log Summarization. For Anomaly Detection and Log Clustering I am also not sure and trying with trial and error to sort out the errors/exceptions for custom file execution.

aadhineniganesh commented 7 months ago

@Prateek12333 Any updates or any resources found to learn more about Anomaly Detection and Log Clustering with custom logs.

Prateek12333 commented 7 months ago

@aadhineniganesh No updates and no learning resources found on Anomaly Detection and Log Clustering for now. Those algorithms are working because they have hardcoded values(code that they have shared in GitHub link) in examples for both algorithms. If we try our own custom file there is no sort of solution which we can implement for those algorithms . If anything comes up will let you know and bring up the solution here. But as per my RND work we cannot bring out custom file/logs for both the algorithms.