search

SkyAPM / aiops-engine-for-skywalking

This is an incubating repository of the Apache SkyWalking AIOps Engine
https://github.com/apache/skywalking/discussions/8883
Apache License 2.0
37 stars 7 forks source link

Implement Drain3-based log clustering flow #23

Closed Liangshumin closed 1 year ago

Liangshumin commented 1 year ago

The cache for storing log-cluster is added, which saves the process of clustering the same logs repeatedly. Use Redis database to store logs, access logs in the way of streams, and use Ray for Redis stream processing

Superskyyy commented 1 year ago

Please change the PR title to a more meaningful one, it's unclear.

Superskyyy commented 1 year ago

The code to be merged serves the GSOC 2022 task, further enhancements are needed to optimize engine workflow.

Superskyyy commented 1 year ago

TODO after this PR, add Drain3 License to LICENSE.

Superskyyy commented 1 year ago

Generally looks good to me, thanks!