tech-by-design / polyglot-prime

Primary monorepo for TechBD polyglot bespoke code
https://tech-by-design.github.io/polyglot-prime/
GNU Affero General Public License v3.0
1 stars 18 forks source link

OpenTelemetry for real-time logs and metrics, SIEM log shipping and aggregation #58

Open razakpm opened 1 month ago

razakpm commented 1 month ago

Add log file for hub-prime java application with monthly iteration and day-wise rollout. Ensure proper environment variable to use in different environments

razakpm commented 1 month ago

Added log file. The file name can be set using an environment variable. Implemented monthly iteration with day-wise rollout.

shah commented 1 month ago

@razakpm reopening this ticket to ensure we're rolling logs into our SIEM as well. Please close once that's done.

shah commented 2 weeks ago

@razakpm are logs being rolled into a SIEM? Also we need to ensure observability is possible using OpenTelemetry and tools like Jaeger.

razakpm commented 2 weeks ago

We are evaluating Wazuh (https://wazuh.com/) for SIEM protection. The custom solution they provided is not working for us. We have raised a ticket for it (https://github.com/wazuh/wazuh/issues/24557) and are waiting for a response.

Meanwhile, the team is trying to understand the documentation at https://documentation.wazuh.com/current/user-manual/ruleset/decoders/index.html to see if it will help resolve the issue.

rinshadka commented 2 weeks ago

As per the community we need to create custom decoders and rules to parse the logs and team in working on the references provided. We will update soon once we successfully parse and fetch the data.