crowdsecurity / crowdsec

CrowdSec - the open-source and participative security solution offering crowdsourced protection against malicious IPs and access to the most advanced real-world CTI.
https://crowdsec.net
MIT License
9.08k stars 470 forks source link

Anomaly detection with ML #3312

Open Dewwi opened 3 weeks ago

Dewwi commented 3 weeks ago

This PR allows use of ML Inference via ONNX models for Anomaly Detection.

It enables use of huggingface tokenizer and onnx inference via CGO.

github-actions[bot] commented 3 weeks ago

@Dewwi: There are no 'kind' label on this PR. You need a 'kind' label to generate the release automatically.

Details I am a bot created to help the [crowdsecurity](https://github.com/crowdsecurity) developers manage community feedback and contributions. You can check out my [manifest file](https://github.com/crowdsecurity/crowdsec/blob/master/.github/governance.yml) to understand my behavior and what I can do. If you want to use this for your project, you can check out the [BirthdayResearch/oss-governance-bot](https://github.com/BirthdayResearch/oss-governance-bot) repository.
github-actions[bot] commented 3 weeks ago

@Dewwi: There are no area labels on this PR. You can add as many areas as you see fit.

Details I am a bot created to help the [crowdsecurity](https://github.com/crowdsecurity) developers manage community feedback and contributions. You can check out my [manifest file](https://github.com/crowdsecurity/crowdsec/blob/master/.github/governance.yml) to understand my behavior and what I can do. If you want to use this for your project, you can check out the [BirthdayResearch/oss-governance-bot](https://github.com/BirthdayResearch/oss-governance-bot) repository.
codecov[bot] commented 7 hours ago

Codecov Report

Attention: Patch coverage is 4.16667% with 23 lines in your changes missing coverage. Please review.

Project coverage is 41.23%. Comparing base (fb733ee) to head (6f99b82).

Files with missing lines Patch % Lines
pkg/exprhelpers/anomalydetection_stub.go 0.00% 13 Missing :warning:
pkg/exprhelpers/helpers.go 9.09% 10 Missing :warning:

:exclamation: There is a different number of reports uploaded between BASE (fb733ee) and HEAD (6f99b82). Click for more details.

HEAD has 2 uploads less than BASE | Flag | BASE (fb733ee) | HEAD (6f99b82) | |------|------|------| |unit-windows|1|0| |unit-linux|1|0|
Additional details and impacted files ```diff @@ Coverage Diff @@ ## master #3312 +/- ## =========================================== - Coverage 58.38% 41.23% -17.16% =========================================== Files 351 334 -17 Lines 37827 36470 -1357 =========================================== - Hits 22087 15039 -7048 - Misses 13831 19941 +6110 + Partials 1909 1490 -419 ``` | [Flag](https://app.codecov.io/gh/crowdsecurity/crowdsec/pull/3312/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=crowdsecurity) | Coverage Δ | | |---|---|---| | [bats](https://app.codecov.io/gh/crowdsecurity/crowdsec/pull/3312/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=crowdsecurity) | `41.23% <4.16%> (-0.01%)` | :arrow_down: | | [unit-linux](https://app.codecov.io/gh/crowdsecurity/crowdsec/pull/3312/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=crowdsecurity) | `?` | | | [unit-windows](https://app.codecov.io/gh/crowdsecurity/crowdsec/pull/3312/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=crowdsecurity) | `?` | | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=crowdsecurity#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.


🚨 Try these New Features: