crowdsecurity / crowdsec

CrowdSec - the open-source and participative security solution offering crowdsourced protection against malicious IPs and access to the most advanced real-world CTI.
https://crowdsec.net
MIT License
8.83k stars 457 forks source link

[parsers/scenarios] Support local data urls #2761

Open LaurenceJJones opened 8 months ago

LaurenceJJones commented 8 months ago

What would you like to be added?

Whilst supporting users there are many cases where the data property of scenarios and parsers can be used. For example downloading a whitelist across multiple log processors at the same time. However, currently the data property is only taken into effect for downloading if the item origin is the hub.

/kind enhancement

Why is this needed?

Adding the ability for custom data sources to be downloaded means users dont need to compiled there own cronjobs to download custom data sources.

However, for the hub items that we accept via PR's we need to make it explicit that they must push the files into our sec-lists repository so we can make sure nothing malicious happens.

github-actions[bot] commented 8 months ago

@LaurenceJJones: Thanks for opening an issue, it is currently awaiting triage.

In the meantime, you can:

  1. Check Crowdsec Documentation to see if your issue can be self resolved.
  2. You can also join our Discord.
  3. Check Releases to make sure your agent is on the latest version.
Details I am a bot created to help the [crowdsecurity](https://github.com/crowdsecurity) developers manage community feedback and contributions. You can check out my [manifest file](https://github.com/crowdsecurity/crowdsec/blob/master/.github/governance.yml) to understand my behavior and what I can do. If you want to use this for your project, you can check out the [BirthdayResearch/oss-governance-bot](https://github.com/BirthdayResearch/oss-governance-bot) repository.
github-actions[bot] commented 8 months ago

@LaurenceJJones: There are no 'kind' label on this issue. You need a 'kind' label to start the triage process.

Details I am a bot created to help the [crowdsecurity](https://github.com/crowdsecurity) developers manage community feedback and contributions. You can check out my [manifest file](https://github.com/crowdsecurity/crowdsec/blob/master/.github/governance.yml) to understand my behavior and what I can do. If you want to use this for your project, you can check out the [BirthdayResearch/oss-governance-bot](https://github.com/BirthdayResearch/oss-governance-bot) repository.