search

MISP / MISP

MISP (core software) - Open Source Threat Intelligence and Sharing Platform
https://www.misp-project.org/
GNU Affero General Public License v3.0
5.35k stars 1.39k forks source link

Bloom filter on Warning list #3034

Open mokaddem opened 6 years ago

mokaddem commented 6 years ago

It seems that checking against a huge warning list can heavily impact the processing time. Using redis or even bloom filter could greatly help.

iglocska commented 6 years ago

We have them in memory already per request, the cost cones mostly from looping and comparing. We're not doing string matching for some types for which it wouldn't really work...

On Mar 14, 2018 10:14 PM, "Sami Mokaddem" notifications@github.com wrote:

It seems that checking against a huge warning list can heavily impact the processing time. Using redis or even bloom filter could greatly help.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/MISP/MISP/issues/3034, or mute the thread https://github.com/notifications/unsubscribe-auth/ADf6wAYtzKUZ_QYnwB0iSqvd5zmoiwnvks5teRevgaJpZM4SqZ5Y .