search

ciscocsirt / malspider

Malspider is a web spidering framework that detects characteristics of web compromises.
BSD 3-Clause "New" or "Revised" License
420 stars 78 forks source link

Purge Alerts via manage.py #27

Open r3comp1le opened 7 years ago

r3comp1le commented 7 years ago

Sorry if this can already be done. But my current method of deleting alerts is via the admin dashboard. And when trying to select all with 11k+ alerts, its hangs up the web browsers due to all the data being loaded for approval deletion.

jasheppa5 commented 7 years ago

Malspider has a "del_alerts" command you can use:

python malspider_django/manage.py del_alerts

The best fix for this is better database schema. Malspider creates new records every time it crawls, which is extremely inefficient. This is why you can end up with thousands and thousands of individual, unaggregated alerts over a short period of time. A better approach is having a first_seen and last_seen field for every element and every alert in the database. This is on my to do list.

-James

On Tue, Mar 28, 2017 at 2:15 PM, r3comp1le notifications@github.com wrote:

Sorry if this can already be done. But my current method of deleting alerts is via the admin dashboard. And when trying to select all with 11k+ alerts, its hangs up the web browsers due to all the data being loaded for approval deletion.

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/ciscocsirt/malspider/issues/27, or mute the thread https://github.com/notifications/unsubscribe-auth/AR0QEHAktfdO341i9pYwXgL465YXf6Yxks5rqU5HgaJpZM4Mr__O .