intrigueio / intrigue-core

Discover Your Attack Surface!
https://core.intrigue.io
Other
1.35k stars 262 forks source link

Tweaks for export scale #421

Closed jcran closed 3 years ago

jcran commented 3 years ago

Two changes to help deal with issues we're running into on hosted service.

1) For large collections where entities have many many aliases, the change to issue export will help, without reducing fidelity of info since we have the alias_group_id to reconstruct.

2) For entities with many tasks creating them, this can sometimes cause entity sizes to blow up. For now (and this is probably a temporary fix to the problem), limit the list of exported task results to those that are not enrich tasks, and the first 100 only