Handle malformed input errors better

InQuest / ThreatIngestor

Extract and aggregate threat intelligence.

https://inquest.readthedocs.io/projects/threatingestor/

GNU General Public License v2.0

831 stars 135 forks source link

Handle malformed input errors better #42

Closed rshipp closed 5 years ago

rshipp commented 6 years ago

There are some situations where unexpected input (like weirdly formed RSS content) causes the program to crash.

We should just do best-effort parsing in these cases. Unexpected input should never cause an uncaught exception; same with network errors/etc. If an input is bad, we can just log something and skip it.

This is a requirement for initial release.

rshipp commented 5 years ago

Putting this through production testing right now.

rshipp commented 5 years ago

This is much stronger now. Going to close this issue in favor of #51, since there are some reliability changes coming along with that branch and I don't think we need to track this separately anymore.