alephdata / ingest-file

Ingestors extract the contents of mixed unstructured documents into structured (followthemoney) data.
GNU Affero General Public License v3.0
53 stars 25 forks source link

Introduce a setting to disable sending ProcessingExceptions to Sentry #607

Closed stchris closed 2 months ago

stchris commented 3 months ago

A ProcessingException is thrown every time ingest-file isn't able to parse a file. In the current state, if Sentry support is enabled, each of these will create an event in Sentry. While these are valuable to have they can easily overwhelm the events budget so we are introducing a flag to disable sending these to Sentry, effectively making this one specific call opt-in. One can still rely on logs to figure out what went wrong in these cases.