Roman/dry ingest pipeline step

[rbiseck3]

Description

The main goal of this was to reduce the duplicate code that was being written for each ingest pipeline step to support async and not async functionality.

Additional bug fixes found and fixed:

• each logger for ingest wasn't being instantiated correctly. This was fixed to instantiate in the beginning of a pipeline run as soon as the verbosity level can be determined.
• The requires_dependencies wrapper wasn't wrapping async functions correctly. This was fixed so that asyncio.iscoroutinefunction() gets trigger correctly.

[sentry-io[bot]]

Suspect Issues

This pull request was deployed and Sentry observed the following issues:

• ‼️ IndexError: list index out of range /general/v0/general View Issue

_{Did you find this useful? React with a 👍 or 👎}