Solve pipeline stalls

[juagargi]

The ingest pipeline seems to have slowed down its performance.

• [x] Investigate
• [x] Add better traces
• [x] Benchmark individual stages
• [x] Better distribution of load among stages in the files pipeline
• [x] Ditto, for DB pipeline
• [x] Create a new join method to join both pipelines

---

This change is