docprocessing migration

[mirrir0]

General Description

We need to migrate the doc processing from the last repo.

This doc processing needs to be staged for testing and processing progress.

• [ ] break pipeline into separate issues
• [ ] update database about progress on stages