Re-writers have been successfully tested in the scraper pipeline, but we need to remove it from this and configure its own module that will use the following flow.
Collect articles that have not yet been rewritten from the database
Rewrite the body of the articles
Post the new articles to a separate 'rewritten articles' table that will become the content read by the frontend
This will result in two tables in the database containing both original articles and the new re-written version.
Re-writers have been successfully tested in the scraper pipeline, but we need to remove it from this and configure its own module that will use the following flow.
This will result in two tables in the database containing both original articles and the new re-written version.