Update database once Consumer is done

[peterdudfield]

Detailed Description

How to update the input_data_last_updated once a consumer has run.

Context

• this table stores the most recent time the nwp, pv, sat, gsp, e.t.c has run
• currently most consumer update the input_data_last_updated. see here
• new NWP Consumer doesnt do this

Possible Implementation

• add into new nwp consumer
• add into dag to get it to do this, would need to give it DB_URL access

[peterdudfield]

One to think about @devsjc

[devsjc]

I feel like this is one for the dag not the consumer - especially if all the various data import jobs are meant to update the table, one could envisage a task at the end of each relevant dag

[peterdudfield]

yea, I'll try and write something and see how neat it looks in the dag

[devsjc]

Seems like less code duplication and seperation that way as well - one reuseable task vs several individual implementations in seperate microservices.

[peterdudfield]

Ill close this for now, as we do update this through the API now