AdamSulek / timelogs

0 stars 1 forks source link

[task] prefect task of retrive messages and insert timelog #10

Open AdamSulek opened 3 years ago

AdamSulek commented 3 years ago

It was solved by the task_flow.py file which contains the @task decorator and runs as a pipeline into the Flow context manager

AdamSulek commented 3 years ago
  1. get_latest_timestamps - if datestamp is None then set some previous time
  2. retrive_messages newer than latest timestamps
  3. parse_messages with line splitting if the message has many lines
  4. insert_into_db