search

jlewi / flaap

Federated Learning and Analytics Protocols
Apache License 2.0
0 stars 0 forks source link

Clear orphaned tasks in the TaskStore #3

Open jlewi opened 2 years ago

jlewi commented 2 years ago

We probably want some mechanism to clear tasks from the taskstore. This could probably be some combination of

  1. Labels - used to associate all tasks with a given job to enable cleanup if that job terminates
  2. Deadline/Timeout - to enable automatic garbage collection

Clearing the tasks should probably be invoked by the Executor's close method. https://github.com/tensorflow/federated/blob/54ae7836c593746e3dd9a3ccfe74f61d46005c5c/tensorflow_federated/python/core/impl/executors/remote_executor.py#L163